When I see a buyer's review for a particular seller or his service, I cannot see the buyer's other reviews. So I don't know if he is a genuine reviewer. You can only search for sellers profile, not buyers unless they place an order with you or they also happen to be both buyers and sellers.
And my concern is not about that. When you have a recent relevant review that's not good, and when you share your gigs (basically you ask someone you know or your social media friends to give you order on fiverr) , it gives sellers opportunity to hide their performance on a recent genuine order.
Which is why this is not a very good feature. Sellers with large network can always game the algo.