there are no "unfair" downvotes. As the post says: Your Stake, Your Choice

Of course there are downvotes that are perceived as unfair and that can suck, but when you can protect yourself by blocks, then downvotes are pointless and that will be bad for steem overall. So we all have to accept that there will be flags and that we just have to move on