Unfortunately the vindictive pigs that engage in this sort of activity get some kind of pleasure out of it, and there is not yet a countermeasure against it. I just got downgraded 6 reputation points by @berniesanders for calling him out for being envy-motivated and it cost me $230 in rewards for my first well upvoted post. That was my next month's rent.
He even edited his counter-roast post saying with 'regret' that it's a shame his downvote cost me so much rep when I post so much good stuff. Yeah, real soft heart this guy.