I like the idea of a separate Mana for downvoting... however...
I think downvoting needs to have some cost associated to it. both to the person receiving the downvote and the person using it.

I don't have a fully formed idea how to implement this, but, I applaud you for thinking about it.

Here's to the Crazy Ones!..the square pegs in the round holes.