Self votes on comments are for example a very valuable tool to bump it up higher in the list to gain visibility. This is a good reason for users to get SP. I want more reasons to get SP not less.

Remember it takes a lot of SP to get any significant payouts. You don't have to hate people who self-vote. You are hurting the system if that is your main criteria for flagging.