I don't think anyone cares if you remove your downvotes. Invest then that is good for steem it also means that if you downvote then or plagiarize then we have a more even playing field. You are not showing any respect to other people and in turn, will not receive any respect. The downvotes remain.