I do pretty much the same thing. I upvote genuine comments, ignore the ones with no substance, and flag the spam.

I always check the users comments before I flag anything because there is a growing number of people who's English is just not good. They may be trying to be genuine but it looks like spam.