That does suck; I contemplated doing the same thing, but I was outbid on the auction

I'd still get in touch with the guy and see if there was a way to remove the flags, at least for your rep

if you do, be cool about it ;)