"But there could still be real poverty behind it. How do you want to judge that?"

I think people are inclined to help others when they can, but a few bad apples make the act of giving difficult for everyone. It leaves the potential giver feeling unsure and guilty for their suspicion, while the actual needy receiver is unable to get the help they need.