I have the same problem with people portraits. I feel that most people get uncomfortable getting photographed and that energy comes through to the photographer. I prefer just doing candid shot of people. Catching them off guard and unaware.
Animals are a different story. I love to photograph them. They usually don't care. I could photograph them all day.