You are probably right. Personally I only follow people I am interested in and do my best to keep that list up to date across all social networks. I unfollow not just because people aren't very good in my opinion but also because my interests have sometimes simply changed.