You are right a large portion of our taxes all over the world is used to pay interest on loans.
But in the US over 50% tax-revenue go to the military and the war-machine. You'd have a lot less deficit spending, if this wasn't done.