I don't want atheists taking their religion into the public square.

When the country was founded most people believed in God or talked like they did. Everyone takes their spiritual beliefs, whatever they are, into their political philosophy. Nobody has the right to tell Christians that they don't belong in politics.