to me this means, "As long as I can avoid the label so I can adhere to social norms and recruit for fascists/still look good, etc."

If that's what that statement to you, you need to study critical thinking..
Critical thinking is the objective analysis of facts to form a judgment.

muslim = religion. fact.
racism = bias against race = fact