Why is it, because of my anxiety from past trauma, that when I have a hard time with others that makes me the problem?

I keep hearing the same point over and over again. That if you get a lot of the same treatment from people wherever you go, your the problem. How can I be the fucking problem when i usually don’t even get the chance to show who I am as a person before I’m judged and labeled as a freak.