INTJ connecting

Looking for advice 20m

I took a personality test to see what my personality might be and if it’s the reason I have trouble connecting to people. I have deep rooted social problems and prefer intellectual activities over parties and spontaneity. Even among people in STEM I have difficulty making connections due to worldview as someone studying physics, though I am able to connect with others studying physics. Should I socially limit myself to this very small community, or should I try branching out?