Not comfortable with group of people

Hello everyone, I came here because I really need a piece of advice. We all have different personalities I understand that and I am this type of person that IDGAF about what you wear, what you do. But, I met these group of people whom my mental health was really affected. She’s kind, she says whatever she wants to say but everytime she do that I feel gaslighted. One time its summer and hot I wore socks with birken like sandals on or slippers and she always tells me why am I wearing socks. I started keeping my distance, because I really dont feel being around them.I am also this type of person in which as long as I can find ways and do things on my own I will not ask for help. Im just not into these group of people because I really dont belong or I just dont want to I have my own space and boundaries. My main concern is my husband he is very friendly and out going and they are the only group of people I dont want to be with so I just let him spend time with them which I really dont care because he has his own life with friends.