Got told “it’s not funny when you say it” after saying a joke that everyone else was saying.

Today I was sitting in a group setting, playing mario kart together and this one person always says "I hate this map" when the next race starts. So everyone else in the group started saying the same thing to jokingly annoy the person. All is fine and person laughs about it too. But when I chimed in to the jokes, I got told by person "it's not funny when you say it" and now I feel like I overstepped a boundary or something. Tbf, I'm not really close to the people in the group because I met them not too long ago through mutual family (I'm also related to the person the joke was being made to). Maybe they just don't like me?