is keeping to myself and minding my business creating my issues ?

29f. so often im dealing with people essentially starting rumors about me or like creating narratives about me (usually that i am like secretly manipulative or have bad intentions or am out to get them in some way) and i just can’t understand why this is ? because i am a super homebody and i am always very honest about what i feel or think and i really just keep to myself while being like standard levels of confident ? i just don’t get where this shit is coming from. and now i’m wondering if the fact that i’m so internal irl is the reason ? like people rly don’t know so it leaves room to assume? it’s mean and i want it to stop and i keep to myself to keep my peace but apparently !!!!!!! that’s not working !!!!