One of the best things you can do for your confidence and self-worth is to have clear boundaries.
Time Boundaries: Don't let others demand too much of your time
Physical: Stop people from invading your personal space
Emotional: Directly address the people who belittle or disrespect you
Nice guys in recovery, practice standing up for yourself by saying No to people.