Anybody else have trouble remembering people’s names?

I often have trouble remembering the names of people, unless I specifically make an effort and memorize their names in advance from time to time. This can get quiet exhausting so I often mostly remember the names of people I am most close with. For other people sometimes I literally just don't remember their names, even if they've mentioned it like a day befor. It feels awkward to me to say that I forgot their names, specially when we're having a nice conversation. One time somebody asked me to hang out and I legit don't remember her name, so it felt pretty rude when it came up in the conversation if I know her last name and I admitted that I don't even know even her first name. How do I deal with this?