It doesn’t matter how long you’ve known them, how close you are, etc. It’s okay to grow apart from someone or to cut them off if you feel like they have a negative impact on your life. That’s great if you want to communicate that point to them; that said, if someone’s got you down, constantly makes you feel bad, or you’re just no longer interested in being close to them, it’s okay to walk away.