Feel like my fwb is too attached

Right for some context I went on a couple dates with this dude and got into him when he only saw me as a friend. He told me at the time he was conflicted in how he felt about me but after the second date dubbed me a friend, We started being fwb because I was the one attached (yes that’s dumb) but after two meet-ups I just lost all feelings and don’t view him that way anymore. Well we’ve been meeting up about 4 times a week for a Month and he always Chooses to stay over because he “likes spending time with me and talking to me” and we usually pop on a film. Now I feel like this is too intimate but because as I said before I don’t really care for him that way anymore, it doesn’t bother me , I get company without getting hurt. however I feel like his behaviour is weird and my friends agree. For example , he will ask me to “look into his eyes as it makes him feel a connection to my heart more”, talk about stuff he loves about me and has gotten drunk and told me he loved me but then took it back the next day when I confronted him. We have an insane amount of chemistry. He likes to have deep chats at night which I just make myself zone out on because as mean as that is I don’t want to know this stuff when I’m being casual and I do not open up in return. When I go to his I leave as soon as it is over, he sometimes comes at like 10pm then leaves at 12am the next day. He will cuddle me weirdly intimately imo and my friends agree. Like I said, I don’t care about this because I no longer feel that way but I am coming to this Reddit for a third hand sight because i feel like I’m being manipulative. Everyone thinks he now has feelings for me he just can’t process them or some bs (which is why I no longer like him as I cba for that stuff) but I feel like I’m being a bad person for allowing him to still come over? Maybe I’m overthinking but someone else’s perspective would be nice. I can’t explain it , I feel like when I switched off my feelings for him, his sort of started up more? It could be nothing since he told me at the start he didn’t see me that way but his actions have changed so much since we started having sex which I don’t mind because like I said I get company and sex without getting my heart broke but I feel manipulative even though it is his choice.