After removing a lot of anti social "friends" in VRChat, I can say with confidence you should too.
If your friends are always "busy" hanging around other people for months despite you being there for them, they're not friends.
Find people that show love back, cut them out.