Even if they were confirmed imposters, does it matter? If you wanna stay, stay and go with the flow. If you wanna go, just go. I've had lots of friends who were actually imposters, and this developed my imposter syndrome, but in the end I found that it doesn't matter; if you enjoy their presence, stay. If you don't, leave them.