I don't think being "annoying" is a good excuse to remove someone.

I mean if that was the case, NO ONE would have kids. Everything and everyone has their good and bad sides.