It sounds like he's forcing you to be a landlord for you to have your way. I can understand that and the frustration that goes with it but in the eyes of the law you have to act as a landlord. As others have said an eviction notice stays on a record and most apartments won't rent to him once you evict him. It's not smart for him to do this in the long run but you have to follow the law or deal with the consequences.

Bemoaning the law meant to protect people and acting like he's always been a problem is bad form.