> I’m also worried that I’ll be responsible for ruining his life if I break up with him.

He won't be ruined. He'll be single. There's a difference. Understand the difference. He'll have to deal with his own needs, which are not huge. Asking for some minimal effort in a relationship shouldn't result in disaster. He's carrying on like the world is ending. It's not.