I feel like a lot of these self help books are written for people who have next to no self esteem. If that's the case, straight up cutting down the amount of time you spend with toxic people to build up your self esteem a bit is a good move.

But when you have more self esteem, it doesn't have to be all or nothing. You can set healthy boundaries, and talk to people who are not necessarily toxic, but just have bad habits.