I listen to lots of audiobooks. Typically I listen while I'm doing rather mundane things that don't detract my attention. If I do lose track, it's not a big deal to go back a chapter or rewind a few minutes. I also listen to most of them at 1.5 speed depending on the narrator. If a book is complex, I'll save it for listening in the car or bedtime, some occasion where I have less to distract me.