No I don’t, my mate listens to audiobooks, I read yet quite often he will use the terms he has read. In a conversation it doesn’t matter if you’re replying, does a bit if you’re starting it which you would say hey I have been listening to this book, have you read it.

Though I would say sometimes the distinction is important because you want to talk about a specific facet of either media. Like the illustrations and maps in the book, or the way the person narrating the book pronounces names.