I have something in my ears the majority of the time, buds/IEMs at least 8 hours a day, then I have to sleep with earplugs. I've done this for years with no negative side effects. I just make sure to give them a break between the times I'm at work and sleeping, so I tend to use speakers or normal headphones the rest of the time. Oh, and make sure you're keeping stuff clean. The hardware and your ears.