Yes, I used to teach SCUBA in Thailand and we'd often get visited by passing whale sharks, we were really strict about leaving them alone and enjoying their presence. Anyone trying to touch them would have their mask ripped off and that usually makes them surface.

I was told their migration patterns are essential for breeding, mating, food and general health. I don't research it though, so hearsay.