Adding to this, animals were (and are) massive disease vectors: if large numbers weren't present, that alone cuts down the risks dramatically.

Just as an example, one of the worst outbreaks in history came from the horses of nomads around China.