I agree with your central point but I'm not sure when you say:

> If all of a sudden some new and different breed of dog appeared people would understand it was a dog, a CV model would not.

I'd be interested in testing this. Might be interesting to train it on dog recognition on some very big data set and deliberately leave one or two breeds out and then see how well it does.