It's due to the fundamental mechanics of natural selection. Smaller avocados with smaller seeds likely got digested by stomach acid & so they never get to pass on their genetics. Over time, then only the larger seeds survive & so they propagate where as smaller ones didn't.