A book called The Rule of Empires discusses several examples of this dynamic in history. One people conquers another to exploit them, but distinctions blur over time, especially due to intermarriage. Once the typical imperial authority has a few half-other-community nephews, they start losing interest in maintaining social stratification.