An important thing to note about Washington, DC is they did have housing covenants that restricted where persons of color could buy property/live. (Some areas in the country also had housing covenants against Jews and other marginalized groups.) Here is an organization that shares a lot of this history/research.