I'm more worried about gamma ray bursts and strange matter, although I think asteroids should be used to take advantage of resource shortages that Earth demands without ruining the planet's ecosystem. At the same time, asteroids do provide the Earth with some defense from the elements, especially our own Asteroid Belt.