For the same reason you don't see such "trails" of the cars on the road next to you. The light coming from the time when object was in different location already reached you in the past.

The "trails" you refer to are essentially what you perceive as "object moving".