FTL travel is impossible for a multitude of reasons, but I fail to see this being one.

When you drive to your friends house, you assume it will be there. But there is nothing preventing it from burning down in your travel time, even if it is only 5 minutes.