How about, it’s none of your business as to the reason for my haste? I could be heading to the hospital to see a dying relative, rushing a child to the hospital or even about to shit my pants.

Regardless of the situation, if someone is in that much of a hurry, let them by. You going slowly is not a moral/ethical win.