The old man sounds like a bully. As in, he targeted you and fucked with you, because that's what bullies do. I'm 95% certain he would've done the same things even if you immediately understood and gave him the seat.

It seems like you'll regret your actions either way, but sometimes shit just happens. There's no perfect path through life, even if every move you make is flawless.