“He will run yesterday” is perfectly grammatical.

Too many people use “ungrammatical” to mean “this sentence just doesn’t sound right”. It has a much narrower meaning than that.