Don't forget metal-plated castle gates and portcullis.

And the comparison with armor is a bit unfair, as making armor is all about strength at low weight and mobility. A knights gauntlet was bleeding edge technology back then. Something a static thing like a wall would not require.