The history is the big thing going the 770-810 range up to the 830s and higher.

My score was briefly 850 for a while, then I did two refis then I let my oldest credit card cancel itself (kept getting sold, I didn't activate it after getting three new cards in a year). Mine sit at 800 or so now. Nothing else changed other than my 25 year old card closing, and my oldest active account being only since 2014.

Seems really stupid, yes.