Viewing a single comment thread. View all comments

Heizard t1_iyvqr6h wrote

We have liner progress bias and previous AI winter bias that heavily affect how we currently perceive scientific progress.

67

SoylentRox t1_iywax9s wrote

Yep. Note part of the cause of AI winters was massive hype over future AI capabilities. So while from 1965 to 2012 steady improvements were made in AI, from neural networks to numerous attempts at symbol logic machines to tons of other machine learning techniques, it was never amazing and instantly real world useful.

It would be like if physicists were hyping nuclear fission bombs for decades prior but they simply couldn't get their hands on more than a gram of plutonium or uranium. Hype all they want, it isn't gonna work.

Obviously once you reach criticality with fission crazy shit happens and reactor cores glow red hot with absurd amounts of activity. And prompt critical, well...

AI needs many many TOPs worth of compute and vast amounts of computer memory - a couple terrabytes of GPU memory is in use on these bigger models.

27