Viewing a single comment thread. View all comments

mj-gaia t1_it8rbkc wrote

Reply to comment by Sashinii in U-PaLM 540B by xutw21

I never understand a single thing posted here but comments like yours tell me that AI seems to be progressing really fast right now so thanks that’s all I need to understand I guess lol

27

AdditionalPizza t1_it8zew3 wrote

Basically look at it this way, scaling works but we haven't scaled massive again (yet). But also in ELI5 terms, they're discovering significantly "better ways to scale" in a sense. So It's going to be bonkers when we do a next generation scale.

36

Spoffort t1_itbjybr wrote

In a way, it doesn't make sense to make big models when there is so much progress in the method of creating them, do you agree?

1

AdditionalPizza t1_itbr8e9 wrote

There's no point in wasting money/time on a large model right now, I agree.

At least until they're satisfied enough to try another larger model again.

2