Viewing a single comment thread. View all comments

AdditionalPizza t1_it8zew3 wrote

Reply to comment by mj-gaia in U-PaLM 540B by xutw21

Basically look at it this way, scaling works but we haven't scaled massive again (yet). But also in ELI5 terms, they're discovering significantly "better ways to scale" in a sense. So It's going to be bonkers when we do a next generation scale.

36

Spoffort t1_itbjybr wrote

In a way, it doesn't make sense to make big models when there is so much progress in the method of creating them, do you agree?

1

AdditionalPizza t1_itbr8e9 wrote

There's no point in wasting money/time on a large model right now, I agree.

At least until they're satisfied enough to try another larger model again.

2