Viewing a single comment thread. View all comments

Lawjarp2 t1_j9g9ojl wrote

Deepmind is better at reinforcement learning. They probably did not expect LLMs to get this good. Still it is likely deepmind will get to AGI sooner than openAI. They have the breadth of knowledge required to build something like that. Unlike openAI they don't go all in on just one thing.

33

GPT-5entient t1_j9hgk2q wrote

Google is very strong in LLMs as well, they have several models of excellent quality. For example Google PaLM is 3x bigger than GPT-3.

However, it is rumored that Bard is a scaled down version of Lamda, only a 2B parameter model but trained on a lot more data than GPT-3. The size would probably make it somewhat less powerful, but also dramatically cheaper to run. It is also possible they have some secret sauce that would make a lot smaller model competitive. We shall see.

I think the Google's problem is that they currently completely dominate search and any disruption is simply not good for them as they have everything to lose and not much to gain. Also search is pretty much the only way Google makes money. So this is existential for them. But make no mistake, they are the clear leader in AI in spite of recent advances by OpenAI and Microsoft.

9

Berke80 OP t1_j9gdg93 wrote

Thanks, I’m guessing reinforcement learning is not as useful in advancing LLMs.

4

alexiuss t1_j9go6ip wrote

Ye. It's way too easy to trick lamda into writing infinite lewd stories.

1

Wyrade t1_j9gy1g1 wrote

I wouldn't have a problem with that.

4