Submitted by Berke80 t3_118ay2c in singularity
From what I can follow on the web, Bard is not as competitive as openAI’s chatGPT. DeepMind launched some incredible feats before. Are the large language models not as advancedly researched at DeepMind?
Edit: grammar
Google is very strong in LLMs as well, they have several models of excellent quality. For example Google PaLM is 3x bigger than GPT-3.
However, it is rumored that Bard is a scaled down version of Lamda, only a 2B parameter model but trained on a lot more data than GPT-3. The size would probably make it somewhat less powerful, but also dramatically cheaper to run. It is also possible they have some secret sauce that would make a lot smaller model competitive. We shall see.
I think the Google's problem is that they currently completely dominate search and any disruption is simply not good for them as they have everything to lose and not much to gain. Also search is pretty much the only way Google makes money. So this is existential for them. But make no mistake, they are the clear leader in AI in spite of recent advances by OpenAI and Microsoft.
This is really good video about topic:
Current AI war between Google and Microsoft and why it is so important.
Thanks, I’m guessing reinforcement learning is not as useful in advancing LLMs.
First, Google has the best language models we know about if we look at benchmarks results, with it's PaLM model.
Second, Google has a much higher standard for what they have been willing to release (which seems to be changing because of the competition).
Third, DeepMind will be releasing their own LLM (Sparrow) - which will most likely be quite capable, as well as accurate.
Fourth, Google will be releasing LaMDA (which powers Bard) soon, and there's no data that shows it's any less proficient than any other model out there, although there are rumours that the smaller model behind Bard might be not competitive enough to impress, although it would be cheap enough to scale for more users.
Fifth, it's important to remember that both ChatGPT and Sydney make numerous mistakes, they are just in a position where they are much less scrutinized for those mistakes
I think you missed a point, the most important point. Each prompt costs gpt a few cents.
It would be way too expensive to have something like that at the scale of google search.
They have to make something that is far, far cheaper.
Exactly this, Google has several very powerful LLMs in play. Looking at the slow motion disaster that is the Bing chat it looks to me that it was perhaps prudent for them to wait a bit instead of rushing.
Some very good and satisfactory answers here. I’m thankful.
Different objectives. They could do that, if Google told them to. But they’re focusing on other things as well, like AlphaFold, Reinforcement Learning, Robotics, Medical applications, and even things like nuclear fusion.
They have their own answer to ChatGPT. They also do research on LLMs… but keep in mind that DeepMind does not develop products. They do research.
Google is the one that needs to develop products.
Deepmind is busy at actually creating AGI, not just doing demos about AIs that know how to play with words
Guess they are not as advanced in LLM, it seems their focus is elsewhere, in more « b2b » applications… AlphaFold will change the world as much as chatGPT.
Thank you for your input, I was amazed by DeepMind’s previous achievements, namely AlphaGo, zero and most distinctly AlphaFold! (I have been a very long time Folding@home contributor; Seeing AlphaFold launch was mind blowing for me!)
I am pretty hopeful that they would do more amazing things, it just felt to me that they are withholding their horses in this LLM race.
https://github.com/deepmind/enn
deepmind is deep into LLMs but have no desires to capitalize on selling chat assistants/therapists.
Very interesting, much more actionable IRL to have a large set of answers with attached probabilities.
Reinforcement learning is just AI wall humping until it finds a door, then always knowing where that door is.
lol
They have lamda which is exactly the same as gpt3 chat. The issue is that google can't control or censor it properly, the censorship tech is waaaay behind the LLMs so they are keeping it locked up.
Lawjarp2 t1_j9g9ojl wrote
Deepmind is better at reinforcement learning. They probably did not expect LLMs to get this good. Still it is likely deepmind will get to AGI sooner than openAI. They have the breadth of knowledge required to build something like that. Unlike openAI they don't go all in on just one thing.