Viewing a single comment thread. View all comments

Hyper1on t1_j3wp270 wrote

Reply to comment by starstruckmon in [D] Microsoft ChatGPT investment isn't about Bing but about Cortana by fintechSGNYC

Why were OpenAI the first to make a model as good as ChatGPT then? It seems clear there is a significant talent and experience advantage in this. I should also mention that no company other than OpenAI has the same quantity of data on human interactions with large language models, thanks to the past 2 and a half years of the OpenAI API.

15

starstruckmon t1_j3wsh74 wrote

>Why were OpenAI the first to make a model as good as ChatGPT then?

That's a good question. OpenAI definitely is more open to allowing the public access to these models than other companies. While OpenAI isn't as open as some would like, they have been better than others. OpenAI might have pioneered some things but the problem is those aren't proprietary. They have published enough for others to replicate.

>It seems clear there is a significant talent and experience advantage in this.

If they can hold on to that talent. Not everyone there is gonna stick around. For eg. a lot of the GPT3 team went over to start Anthropic AI, which already has a competitor in beta.

>I should also mention that no company other than OpenAI has the same quantity of data on human interactions with large language models, thanks to the past 2 and a half years of the OpenAI API.

This is a good point. But is really better than the queries Microsoft has through Bing or Google through their search? Maybe, but still feels like little for 10B. Idk.

4

visarga t1_j419sn0 wrote

MS failed the search, abandoned the browser, missed the mobile, now they want to hit. It's about not fucking up again.

I don't think the GPT-3 model itself is a moat, someone will surpass it and make a free version soon enough. But the long term strategy is to become a preferred hosting provider. In a gold rush, sell shovels.

1

sockcman t1_j3wvzc9 wrote

Because the other big player (Google) didn't care enough / see the value. Google could snap their fingers and have chat gpt if they wanted. Google invented the model that gpt uses.

4

bouncyprojector t1_j3xk059 wrote

Except that Google publishes their research in detail and OpenAI doesn't. It's not clear how OpenAI has modified the GPT architecture/training other than some vague statement about using human feedback. Small changes can make a big difference and we don't really know what they've done.

2

All-DayErrDay t1_j3xtdbw wrote

Completely agree and that’s the difference that matters the most. Can’t always buy the most important things like talent. And hiding your research gains means you could have a lot of insights no one else has.

3

42gether t1_j40fxyg wrote

> Why were OpenAI the first to make a model as good as ChatGPT then?

Here's a controversial take: luck

They didn't invent the wheel or faster than light travel, it was something that was going to happen sooner or later and they were just the first to do it publicly, meanwhile Google fired a guy that mass mailed people saying their own ai was sentient.

4

visarga t1_j41aj3a wrote

> meanwhile Google fired a guy that mass mailed people saying their own ai was sentient.

Never imagined it would turn out so bad for Google to need Lemoine's testimony

1