Viewing a single comment thread. View all comments

bass6c t1_j96dhu0 wrote

Most of the technologies being used by openai are either from Google or from Deepmind. The transformer and instructed fine tuning,… are from Google brain. OpenAI recent success comes at a heavy cost for the ai community. Companies such as Google, Meta and Amazon will most likely stop publishing influential papers.

29

FusionRocketsPlease t1_j96um3f wrote

>OpenAI recent success comes at a heavy cost for the ai community. Companies such as Google, Meta and Amazon will most likely stop publishing influential papers.

What the hell they expected?

6

Utoko t1_j97767s wrote

hm they probably expected the non-profit "Open"AI not completely switch around stop publishing papers and becoming a for profit company. (Usually in the past that isn't the norm or the purpose of a nonprofit)

We had a couple of years were the cooperations somehow realized that sharing their research advanced progress a lot faster. OpenAI will get the companies back to protectionism.

20

visarga t1_j97eebr wrote

> OpenAI will get the companies back to protectionism.

Now that's an 180.

4

bass6c t1_j976we4 wrote

Collaborative Work and openness drive progress.

8

FirstOrderCat t1_j97i6py wrote

> Most of the technologies being used by openai are either from Google or from Deepmind.

it is just indication that google and deepmind create theoretical concepts but can't execute it to complete product.

4

bass6c t1_j97jd0e wrote

As if Google or Deepmind does not have or cannot buil models such as openai’s. As of now Google hold probably the most powerful language model in the world. Palm beat GPT models in every major beachmark. I’m not even talking about u-palm or flan palm (more advanced versions of palm).

3

FirstOrderCat t1_j97jovv wrote

> Palm beat GPT models in every major beachmark.

palm is much larger, which makes it harder to run in production serving many user's requests, so it is example of enormous waste of resources.

Also, current NLP benchmarks are not reliable, simply because models can be pretrained on them and you can't verify this.

5

bass6c t1_j97mvsk wrote

This was a reply to your comment stating Google can’t convert theorical concept into an actual product. That’s not the case. The thing is Google isn’t interested into shipping costly llm to only then hurt their own business. It’s not about they can’t it’s they won’t.

1

FirstOrderCat t1_j97o5hw wrote

I think my point still stands:

- Google didn't ship LLM as product yet, and now forced to catch up because lost innovation race (even you think they are not interested lol)

- OpenAI shipped multiple generations of LLM products already

6

thesofakillers t1_j9al7xs wrote

The RLHF paper from Christiano et al. in 2017 was a DeepMind-OpenAI collab

2

Villad_rock t1_j96njv3 wrote

Doesn’t Microsoft do any ai research?

1

PeedLearning t1_j97x4yf wrote

no, basically nothing in terms of fundamental research

−6

DukkyDrake t1_j984g11 wrote

A statement from extreme ignorance of reality.

−4