Viewing a single comment thread. View all comments

DamienLasseur t1_iw4rhcj wrote

Especially this 2nd half! Feels like the progress of AI has accelerated ten-fold. Likely due to the increased interest and investments being poured into the field. Competition drives innovation!

21

elonmusk12345_ t1_iw4wzpb wrote

Although I agree with the sentiment, it's important to note that VC funding for AI startups is down ~50% this year compared to last year.

12

Reddituser45005 t1_iw4ygwn wrote

The field is increasingly dominated by established tech giants so there is less opportunity for start ups. The cost of entry is high. In addition, it’s a mistake to just focus on US companies. AI research is happening globally and China, in particular, is battling the U.S. for AI supremacy.

25

visarga t1_iw6ab1o wrote

Maybe state of the art foundation models are hard to do without deep pockets, but applications built on these models are 100x easier to make now than before. I mean, you just tell it what you want. That's lowering the entry barrier for the public. Everyone can get in on it.

Used to be necessary to collect a dataset, create a custom architecture, train many models, pick the best, iterate on the dataset, etc to get to the same results. The work of months or years compressed into a prompt. It's not just artists that are being automated, traditional ML engineers too.

The only solution for ML eng is to jump on top of GPT-3 and its family, no more work left to do at a lower level. I am talking from personal experience, 4 years old project with 5 engineers and 3 labellers was solved at first sight by GPT-3 with no tuning. Just ask it nicely, it's all you have to do now.

4

Qumeric t1_iw6ynba wrote

2nd half looked more impressive, but actually, 1st half was much more impactful (Chinchilla, Gato, Minerva, AlphaCode).

2