Viewing a single comment thread. View all comments

Nill444 t1_j4ff4gi wrote

>It can write simple boilerplate based on solutions it's already seen,

It can solve Advent of Code problems...

−1

manOnPavementWaving t1_j4fi6f0 wrote

Mediocre first year IT students can do that. But no way it's writing an efficient flash attention kernel without having seen one before.

3

2bdb2 t1_j4fw5ty wrote

>It can solve Advent of Code problems...

Which is a collection of relatively simple problems, commonly solved by first year students, where the solutions are almost certainly in the training data set....

2

Nill444 t1_j4gfcfx wrote

advent of code 2022 was ongoing when people were using ChatGPT for solving problems (although not all of them) it couldn't have been in the data set.

1

2bdb2 t1_j4j84pp wrote

The specific questions may not have been in the data set, but it'll have seen the same types of questions before.

1