Viewing a single comment thread. View all comments

GoldenRain t1_jdr38ub wrote

Even Openai says LLM are unlikely to be the path to AGI.

3

maskedpaki t1_je2lgig wrote

Ilya sutskever literally believes that next word prediction is general purpose so you are just wrong on this.

The only thing he is unsure about is if something more efficient than next token prediction gets us there first. It's hard to defend Gary marcus' view that gpt isn't forming real internal representations since we can see that gpt4 so obviously is.

1