Ilya sutskever literally believes that next word prediction is general purpose so you are just wrong on this.

The only thing he is unsure about is if something more efficient than next token prediction gets us there first. It's hard to defend Gary marcus' view that gpt isn't forming real internal representations since we can see that gpt4 so obviously is.