Viewing a single comment thread. View all comments

EOE97 t1_j5vmhro wrote

Reply to comment by dasnihil in Gary Marcus refuted?? by FusionRocketsPlease

But there's the possibility we could build specialised top class models and in the future we just keep making them more amd more multimodal and general by adding other models on top of it.

Maybe that's another way to AGI. Narrow AI models/agents strewn together such that the sum is greater than the parts.

10

dasnihil t1_j5vnkn4 wrote

all my engineering intuition bets against that. but i do get the idea, and i also have a good intuition of what kind of intelligence this kind of approach will give rise to and i'm okay with that. nothing wrong with scaled up LLMs and reinforcement learning. all innovative algorithms are welcome. engineers will keep at it while fancy things distract others.

1

botfiddler t1_j5xxl9l wrote

Yeah, these language models might be one building block, but their output will for example need to be parsed and related to world models and specific knowledge graphs. Also, people have an individual memory and many other elements to them.

1