Viewing a single comment thread. View all comments

Ulfgardleo t1_j91e648 wrote

Reply to comment by goolulusaurs in [D] Please stop by [deleted]

Due to the way their training works, LLM cannot be sentient. It misses all ways to interact with the real world outside of text prediction. it has no way to commit knowledge to memory. It does not have a sense of time or order of events, because it cant remember anything between sessions.

If something cannot be sentient, one does not need to measure it.

2

liquiddandruff t1_j92fnve wrote

confidently wrong https://arxiv.org/abs/2302.02083

2

Ulfgardleo t1_j96vdnc wrote

but theory of mind is not sentience. it is also not clear whether what we measured here is theory of mind.

1

liquiddandruff t1_j984iw5 wrote

the point you're missing is we're seeing surprising emergent behaviour from LLMs

ToM is not sentience but it is a necessary condition of sentience

> it is also not clear whether what we measured here is theory of mind

crucially, since we can define ToM, definitionally this is infact what is being observed

none of the premises you've used are sufficiently strong to preclude LLMs attaining sentience

  • it is not known if interaction with the real world is necessary for the development of sentience

  • memory is important to sentience but LLMs do have a form of working memory as part of its attention architecture and inference process. is this sufficient though? no one knows

  • sentience if it has it at all may be fleeting and strictly limited during inference stage of the LLM

mind you i agree it's exceedingly unlikely that current LLMs are sentient

but to arrive to "LLMs cannot ever achieve sentience" from these weak premises combined with our of lack of understanding of sentience, a confident conclusion like that is just unwarranted.

the intellectually defensible position is to say you don't know.

1

goolulusaurs t1_j91ewpt wrote

You are just guessing, cite a scientific paper.

−2

Tribalinstinct t1_j91lz2u wrote

Sentience is the ability to sense and experience the world, do you really need a study on a algorithm that predicts what words it should combine to create believable sentences to understand how it's not sentient? Let alone self aware or intelligent? It has no sensors to interact with the wider world or perceive it, no further computation of actually processing the information or learning from it. It just scrapes and parses data then stitches it together in a way that makes it read as human like....

Cite me a study that you have a brain, would be nice to have one, but it's not information that is needed by a person who understands the simplest of biology and thus is able to know that there is in fact a brain there.

1