Viewing a single comment thread. View all comments

Grouchy-Friend4235 t1_itpfsgd wrote

Reply to comment by 4e_65_6f in Large Language Models Can Self-Improve by xutw21

Repeating what others said is not particularly intelligent.

−1

4e_65_6f t1_itpiu1j wrote

That's not what it does though. It's copying their odds of saying certain words in a certain order. It's not like a parrot/recording.

4

Grouchy-Friend4235 t1_iu0ozx1 wrote

That's pretty close to the text-book definition of "repeating what others (would have) said"

1

kaityl3 t1_itsyccp wrote

They can write original songs, poems, and stories. That's very, very different from just "picking what to repeat from a list of things others have already said".

4

Grouchy-Friend4235 t1_itwn1m9 wrote

It's the same algorithm over and over again. It works like this:

  1. Tell me something
  2. I will add a word (the one that seems most fitting, based on what I have been trained on)
  3. I will look at what you said and what I said.
  4. Repeat from 2 until there is no more "good" words to add, or the length is at maximum.

That's all these models do. Not intelligent. Just fast.

0