fiftythreefiftyfive t1_j556cn0 wrote on January 20, 2023 at 2:01 PM

Reply to comment by barneysfarm in ChatGPT really surprised me today. by GlassAmazing4219

It’s not just making trees. That’s part of it, sure, but a big part of it is artificial neural networks (don’t mind the name, I don’t like it either) with feedback loops. You can think of it as a more efficient form of evolution - random modifications in its behavior that leads to changes in outcome, behavior that is then either encouraged or discouraged based on feedback (based on human input and if it’s well made, on self-testing). That’s part of the code. And that type of code is capable of creating new things, new solutions.

barneysfarm t1_j556xjt wrote on January 20, 2023 at 2:05 PM

I dont disagree with you. The point I was trying to make in reply to the original comment is that it simply cannot be independently creative given that everything in its function depends on the inputs it receives from the user, the data it has to pull from, and sure, an evolving code base.

It's the same reason that yes it can string together existing thoughts from existing data into an essay, but it hasn't produced any novel ideas because it can only pull from existing data.

fiftythreefiftyfive t1_j5594u3 wrote on January 20, 2023 at 2:21 PM

The point I’m trying to make is that this evolving code part is capable of creativity, or at least a very good imitation of it.

That’s the main thing distinguishing old chess/go bots from the new generation, which has become way, way stronger. The old bots essentially just did depth searches and then evaluated positions based on spoon fed human knowledge. This was a big hurdle for Go bots in particular, because depth searches are extremely computationally difficult with a board that large.

The new generation instead, plays millions of games against itself. It randomly changes its strategies over time. If it wins, it tells itself, “hey I won! Maybe that is worth remembering”, slightly changes it’s code accordingly and continues building from there.

These type of bots are capable of coming up with completely new strategies on their own. Again - not just through search trees, that’s completely infeasible for a game like go - but by modifying its own code incrementally until it knows how to play the game. And similar things can happen here, even to a lesser degree. Go/chess have the advantage of having very clear outlines of what “good” is - if you win the game, good, have your cookies continue just like that, sport. For essays etc… it’s a bit more vague - the best we have is user feedback, and you need some separate intelligent code to generate “feedback” on its own. But in this manner, it does something that is, imo, akin to “creativity”

barneysfarm t1_j55f5ul wrote on January 20, 2023 at 3:03 PM

It still cannot do so independently. That's my point. It depends entirely on our collective knowledge to do any of that. It is not creative by itself.

fiftythreefiftyfive t1_j55g18k wrote on January 20, 2023 at 3:08 PM

Neither do humans. People didn't suddenly produce great art work, from the flat medieval art to the quality we saw to the great renaissance art took centuries, generations of arrtists buiilding on each others small innovations. I think your expectations exceed what people are capable of.

barneysfarm t1_j55gbw1 wrote on January 20, 2023 at 3:10 PM

Except for the fact that you can sit with no stimuli and still end up with outputs from your brain.

ChatGPT is entirely dependent on a creative user if it is going to make a creative output. It will not do so independently, which has been my entire point. It can only be perceived as creative because it relies on creative work and inputs from creative beings.