Viewing a single comment thread. View all comments

fiftythreefiftyfive t1_j55337s wrote

Reply to comment by barneysfarm in ChatGPT really surprised me today. by GlassAmazing4219

“ At this point AI can only be trained on existing data, its not creating novel nueral connections that could result in original thought.”

Ah… no

AI also learns on feedback loop, and randomizes. So - it fosters a sense of what is “good”, based on feedback loop, and can create new things based on that feedback loop.

1

barneysfarm t1_j5537d0 wrote

It's not creating anything that doesn't already exist. Not at this point.

2

fiftythreefiftyfive t1_j5554an wrote

It is. Like, you can ask it for essays about extremely obsucure topics that likely no one ever wrote an essay on. Specify a length. Even on abstract topics - (whether some character from a not all too well known show is inherently evil or not). It’ll produce you a coherent answer, mention all the relevant scenes, you can adjust what position you want it to take or how long you want the essay to be etc…

What it’s strongest at currently, is the ability to tie ideas together - for example, scenes from a show and concepts (such as “inherently evil”). Hence why it’s particularly good at essays.

0

barneysfarm t1_j555el5 wrote

And it all depends on the user, the code, and the data it pulls from to make a response. It's not independently creative or intelligent, it is great at making people believe it is.

2

fiftythreefiftyfive t1_j556cn0 wrote

It’s not just making trees. That’s part of it, sure, but a big part of it is artificial neural networks (don’t mind the name, I don’t like it either) with feedback loops. You can think of it as a more efficient form of evolution - random modifications in its behavior that leads to changes in outcome, behavior that is then either encouraged or discouraged based on feedback (based on human input and if it’s well made, on self-testing). That’s part of the code. And that type of code is capable of creating new things, new solutions.

0

barneysfarm t1_j556xjt wrote

I dont disagree with you. The point I was trying to make in reply to the original comment is that it simply cannot be independently creative given that everything in its function depends on the inputs it receives from the user, the data it has to pull from, and sure, an evolving code base.

It's the same reason that yes it can string together existing thoughts from existing data into an essay, but it hasn't produced any novel ideas because it can only pull from existing data.

2

fiftythreefiftyfive t1_j5594u3 wrote

The point I’m trying to make is that this evolving code part is capable of creativity, or at least a very good imitation of it.

That’s the main thing distinguishing old chess/go bots from the new generation, which has become way, way stronger. The old bots essentially just did depth searches and then evaluated positions based on spoon fed human knowledge. This was a big hurdle for Go bots in particular, because depth searches are extremely computationally difficult with a board that large.

The new generation instead, plays millions of games against itself. It randomly changes its strategies over time. If it wins, it tells itself, “hey I won! Maybe that is worth remembering”, slightly changes it’s code accordingly and continues building from there.

These type of bots are capable of coming up with completely new strategies on their own. Again - not just through search trees, that’s completely infeasible for a game like go - but by modifying its own code incrementally until it knows how to play the game. And similar things can happen here, even to a lesser degree. Go/chess have the advantage of having very clear outlines of what “good” is - if you win the game, good, have your cookies continue just like that, sport. For essays etc… it’s a bit more vague - the best we have is user feedback, and you need some separate intelligent code to generate “feedback” on its own. But in this manner, it does something that is, imo, akin to “creativity”

1

barneysfarm t1_j55f5ul wrote

It still cannot do so independently. That's my point. It depends entirely on our collective knowledge to do any of that. It is not creative by itself.

1

fiftythreefiftyfive t1_j55g18k wrote

Neither do humans. People didn't suddenly produce great art work, from the flat medieval art to the quality we saw to the great renaissance art took centuries, generations of arrtists buiilding on each others small innovations. I think your expectations exceed what people are capable of.

1

barneysfarm t1_j55gbw1 wrote

Except for the fact that you can sit with no stimuli and still end up with outputs from your brain.

ChatGPT is entirely dependent on a creative user if it is going to make a creative output. It will not do so independently, which has been my entire point. It can only be perceived as creative because it relies on creative work and inputs from creative beings.

1