marumari t1_jdas22s wrote
Reply to comment by erasmause in Google and Microsoft’s chatbots are already citing one another in a misinformation shitshow by altmorty
If you can’t predict what will come out then it’s not particularly deterministic. Maybe within a certain broad range of behaviors but that’s about it.
erasmause t1_jdaxed1 wrote
Deterministic just means that the process isn't stochastic, which aligns with my understanding of AI models (at least after they've been trained). Chaotic means the output is highly sensitive to small changes in the input, which admittedly also isn't a great description of what's going on, but does capture the difficulty of predicting the output without restoring to non-determinism.
marumari t1_jdb0gk6 wrote
It's possible we are using different semantics for "deterministic," I am mostly meaning that given the same input the AI will produce the same output. This is not what happens, although from a mathematics determinism standpoint you are correct.
born-out-of-a-ball t1_jdbj1fx wrote
OpenAI's GPT model is deterministic, but for ChatGPT they deliberately add variation to the user's input to get more creative answers.
erasmause t1_jdcr6ps wrote
Strictly speaking, a deterministic system only needs a feedback mechanism to generate different responses to the same input.
jdm1891 t1_jdb1hqe wrote
It is not deterministic, it picks randomly, with the distribution skewed towards more probable words. That is what makes them so good - the difference between deterministic and stochastic AI doing this is the difference between GPT and predictive text on your phone. The predictive text always picks the most probable word leading to run on and repetitive sentences GPt has the ability to pick a less likely word which allows it to write much more varied and niche things.
It being stochastic is also the reason you can have it regenerate responses.
Viewing a single comment thread. View all comments