GrandMasterPuba t1_jdtzwu3 wrote
Reply to comment by izumi3682 in You Can Have the Blue Pill or the Red Pill, and We’re Out of Blue Pills - Yuval Harari on threats to humanity posed by AI by izumi3682
>Then I typed, because I was not going to take a chance that I could not understand a HS grad equivalent explanation, "Explain this abstract in a manner that would be appropriate to a 6th grader". And in a split second it did. And then I fully understood what the abstract meant.
Prove it. Post what it said to you. Let us see that it truly understood and not that you are simply seeing what you want to see.
izumi3682 OP t1_jdvy7rh wrote
Have you never tried Chatgpt? Anybody can use it. It's free and available. And it is beyond belief. Let me ask you this. At what point is is it likely a narrow AI can have enough processing speed, "big data" and novel computing architectures, that it can mimic "understanding" in such a way that to our perception it is indistinguishable from actual understanding. In other words, the exact same outcome from two vastly different cogitational procedures. In fact they are so different that it is only the laws of physics that are being obeyed. A simple example the horse and our artificial "horse", the automobile. Who says that an AI must operate the way a biological brain operates? It will do what we want but in an utterly alien way. Humans are incredibly easy to trick. You will believe the AI is conscious and self-aware. But it won't be at all. And it won't matter.
Anyway, let me see what i can do. The one thing I can't reproduce for you in text here, is the unbelievable speed at which Chatgpt operates. You have to go see that for yourself.
I could not remember what precisely I was looking for in that solar wind question, so instead I went to find an introductory abstract of the original paper on string theory. Then I did the same things I did in the example above. The copypasta is entirely unedited and is as it was copied. Having said that, the presentation is far more user friendly than this c/p obviously because of greatly different formats. Also, probably because I was using Chatgpt at a peak user time of about 11:30 AM the answers were generated slightly slower. It took about 2 seconds for each answer instead of a split quarter second. But the first time I used it was at 2 AM local time. There are probably lots of localized servers that keep the speed up as it is.
Here it is.
Welcome back! What would you like to chat about? Received message do you understand this abstract? Sent message. do you understand this abstract? I’m sorry, but I don’t see any abstract in the web page context. Could you please provide more information or clarify which abstract you are referring to?
Received message. I'm sorry, but I don't see any abstract in the web page context. Could you please provide more information or clarify which abstract you are referring to?
Like DislikeMore . Introduction/Overview 1.1 Motivation for String Theory Presently we understand that physics can be described by four forces: gravity, electromagnetism, the weak force, responsible for beta decays and the strong force which binds quarks into protons and neutrons. We, that is most physicists, believe that we understand all of these forces except for gravity. Here we use the word “understand” loosely, in the sense that we know what the Lagrangian is which describes how these forces induce dynamics on matter, and at least in principle we know how to calculate using these Lagrangians to make well defined predictions. But gravity we only understand partially. Clearly we understand gravity classically (meaning in the ~ = 0 limit). As long as we dont ask questions about how gravity behaves at very short distances (we will call the relevant breakdown distance the Planck scale) we have no problems calculating and making predictions for gravitational interactions. Sometimes it is said that we don’t understand how to fuse quantum mechanics and GR. This statement is really incorrect, though for “NY times purposes”, it’s fine. In fact we understand perfectly well how to include quantum mechanical effects into gravity, as long we we dont ask questions about whats going on at distances, less than the Planck length. This is not true for the other forces. That is, for the other forces we know how to include quantum effects, at all distance scales. So, while we have a quantum mechanical understanding of gravity, we don’t have a complete theory of quantum gravity. The sad part about this is that all the really interesting questions we want to ask about gravity, e.g. what’s the “big bang”, what happens at the singularity of black hole, are left unanswered. What is it, exactly, that goes wrong with gravity at scales shorter than the Planck length? The answer is, it is not “renormalizable”. What does “renormalizable” mean? This is really a technical question which needs to be discusse Sent message. Yes, I understand the text you provided. It appears to be an introduction or overview of a document discussing the motivation for String Theory. The text explains that physics can be described by four forces: gravity, electromagnetism, the weak force, and the strong force. While most physicists believe that they understand all of these forces except for gravity, the text clarifies that gravity is understood classically and partially at the quantum level. However, a complete theory of quantum gravity is still lacking. The text also mentions that interesting questions about gravity, such as the nature of the “big bang” and black hole singularities, remain unanswered due to the lack of a complete theory of quantum gravity.
Is there anything specific you would like to know or discuss further?
Received message. Yes, I understand the text you provided. It appears to be an introduction or overview of a document discussing the motivation for String Theory. The text explains that physics can be described by four forces: gravity, electromagnetism, the weak force, and the strong force. While most physicists believe that they understand all of these forces except for gravity, the text clarifies that gravity is understood classically and partially at the quantum level. However, a complete theory of quantum gravity is still lacking. The text also mentions that interesting questions about gravity, such as the nature of the "big bang" and black hole singularities, remain unanswered due to the lack of a complete theory of quantum gravity. Is there anything specific you would like to know or discuss further? Rephrase this in a manner that would be understandable to a 6th grader. Sent message. Sure! Here’s a simpler version: Scientists study how everything works using four main ideas called forces. These forces are like special powers that make things move and stick together. One of these forces is called gravity, which is what makes things fall down and keeps us on the ground. Scientists understand a lot about how gravity works when things are big, like planets and stars. But when things are very, very small, it’s harder to understand how gravity works. That’s why scientists are trying to learn more about it.
Is there anything else you would like to know?
Received message. Sure! Here's a simpler version: Scientists study how everything works using four main ideas called forces. These forces are like special powers that make things move and stick together. One of these forces is called gravity, which is what makes things fall down and keeps us on the ground. Scientists understand a lot about how gravity works when things are big, like planets and stars. But when things are very, very small, it's harder to understand how gravity works. That's why scientists are trying to learn more about it. Is there anything else you would like to know? Rephrase this in a manner understandable to a sixth grader but include an explanation of string theory and quantum gravity Sent message. Sure! Here’s a simpler version that includes an explanation of string theory and quantum gravity: Scientists study how everything works using four main ideas called forces. These forces are like special powers that make things move and stick together. One of these forces is called gravity, which is what makes things fall down and keeps us on the ground. Scientists understand a lot about how gravity works when things are big, like planets and stars. But when things are very, very small, it’s harder to understand how gravity works. That’s why scientists are trying to learn more about something called quantum gravity, which is a way to explain how gravity works when things are super tiny.
One idea that scientists have come up with to help explain quantum gravity is called string theory. String theory is like a story that says everything in the universe is made up of tiny strings, kind of like pieces of spaghetti. These strings wiggle and move in different ways to make up all the things we see around us. Scientists hope that by studying string theory, they can learn more about how gravity works when things are very small.
Is there anything else you would like to know?
Remember that you can endlessly tweak your prompt to get exactly what you want as an answer. For example I now realize I missed adding "Lagrangian" and "planck scale" to my finessed request. But it can do it all, no doubt.
GrandMasterPuba t1_jdvz5mj wrote
So it's summarizing Wikipedia.
This is a language model. It predicts the next best word given a string of preceding tokens based on a corpus of training data, of which includes a vast domain of information on string theory.
I will not truly be convinced that GPT can "understand concepts" until it can create new knowledge. I have yet to see any evidence of that.
izumi3682 OP t1_jdw8b8c wrote
You dint ask me to demonstrate it could create "new knowledge. You asked me to prove that it dint just give me what I hoped to see. But I'll bet you that really, actually, genuinely, serious scientists will ask it questions properly specific that it will create new knowledge. And bear in mind that such a thing would be of such societal gravity that it would at least produce Nobel prizes or novel amazing technology or substances, but could at worst be existentially threatening to humanity.
In the meantime, you just keep pushing back them goalposts. I prophesy it is going leap over them in less than 3 years. Hold my feet to the fire in the year 2026. I'm gonna be right.
Also just because I couldnt resist, I went ahead and did this...
rephrase this in a manner that would be undestandable to a sixth grader and include the terms "lagrangian", planck scale, quantum gravity and string theory. Sent message. Sure! Here’s a simpler version that includes the terms you mentioned: Scientists study how everything works using four main ideas called forces. These forces are like special powers that make things move and stick together. One of these forces is called gravity, which is what makes things fall down and keeps us on the ground. Scientists have a special tool called a “Lagrangian” that helps them understand how these forces work and make predictions.
Scientists understand a lot about how gravity works when things are big, like planets and stars. But when things are very, very small, it’s harder to understand how gravity works. There’s a size called the “Planck scale” where gravity starts to act differently and scientists don’t understand it as well. That’s why scientists are trying to learn more about something called quantum gravity, which is a way to explain how gravity works when things are super tiny.
One idea that scientists have come up with to help explain quantum gravity is called string theory. String theory is like a story that says everything in the universe is made up of tiny strings, kind of like pieces of spaghetti. These strings wiggle and move in different ways to make up all the things we see around us. Scientists hope that by studying string theory, they can learn more about how gravity works when things are very small.
Is there anything else you would like to know?
What do you think the impact of this is gonna be on human education in say, the US? Cuz I'm in the US. Why don't you ask it a question your ownself?
GrandMasterPuba t1_jdwavl3 wrote
>Why don't you ask it a question your ownself?
I use it every single day through CoPilot. In fact, I wager I've used it exponentially more than you have. It's an impressive tool, there's no doubt.
But it is just a tool. It is not an AGI. It's a model. You're seeing Jesus in your toast.
izumi3682 OP t1_jdx3d7e wrote
I never said it was an AGI. But. It's gonna be. And in less than 3 years I prophesy. And very shortly after that, between 6 months and one year, it's gonna be an ASI. And ASI=TS Technological singularity is TS.
I am going to be proven correct.
>As of this commentary there is no such thing as AGI, that is "artificial general intelligence"--A form of AI that reasons and employs "common sense" just like a human, to figure out how to do things it has never been exposed to before. And don't forget--That AGI will also have unimaginable computing power behind it's human like thinking. Something humans don't have--yet, maybe... And we don't even know if such a thing is possible. But I suspect that given enough processing power, speed and access to big data and novel AI computing architectures, that a narrow AI (a computing algorithm that can only do one task, but with superhuman capability) will be able to effectively simulate or mimic the effect of AGI. Then my question is, does it matter if it is narrow AI simulating AGI or real honest to gosh AGI. Is there even a difference? My point being that narrow AI is very much in existence today. Consciousness and self-awareness are certainly not a requirement. And in fact a true EI (emergent intelligence--conscious and self-aware.) would be very undesirable. We don't need that kind of competition.
That is a self quote from my hub essay that I wrote in 2018. I saw it coming even then, although people like you, the AI experts, said no, that is not how AI works.
But that is exactly how people that know, like Sam Altman and Geoffrey Hinton see it. Further they are realizing that LLMs that are comprehensive enough, apparently begin to spontaneously demonstrate emergent traits. They become able to do things that they were not programmed to do.
And nobody knows why. The black box phenomenon growing larger and larger.
Don't take my word for it. Watch it from these guys yourself.
Geoffrey Hinton
https://www.youtube.com/watch?v=qpoRO378qRY
Sam Altman and his CTO
https://www.youtube.com/watch?v=540vzMlf-54
Oh. And former Alphabet CEO Eric Shmidt
https://www.youtube.com/watch?v=Sg3EchbCcA0&t=734s
Here are some AI experts that are part of AI alignment efforts, discussing what is happening today.
https://www.youtube.com/watch?v=APliuwGYDNc
BTW all of these interviews are from less than two weeks ago. That is the impact of GPT-4.
>...CoPilot
Oh. Yer just a coder. I should have known. No, I don't doubt you use Chatgpt exponentially more than I do. It is a fantastic tool to make your tasks ever so much easier. Don't you understand that the reason it is of such incredibly good use to you is that it is exponentially itself developing into a more powerful AI. Did you know that GPT-4 can code at the level of a senior coder? Further it continuously improves based on input from coders like yourself to the model. Then OpenAI sends out little "updates" that demonstrate improvement. Your helpful tool that takes most of the stress off you is going to replace you in about two more years, if not sooner than that.
Right now GPT-4 is hobbled by not having access to training after Sep 2021 and very limited access to the internet. But in 3 to 6 months' time, you're gonna see some serious shizz. And one year from now? We can't model what GPT-4 will be capable of.
And that is how the TS rolls. I still maintain, somewhat reluctantly, that 2029 will be the year of the TS, but the release of GPT-4 may have profoundly changed the game. What do you imagine something like a "GPT-5" or whatever it's called, will be capable of? More importantly, when would it release? And for that matter what kind of unimaginable craziness are we yet to see in the balance of 2023 alone? I know that Nvidia is up to some kind of novel AI right now. I state to you, as a fact, there will be at least 4 more profound AI related news stories that will become public knowledge this year. Not all of them related to coding. But it may not matter either. My god! What we are talking about now, compared to 2018--a technological lifetime ago of 5 years. What will 5 years from today, 2028, look like. We can't model it.
GrandMasterPuba t1_jdx8emg wrote
>What do you imagine something like a "GPT-5" will be capable of?
I imagine it will be capable of predictive modeling of language, just like GPT-4, and just like GPT-3; that it will be better at it, that it will continue to confuse people who don't know what they're talking about into believing it is somehow alive or conscious, and that it will continue to just be a statistical model running on silicon in a cooled warehouse.
I imagine that it will be just good enough to convince business leaders to replace all their workers with it, and that it will be ever so slightly shittier than a normal human because it lacks any sort of foresight or higher level reasoning, and as a result the world will be just a little bit shittier for everyone.
izumi3682 OP t1_jdxukmm wrote
>I imagine that it will be just good enough to convince business leaders to replace all their workers with it, and that it will be ever so slightly shittier than a normal human because it lacks any sort of foresight or higher level reasoning, and as a result the world will be just a little bit shittier for everyone.
Doubtful. I think you are not seeing the forest for the trees. Did GPT-2 take you by surprise in 2019? How about GPT-3 in 2020, barely a year later. Did you know what it was going to be capable of when it released? The whole point of all of this discussion is that you seem to be the only one who believes that very little improvement will accrue to our efforts at AI in the balance of this decade. I suspect that it will transcend human intelligence as early as the year 2027. It's not going to be "shitty". It's going to be beyond our 2023 "stone-knives-and-bear-skins-primitive" imagination, compared to what will be the ground truth in the year 2025.
Just out of curiosity, what year do you believe humanity will achieve AGI? 2025 which I predict NLT, 2030, 2045, 2060, never? I think you are massively underestimating the improvement of these narrow-ish AIs. I'm not sure why. Could be some kind of defensiveness or denial. And that is understandable from the perspective of the human condition. But bear in mind that there is an abyss of difference between an AGI and an EI, that is "emergent intelligence". An AGI is just more fancy computing that can do lots of different things. It has a level of computing that allows it to understand the laws of physics and probably based on that, what we would regard as common sense. Consciousness and self-awareness not necessary. An EI is a new form of sentience in the universe (our portion of the multiverse), conscious and self-aware. We need to work very hard to avoid bringing about an EI.
Take a look at this. I wrote it when I was wondering how we can make an AI be "motivated" to do something.
https://www.reddit.com/user/izumi3682/comments/9786um/but_whats_my_motivation_artificial_general/
GrandMasterPuba t1_jdyrevb wrote
>Just out of curiosity, what year do you believe humanity will achieve AGI?
It won't. Technology is peaking. In the coming decades sociopolitical and environmental stressors will cause technology to enter an inevitable decline and we will enter an era of degrowth and survival.
It is already happening. Software is in decline as we speak. Developers are less productive than ever. Software in general is more broken and error-prone than ever. Understanding of technological fundamentals is lower than ever. An influx of new, green engineers who never bothered to learn how any of this shit works has displaced the old retired graybeards who built it all. Web companies are failing left and right, their castles built on mountains of sand crumbling beneath them as they run out hands to pile the grains back up.
My counter argument to your pie in the sky notions of infinite growth is that GPT and LLMs in general are in a period of logistic growth. They were advancing slowly, then all at once, and soon will reach a limit.
izumi3682 OP t1_jdzarvv wrote
>...soon will reach a limit.
OMG! You sound just like 2018 all over again. Well, ok I'll look you up in a year or two, or you can look me up in a year or two and we'll compare notes. I'm not going anywhere; I mean unless I get hit by a truck or something. But I have been continuously in rslashfuturology for nearly ten years now. I pretty much have seen it all. And I will continue to breathlessly report all the latest developments in AI and anything else "futurey" that attracts my attention.
About AI winters. "Limits". AI winters occur when for technical or even science philosophy reasons a wall is hit in progress. The AI winter of the mid 90s to mid 00s, about ten solid years, was because it did not seem to be possible for contemporary computing to realize the long theorized "neural network" first seen in a very primitive form in "Eliza" in 1966. Marvin Minsky, the finest AI scientist of his day, said as much. "The problem seems to be "intractable".
Rising AI scientists like Geoffrey Hinton were basically "alone in the wilderness" struggling to advance the science even a fraction of an increment. But even he had no luck. Now the other element of AI winters is when the investors that had initially seeded these projects with considerable sums of money, begin to think, hmm I don't think this is going to pan out after all. And then the money dries up. A vicious cycle feeds itself. Virtually no progress occurs.
Hinton racked his brain trying to come up with ways to make CPUs realize that elusive neural network. Primitive ones did already exist. But new ideas were needed. I'm not sure how, but Hinton looked at the GPU units that Nvidia was using for advanced (by early 2000 standards) graphics in video games. He probably had significant insight into what he was looking for and likely realized that the same effect that GPUs had on graphics could be used to realize those long sought convolutional neural networks. Further he took a relatively old concept, "back propagation" and used it along with GPUs to almost literally force the CNN into existence. Many other now renowned AI experts were instrumental in this as well.
Hinton, in his typical engineering understatement, said, regarding GPUs; "This seems to work". And from that point forward "narrow AI" began to explode. And explode. And explode. Tens of thousands of narrow AI aided apps to include "Siri" suddenly came into existence. The one that blew me away personally about the year 2015 or 16 was the "Google Translate". The translation font on my iPhone screen was identical to the original font. Even the color was identical if the original font was in color. When I saw how that worked it was like magic, a miracle of technology. Then I had this other app on my iPhone about 2016 called "AIpoly". It was an app that was an experimental sort of beta app for the use of blind people. You set the app to use your iPhone cam to look at objects up close and it would state in text what it saw. I pointed the cam at my hand, my doc i worked with was right there with me. The text said, "The back of a hand". Our jaws collectively dropped. We both said "Whoaaa!!" in genuine and truthful amazement. Then I pointed it at my computer monitor and the text read "computer monitor". There was a way to turn on sound for the blind people but I could not find it. So we just relied on the text. But it could not identify a candy wrapper on the desk. It said, "I am unable to identify this." But OMG! We were blown away.
Two years later in 2018, the first GPT was released with 175 million parameters. And the rest of course is history.
There will never ever again be an "AI winter" for two reasons. The first is that our extant AI is so inextricably entwined into all of human affairs that it is essential that it continuously improves or everything fails. This leads to the second part of the first reason. When Chatgpt released on 30 Nov 22, within one week more than 100 million users had scarfed it up. In less than one week. The fastest technological penetration of society in human recorded history. Of them 100 million users, I'm pretty confident that a goodly percentage of them are AI developers in their own right. And I'm further confident that we shall see an absolute "Cambrian Explosion" of new forms of AI and training algorithms like "transformers" and "diffusion" to name two.
What do you think shall be the next training algorithm to come to our attention. I mean what will it be called. It's coming sure as Christmas. More than likely this year too. And it will be utterly transformational in our efforts to achieve AGI, which i maintain will be in existence NLT 2025.
The second reason is a bit more ominous. Vladimir Putin, stated less than ten years ago I think, that "the first country to develop AGI will control the world". The national defense of the USA, China (PRC), Russia and probably a great many other mostly first world countries depend utterly on ever faster developments in AI. The money is never going to dry up again. And investors know that. BTW Nvidia of GPU fame is working on its own novel form of AI. I don't know when it's going to be released, but it's on the way. Could be this year maybe.
No, AI is going to continue to develop and evolve, some of the evolution on its own--through unanticipated emergent behaviors. But through humans working as hard and as fast as they possibly can to make AGI. Because now, yes, it is a race. And everybody knows it. And like I stated earlier, it is natural and normal that this is happening. It is logical that we are at the point we are at today. Thank the renaissance, the Catholic/Protestant reformation, industrial revolution, the enlightenment, WWII, Eniac, H bombs and "Eliza". Oh! And video games. Further the AI itself will be developing science and technology as a multiplier on top of our now exa-scale computing power. Today that processing speed hovers around 1-1.6 exaflops, but as soon as 2025 it is expected to be between 10-20 exaflops. What are quantum computers up to now? Not sure, they're a bit of a wild card in all this. But I will say this, I suspect it will take quantum computing to realize genuine consciousness in an AI. An "EI" then, may come into existence, and God help us all when (hopefully if, rather) that happens.
Viewing a single comment thread. View all comments