sext-scientist t1_iw77ylt wrote on November 13, 2022 at 2:26 PM

Reply to comment by Ducky181 in The CEO of OpenAI had dropped hints that GPT-4, due in a few months, is such an upgrade from GPT-3 that it may seem to have passed The Turing Test by lughnasadh

Size is almost certainly the entire problem with these models. More recent research into how human brains process information has confirmed current generation language models have 6-9 orders of magnitude less compute than humans.

Hardware wise, hopefully 3D silicon and lower nm processes reduce the above gap in the next few years.

avatarname t1_ix5auxp wrote on November 20, 2022 at 9:24 PM

I do wonder sometimes if our intelligence is just the question of scale of these things with some tweaking. We tend to think we are oh so imaginative and inventive and then on YouTube I discover that I have pretty much left the same comment only worded differently 13 years, 6 years back and now, on the same video that I forgot I had watched before :D