Viewing a single comment thread. View all comments

BellyDancerUrgot t1_j39klnu wrote

Reply to comment by Scarlet_pot2 in We need more small groups and individuals trying to build AGI by Scarlet_pot2

You need to learn graduate level math to even begin to understand the math required for the most basic models.

1

turnip_burrito t1_j3bb4p2 wrote

Well, not graduate level. Junior level in college is sufficient for the most basic models. Like for feedforward neural networks, you just need to know chain rule from calculus and some summation series notation.

Apart from that, Bayesian probability, geometric series, convergence rules, constructing mathematical proofs, it's advanced but shouldn't take too long to pick up if taught correctly. But this stuff will take much longer (basically graduate level for meaningful work).

1

BellyDancerUrgot t1_j3dxt4h wrote

Depends on what you define as basic. The post talks about novel approaches to AGI. Simple MLP is below basic in that regard. And even then I doubt most people learn about differentiation with respect to coordinate transformation in undergrad unless they do some highly specialized ML or math course.

1

AsheyDS t1_j3c78hd wrote

You're more concerned with the ML branch then, so maybe you think that's what's going to lead to AGI, but not even all ML researchers are convinced of that. There's a lot more to consider, like the rest of the AI field. People need to stop being discouraged by this talk of phds and math.

1

BellyDancerUrgot t1_j3dtr99 wrote

Do share then what your beliefs are. What exactly is AI without math? Just curious since you have the tag of a researcher. What field are u working on? I’m not suggesting that a PhD is necessary, a degree is a indicator of ur work. But phd level work is necessary to achieve anything meaningful in this field. The post is very hand wavy and aimless. Andrew Ng and Khan academy is not enough to invent the next big thing however small it is. Read up on Mish activation. The guy who did that did so before even getting a masters degree. But that’s only because he is a genius who was capable of understanding grad math when barely out of high school.

1

AsheyDS t1_j3e7r7c wrote

>Do share then what your beliefs are.

I do not have a phd, nor do I have a degree that would satisfy you, so my beliefs are meaningless. :) I didn't even get into this field until after college.

>What exactly is AI without math?

What is natural intelligence without math? Math is just a system of measurement, and one that as of yet hasn't defined every single thing. I get that we're talking about computers as the substrate, so math makes sense, but it's not the only way to define things, or enact a process. That said, I'm not suggesting ditching math, it will be integral to many processes, I'm just saying it doesn't have to be the main focus of work or study centered around cognition. That's what we're ultimately talking about here with AGI, not just mathematical processes. This is, unless you believe ML is the path to AGI, as many do.

1

BellyDancerUrgot t1_j3efn9s wrote

I don’t have a PhD either lol. Your beliefs aren’t meaningless either. Nobody actually knows what breakthrough we might have next. I do consider chatgpt to be a breakthrough tbh (using RL to train an LLM). VQA was a breakthrough imo. GANs was also a breakthrough. All these came about in the same way as the post suggests but without hardware or funding u would never see all of it come together.

There’re people like Blake Richards working on the boundaries of neuroscience and AI but it’s hard to work on any of those fields without math as the underlying structure. Still, even if you approach it or want to approach it from an entirely new way it’s hard to do that without knowing the approaches that do exist which would require you to have a lot of math knowledge regardless. You can do that without a degree for sure tho , that wasn’t my point. It’s just super hard without guidance and the primary topic of this post is: working on smaller problems without any funding , I don’t see how that works and i don’t see any actual pragmatic answers here by op either.

1