Viewing a single comment thread. View all comments

semitope t1_j8ihbzl wrote

Reply to comment by Lionfyst in ChatGPT Passed a Major Medical Exam, but Just Barely | Researchers say ChatGPT is the first AI to receive a passing score for the U.S. Medical Licensing Exam, but it's still bad at math. by chrisdh79

it's a little weird for AI to be bad at math

2

mattsowa t1_j8iqq5u wrote

Why?

5

semitope t1_j8jzisc wrote

because its basic functionality for computers. And it's the easiest thing because the solution is not ambiguous. But sounds like it just isn't able to put it in a math form as given.

−3

theucm t1_j8mobi7 wrote

"Its a little weird for a person to be bad at chemistry."

"Why?"

"Because it's a basic function of living things. "

3

semitope t1_j8n9mlm wrote

that's a completely wrong comparison. A person isn't born automatically being able to do math. Computer processors all have Arithmetic logic units.

−1

theucm t1_j8obg7s wrote

You missed my point, I think.

​

I'm saying that expecting a language model to be intrinsically good at math because it runs on a processor with arithmetic logic is like expecting a living thing to be good at chemistry because our brains "run" on chemical and electrical impulses. The language model AI only has the ability to access the knowledge it has been trained on, which apparently didn't include math.

2

mattsowa t1_j8kwdrj wrote

I mean if you know how it works it isn't surprising at all really..

I find the fact that it's a basic functionality for a computer irrelevant.

2

BirdLawyerPerson t1_j8ii7wd wrote

They're bad at word problems, which requires recognizing that they're being presented with a math problem at all, before determining the right formula to apply and calculating what the answer should be.

2