Over just a few months, ChatGPT went from correctly answering a simple math problem 98% of the time to just 2%, study finds. Researchers found wild fluctuations—called drift—in the technology’s abi…::ChatGPT went from answering a simple math correctly 98% of the time to just 2%, over the course of a few months.
Turns out you need very good computer scientists to make good AI. And those are very expensive and hard to come by.
OpenAI actually has some decent people working there. ChatGPT doesn’t seem to have any.
It just occurred to me that one could purposely seed it with incorrect information to break its usefulness. I’m anti-AI so I would gladly do this. I might try it myself.
HMMMM. It’s almost like it’s not AI at all, but just a digital parrot. Who woulda thought?! /s
To it, everything is true and normal, because it understands nothing. Calling it “AI” is just for compromising with ignorant people’s “knowledge” and/or for hype.
Exactly. It should be called ML model, because that’s what it is, and I’ll just keep calling that. Everyone should do that.
What does that stand for? O:
You’d think I’d know that since I’m talking about AI; but actually most of my knowledge is about how things work or don’t work, not current trends/news.
It’s a machine learning chat bot, not a calculator, and especially not “AI.”
Its primary focus is trying to look like something a human might say. It isn’t trying to actually learn maths at all. This is like complaining that your satnav has no grasp of the cinematic impact of Alfred Hitchcock.
It doesn’t need to understand the question, or give an accurate answer, it just needs to say a sentence that sounds like a human might say it.
so it confidently spews a bunch of incorrect shit, acts humble and apologetic while correcting none of its behavior, and constantly offers unsolicited advice.
I think it trained on Reddit data
This. It is able to tap in to plugins and call functions though, which is what it really should be doing. For math, the Wolfram alpha plugin will always be more capable than chatGPT alone, so we should be benchmarking how often it can correctly reformat your query, call Wolfram alpha, and correctly format the result, not whether the statistical model behind chatGPT happens to use predict the right token
to be fair, fucking up maths problems is very human-like.
I wonder if it could also be trained on a great deal of mathematical axioms that are computer generated?
It doesn’t calculate anything though. You ask chatgpt what is 5+5, and it tells you the most statistically likely response based on training data. Now we know there’s a lot of both moronic and intentionally belligerent answers on the Internet, so the statistical probability of it getting any mathematical equation correct goes down exponentially with complexity and never even approaches 100% certainty even with the simplest equations because 1+1= window.
Why are people using a language model for math problems?
Because it works, or at least it used to. Is there something more appropriate ?
I used Wolfram Alpha a lot in college (adult learner, but that was about ~4 years ago that I graduated, so no idea if it’s still good). https://www.wolframalpha.com/
I would say that Wolfram appears to probably be a much more versatile math tool, but I also never used chatgpt for that use case, so I could be wrong.
Math is a language.
Mathematical ability and language ability are closely related. The same parts of your brain are used in each tasks. Words and numbers are essentially both ideas, and language and math are systems used to express and communicate these.
A language model doing math makes more sense than you’d think!
It was initially presented as the all-problem-solver, mainly by the media. And tbf, it was decently competent in certain fields.
I did use it more than half a year ago for a few math problems. It was partly to help me getting started and to find out how well it’d go.
ChatGPT was better than I’d thought and was enough to help me find an actually correct solution. But I also noticed that the results got worse and worse to the point of being actual garbage (as it’d have been expected to be).
It can be useful asking it certain questions which are a bit complex. Like on a plot which has the y axis linear and x axis logarithmic, the equation of a straight line is a little bit complicated. Its in the form y = m*(log(x)) + b rather than on a linear-linear plot which is y = m*x+b
ChatGPT is able to calculate the correct equation of the line but it gets the answer wrong a few times… lol
