If you love those bots answering the phone when you call a business or that chat box on the screen when you visit some sites, you will love AI as it promises to bring more of the same.
To test the AI models, the researchers had them attempt thousands of math problems from the widely used benchmark GSM8K dataset. A typical question is as follows: “James buys 5 packs of beef that are 4 pounds each. The price of beef is $5.50 per pound. How much did he pay?” Some questions are a tad more complicated, but it’s nothing that a well-educated middle schooler can’t solve.
The way the researchers exposed these gaps in the AI models was shockingly easy: they simply changed the numbers in the questions. This prevents data contamination — in other words, ensuring that the AIs haven’t seen any of these exact problems before in their training data, without actually making the problems any harder.
This alone caused a minor but notable drop in accuracy in every single of the 20 tested LLMs. But when the researchers took things a step further by also changing the names and adding in irrelevant details — like in a question about counting fruits, remarking that a handful of them were “smaller than usual” — the performance drop was, in the researchers’ own wording, “catastrophic”: as high as 65 percent.
These varied between models, but even the cleverest of the bunch, OpenAI’s o1-preview, plummeted by 17.5 percent. (Its predecessor GPT-4o, fell by 32 percent.)
Eight ways that AI is making our world better, according to the article;
Artificial intelligence (AI) is already all around us. You’ve experienced it today if you opened your phone using face recognition or watched something suggested to you by Netflix.
ChatGPT is the AI celebrity of the moment, but there is so much more to the present and future of AI.
It’s helping with huge advancements in health-care diagnostics and patient care. It reduces human error and allows for more precise decision-making. It’s solving complex issues that our human brains can’t compute on their own.
So, what triggered the sudden explosion of AI? Data, baby.
We’ve been gathering digital data for several decades now and industries across the board are getting better at collecting it and making it available to ever-improving computing systems.
Data the tech companies have gathered so much data about us that they are trying to figure out how to wring more blood (money) from us. Those bots (AIs) are gathering all that data to see how it can be used to sell us more stuff that we don’t need.
Forbes article claims that AI will make the world safer for us:
Artificial intelligence has skeptics, critics and scaremongerers. People are trolling AI news sites and starting protests against the technology. But it’s not all lost jobs and robots taking over. Discoveries and new inventions in artificial intelligence are making the world a safer place for humans. And that’s the point.
The bad about AI:
The Bad: Potential bias from incomplete data
“AI is a powerful tool that can easily be misused. In general, AI and learning algorithms extrapolate from the data they are given. If the designers do not provide representative data, the resulting AI systems become biased and unfair. For example, if you train a human detection algorithm and only show the algorithm images of people with blonde hair, that system may fail to recognize a user with brown hair (e.g., brown hair = not a human). In practice, rushed applications of AI have resulted in systems with racial and gender biases. The bad of AI is a technology that does not treat all users the same.”
The Scary: Artificial intelligence is influencing our decision making
“We are already facing the negative outcomes of AI. For example, take recommendation algorithms for streaming services: the types of shows you see are influenced by the shows recommended to you by an artificial agent. More generally, today’s AI systems influence human decision making at multiple levels: from viewing habits to purchasing decisions, from political opinions to social values. To say that the consequences of AI is a problem for future generations ignores the reality in front of us — our everyday lives are already being influenced. Artificial intelligence — in its current form — is largely unregulated and unfettered. Companies and institutions are free to develop the algorithms that maximize their profit, their engagement, their impact. I don’t worry about some dystopian future; I worry about the reality we have right now, and how we integrate the amazing possibilities of artificial intelligence into human-centered systems.”