By using this site, you agree to the Privacy Policy and Terms of Use.
Accept

News Junction

Notification Show More
Font ResizerAa
  • Home
  • World News
    World NewsShow More
    UK political opinion poll tracker
    UK political opinion poll tracker
    May 16, 2025
    Asian markets stagger into weekend as trade rally runs out of legs
    Asian markets stagger into weekend as trade rally runs out of legs
    May 16, 2025
    Baby KJ was born with a rare, deadly disease. Doctors designed a fix – just for him
    Baby KJ was born with a rare, deadly disease. Doctors designed a fix – just for him
    May 16, 2025
    FIFA president Gianni Infantino criticised by European football chiefs over decision to join Donald Trump tour | World News
    FIFA president Gianni Infantino criticised by European football chiefs over decision to join Donald Trump tour | World News
    May 16, 2025
    Arctic Worries: Melting Ice, and a Russia-China Partnership
    Arctic Worries: Melting Ice, and a Russia-China Partnership
    May 16, 2025
  • Business
    BusinessShow More
    Ukraine blows up bridges to consolidate its positions in Russia
    Ukraine blows up bridges to consolidate its positions in Russia
    August 18, 2024
    Commentary: AI phones from Google and Apple will erode trust in everything
    Commentary: AI phones from Google and Apple will erode trust in everything
    August 18, 2024
    The most famous Indian Dishes – Insights Success
    The most famous Indian Dishes – Insights Success
    August 18, 2024
    Life on the road as a female long rides cyclist
    Life on the road as a female long rides cyclist
    August 18, 2024
    UK inflation rises to 2.2%
    UK inflation rises to 2.2%
    August 18, 2024
  • Cryptocurrency
    CryptocurrencyShow More
    BTC, ETH, XRP, BNB, SOL, ADA, DOGE, PI, HBAR, LINK
    BTC, ETH, XRP, BNB, SOL, ADA, DOGE, PI, HBAR, LINK
    May 16, 2025
    Bitcoin traders’ evolving view of BTC’s role in every portfolio bolsters 0K support
    Bitcoin traders’ evolving view of BTC’s role in every portfolio bolsters $100K support
    May 16, 2025
    Crypto’s lack of ‘frothy use case’ a good sign: WisdomTree exec
    Crypto’s lack of ‘frothy use case’ a good sign: WisdomTree exec
    May 16, 2025
    Tornado Cash dev Roman Storm trial goes ahead with slight trim
    Tornado Cash dev Roman Storm trial goes ahead with slight trim
    May 16, 2025
    Bitcoin to outperform gold in second half of 2025: JP Morgan
    Bitcoin to outperform gold in second half of 2025: JP Morgan
    May 16, 2025
  • Technology
    TechnologyShow More
    How to Improve Your Spotify Recommendations
    How to Improve Your Spotify Recommendations
    August 18, 2024
    X says it’s closing operations in Brazil
    X says it’s closing operations in Brazil
    August 18, 2024
    Supermoon set to rise: Top tips for amateur photographers | Science & Tech News
    Supermoon set to rise: Top tips for amateur photographers | Science & Tech News
    August 18, 2024
    Scientists Want to See Videos of Your Cat for a New Study
    Scientists Want to See Videos of Your Cat for a New Study
    August 18, 2024
    OpenAI’s new voice mode let me talk with my phone, not to it
    OpenAI’s new voice mode let me talk with my phone, not to it
    August 18, 2024
  • Entertainment
  • Sports News
  • People
  • Trend
Reading: Is ChatGPT Smart Enough to Solve Problems Without Words?
Share
Font ResizerAa

News Junction

  • World News
  • Business
  • Technology
  • Cryptocurrency
  • Trend
  • Entertainment
Search
  • Recent Headlines in Entertainment, World News, and Cryptocurrency – NewsJunction
  • World News
  • Business
  • Cryptocurrency
  • Technology
  • Entertainment
  • Sports News
  • People
  • Trend
Have an existing account? Sign In
Follow US
News Junction > Blog > Technology > Is ChatGPT Smart Enough to Solve Problems Without Words?
Is ChatGPT Smart Enough to Solve Problems Without Words?
Technology

Is ChatGPT Smart Enough to Solve Problems Without Words?

Published August 1, 2023
Share
8 Min Read
SHARE

The latest in a slew of speculative AI research papers is making some pretty outlandish claims about how deep learning models have some subtle, unrealized cognitive abilities akin to, or even surpassing humans. Though researchers found a modern pre-training transformer model does well at multiple-choice tests that don’t necessarily require language, they still have no honest idea if the AI is just basing its answers off its opaque training data.

Why is Everyone Suing AI Companies? | Future Tech

University of California, Los Angeles researchers tested “analogical tasks” on the GPT-3 large language model and found it was at or above “human capabilities” for resolving complex reasoning problems. UCLA was fast to make rather outlandish claims about the research in its press release Monday, raising the question of whether the AI was “using a fundamentally new kind of cognitive process.”

That’s an inherently biased question that relies on a sensational view of AI systems, but let’s look a bit deeper. The UCLA psychology postdoc researcher Taylor Webb and professors Keith Holyoak and Hongjing Lu published their paper in the journal Nature Human Behaviour. They compared the AI’s answers to that of 40 undergrad students and found the bot performed at the higher end of humans’ scores, and that it even made a few of the same mistakes.

In particular, the researchers based their tests on the non-verbal test called Raven’s Progressive Matrices developed all the way back in 1939. It’s a list of 60 multiple-choice questions that get harder as they go along, and they mostly require test takers to identify a pattern. Some have extrapolated Raven’s to measure IQ as a score for general cognitive ability, especially since some proponents say it doesn’t hold many ethnic or cultural biases compared to other, inherently biased intelligence tests.

Thankfully, the paper doesn’t try to ascribe a bunk IQ score to the AI. They also asked the bot to solve a set of SAT analogy questions that involved word pairs. Say a vegetable is related to a cabbage. Therefore, an insect is equivalent to a “beetle,” and so on. The researchers claimed that, to their knowledge, the questions had not appeared on the internet and that it was “unlikely” it would have been gobbled up as part of GPT-3’s training data. Again, the AI performed at a level slightly above the average meat bag.

There are several problems the AI sucks at, or perhaps it’s just more of a STEM kid than a humanities student. It was much less capable of solving analogy problems based on short stories, though the newer, more expansive GPT-4 was overall better at the task. Asked to use a bunch of household objects to transfer gumballs from one room to another, and the AI came up with “bizarre solutions.”

Webb and his fellows have been working on this problem for close to half a year, and since their initial preprint they’ve added more tests to the model. All these tests led them to start openly theorizing about how GPT-3 could be forming some kind of “mapping process” similar to how humans are theorized to tackle such problems. The researchers jumped at the idea that AI could have developed some alternate type of machine intelligence.

The “spatial” part of the tests would often involve shapes, and it required the AI to guess the correct shape or diagram based on previous, similar shapes. The study authors went on to further draw comparisons to flesh and blood test takers, saying that the AI shared many similar features of “human analogical reasoning.” Essentially, the researchers said that the AI was reasoning in the same ways that humans did through having a sense of the comparison of shapes.

Webb and his colleagues first released a preprint of the paper in December. There, the researcher claimed GPT-3 didn’t have “any training” on these tests or related tasks.

There is a fundamental problem with anybody trying to claim that there’s something the AI isn’t trained on. Is it possible there’s absolutely nothing language-based on the Raven’s test in the 45 full terabytes of training data used by the AI? Perhaps, but GPT-3-creator OpenAI has not released a full list of what’s contained inside the data set that their LLM learned from. This is for a few reasons, one is to keep their proprietary AI under lock and key to better sell their services. The second is to keep even more people from suing them for copyright infringement.

Previously, Google CEO Sundar Pichai claimed in an interview that somehow, Google’s Bard chatbot learned Bengali on its own. The thing is, researchers found Bengali and other overlapping languages already existed in the training data. Most of AI’s data is centered on English and the “West,” but it’s learning is so broad and covers such a vast range of information there’s a chance that some example of language-less problem-solving slipped in there.

The UCLA release even mentions that the researchers have no idea how or why the AI does any of this since they don’t have access to OpenAI’s secret sauce. What this paper and others like it do is create even more hysteria about the AI containing some form of actual “intelligence.” OpenAI CEO has run on at length about the concerns of Artificial General Intelligence, a kind of computer system that’s actually smart. But what that means in practice is nebulous. Altman described GPT-4 as an “alien intelligence,” in an interview with The Atlantic where he also described the AI writing computer code it wasn’t explicitly programmed to do.

But it’s also a shell game. Altman won’t release what’s in the AI’s training data, and because it’s a big black box the company, AI proponents, and even well-meaning researchers can get suckered into the hype with claims the language models are breaking free from the digital cage containing it.


Want to know more about AI, chatbots, and the future of machine learning? Check out our full coverage of artificial intelligence, or browse our guides to The Best Free AI Art Generators, The Best ChatGPT Alternatives, and Everything We Know About OpenAI’s ChatGPT.

#ChatGPT #Smart #Solve #Problems #Words

- Advertisement -
TAGGED:AltmanArtificial general intelligenceArtificial intelligenceChatGPTComputational neuroscienceGenerative pre-trained transformerGizmodoGoogleGPT-3GPT-4HallucinationHongjing LuHypothetical technologyKeith HolyoakLarge language modelsMondayOPENAIProblemsSmartSolveSundar PichaiSuperintelligenceTaylor WebbWords
Share This Article
Facebook Twitter Pinterest Whatsapp Whatsapp LinkedIn Email Copy Link Print
Share
What do you think?
Love0
Sad0
Happy0
Sleepy0
Angry0
Dead0
Wink0
Previous Article The Basics of Virtual Staging in Real Estate – The Perfect Showcase – Insights Success The Basics of Virtual Staging in Real Estate – The Perfect Showcase – Insights Success
Next Article Researchers develop blockchain verification service for cultural artifacts Researchers develop blockchain verification service for cultural artifacts
- Advertisement -

Latest Post

BTC, ETH, XRP, BNB, SOL, ADA, DOGE, PI, HBAR, LINK
BTC, ETH, XRP, BNB, SOL, ADA, DOGE, PI, HBAR, LINK
Cryptocurrency
UK political opinion poll tracker
UK political opinion poll tracker
World News
Bitcoin traders’ evolving view of BTC’s role in every portfolio bolsters 0K support
Bitcoin traders’ evolving view of BTC’s role in every portfolio bolsters $100K support
Cryptocurrency
Crypto’s lack of ‘frothy use case’ a good sign: WisdomTree exec
Crypto’s lack of ‘frothy use case’ a good sign: WisdomTree exec
Cryptocurrency
Asian markets stagger into weekend as trade rally runs out of legs
Asian markets stagger into weekend as trade rally runs out of legs
World News
Tornado Cash dev Roman Storm trial goes ahead with slight trim
Tornado Cash dev Roman Storm trial goes ahead with slight trim
Cryptocurrency
- Advertisement -

You Might Also Like

Microbes cling on to International Space Station – here’s why astronauts are trying to collect them | Science & Tech News
Technology

Microbes cling on to International Space Station – here’s why astronauts are trying to collect them | Science & Tech News

June 26, 2024
Hire mindset over skill set
Technology

Hire mindset over skill set

February 3, 2024
Anticipated Video Game Tests : black ops 6 beta
Technology

Anticipated Video Game Tests : black ops 6 beta

July 17, 2024
Instagram is down for multiple users
Technology

Instagram is down for multiple users

July 25, 2023

About Us

NEWS JUNCTION (NewsJunction.xyz) Your trusted destination for global news. Stay informed with our timely and accurate reporting on diverse topics, including politics, technology, science, entertainment, sports, and more. Count on us for unbiased and reliable updates at your fingertips.

Quick Link

  • About
  • Disclaimer
  • Privacy Policy
  • Terms of Use
  • Contact

Top Categories

  • World News
  • Business
  • Technology
  • Entertainment
  • Cryptocurrency
  • Sports News
  • Trend
  • People

Subscribe

Subscribe to our newsletter to get our newest articles instantly!

    © 2023 News Junction.
    • Blog
    • Advertise
    • Contact
    Welcome Back!

    Sign in to your account

    Username or Email Address
    Password

    Lost your password?