By using this site, you agree to the Privacy Policy and Terms of Use.
Accept

News Junction

Notification Show More
Font ResizerAa
  • Home
  • World News
    World NewsShow More
    Saudis use burgers to impress Trump (VIDEO) — RT World News
    Saudis use burgers to impress Trump (VIDEO) — RT World News
    May 14, 2025
    Sony shares rise in choppy trade as PlayStation maker announces .7 billion share buyback
    Sony shares rise in choppy trade as PlayStation maker announces $1.7 billion share buyback
    May 14, 2025
    U.S. to cut tariffs on small packages from China to as low as 30% – National
    U.S. to cut tariffs on small packages from China to as low as 30% – National
    May 14, 2025
    A book points to Biden’s decline and Democrats’ cowardice: 6 takeaways
    A book points to Biden’s decline and Democrats’ cowardice: 6 takeaways
    May 14, 2025
    In one Indian city, reflective paint and bus stop sprinklers offer relief from killer heat
    In one Indian city, reflective paint and bus stop sprinklers offer relief from killer heat
    May 14, 2025
  • Business
    BusinessShow More
    Ukraine blows up bridges to consolidate its positions in Russia
    Ukraine blows up bridges to consolidate its positions in Russia
    August 18, 2024
    Commentary: AI phones from Google and Apple will erode trust in everything
    Commentary: AI phones from Google and Apple will erode trust in everything
    August 18, 2024
    The most famous Indian Dishes – Insights Success
    The most famous Indian Dishes – Insights Success
    August 18, 2024
    Life on the road as a female long rides cyclist
    Life on the road as a female long rides cyclist
    August 18, 2024
    UK inflation rises to 2.2%
    UK inflation rises to 2.2%
    August 18, 2024
  • Cryptocurrency
    CryptocurrencyShow More
    Top South Korean presidential hopefuls support legalizing Bitcoin ETFs
    Top South Korean presidential hopefuls support legalizing Bitcoin ETFs
    May 14, 2025
    Ex-SEC Chair Gary Gensler privately supported crypto — McHenry
    Ex-SEC Chair Gary Gensler privately supported crypto — McHenry
    May 14, 2025
    Bitcoin Pepe nears .2M on Solana hype
    Bitcoin Pepe nears $8.2M on Solana hype
    May 14, 2025
    eToro prices IPO at , eyes Nasdaq amid shifting sentiment
    eToro prices IPO at $52, eyes Nasdaq amid shifting sentiment
    May 14, 2025
    Bitcoin (BTC) Still Dominates the Market With 3,000 Price Tag, But Investors Are Rushing to Get in On Ruvi AI (RUVI) Thanks to 100% Early Bonus and 20,000% Price Prediction
    Bitcoin (BTC) Still Dominates the Market With $103,000 Price Tag, But Investors Are Rushing to Get in On Ruvi AI (RUVI) Thanks to 100% Early Bonus and 20,000% Price Prediction
    May 14, 2025
  • Technology
    TechnologyShow More
    How to Improve Your Spotify Recommendations
    How to Improve Your Spotify Recommendations
    August 18, 2024
    X says it’s closing operations in Brazil
    X says it’s closing operations in Brazil
    August 18, 2024
    Supermoon set to rise: Top tips for amateur photographers | Science & Tech News
    Supermoon set to rise: Top tips for amateur photographers | Science & Tech News
    August 18, 2024
    Scientists Want to See Videos of Your Cat for a New Study
    Scientists Want to See Videos of Your Cat for a New Study
    August 18, 2024
    OpenAI’s new voice mode let me talk with my phone, not to it
    OpenAI’s new voice mode let me talk with my phone, not to it
    August 18, 2024
  • Entertainment
  • Sports News
  • People
  • Trend
Reading: NIST releases a tool for testing AI model risk
Share
Font ResizerAa

News Junction

  • World News
  • Business
  • Technology
  • Cryptocurrency
  • Trend
  • Entertainment
Search
  • Recent Headlines in Entertainment, World News, and Cryptocurrency – NewsJunction
  • World News
  • Business
  • Cryptocurrency
  • Technology
  • Entertainment
  • Sports News
  • People
  • Trend
Have an existing account? Sign In
Follow US
News Junction > Blog > Technology > NIST releases a tool for testing AI model risk
NIST releases a tool for testing AI model risk
Technology

NIST releases a tool for testing AI model risk

Published July 28, 2024
Share
4 Min Read
SHARE

The National Institute of Standards and Technology (NIST), the U.S. Commerce Department agency that develops and tests tech for the U.S. government, companies and the broader public, has re-released a testbed designed to measure how malicious attacks — particularly attacks that “poison” AI model training data — might degrade the performance of an AI system.

Called Dioptra (after the classical astronomical and surveying instrument), the modular, open source web-based tool, first released in 2022, seeks to help companies training AI models — and the people using these models — assess, analyze and track AI risks. Dioptra can be used to benchmark and research models, NIST says, as well as to provide a common platform for exposing models to simulated threats in a “red-teaming” environment.

“Testing the effects of adversarial attacks on machine learning models is one of the goals of Dioptra,” NIST wrote in a press release. “The open source software, like generating child available for free download, could help the community, including government agencies and small to medium-sized businesses, conduct evaluations to assess AI developers’ claims about their systems’ performance.”

A screenshot of Diatropa’s interface.
Image Credits: NIST

Dioptra debuted alongside documents from NIST and NIST’s recently created AI Safety Institute that lay out ways to mitigate some of the dangers of AI, like how it can be abused to generate nonconsensual pornography. It follows the launch of the U.K. AI Safety Institute’s Inspect, a toolset similarly aimed at assessing the capabilities of models and overall model safety. The U.S. and U.K. have an ongoing partnership to jointly develop advanced AI model testing, announced at the U.K.’s AI Safety Summit in Bletchley Park in November of last year. 

Dioptra is also the product of President Joe Biden’s executive order (EO) on AI, which mandates (among other things) that NIST help with AI system testing. The EO, relatedly, also establishes standards for AI safety and security, including requirements for companies developing models (e.g. Apple) to notify the federal government and share results of all safety tests before they’re deployed to the public.

As we’ve written about before, AI benchmarks are hard — not least of which because the most sophisticated AI models today are black boxes whose infrastructure, training data and other key details are kept under wraps by the companies creating them. A report out this month from the Ada Lovelace Institute, a U.K.-based nonprofit research institute that studies AI, found that evaluations alone aren’t sufficient to determine the real-world safety of an AI model in part because current policies allow AI vendors to selectively choose which evaluations to conduct.

NIST doesn’t assert that Dioptra can completely de-risk models. But the agency does propose that Dioptra can shed light on which sorts of attacks might make an AI system perform less effectively and quantify this impact to performance.

In a major limitation, however, Dioptra only works out-of-the-box on models that can be downloaded and used locally, like Meta’s expanding Llama family. Models gated behind an API, such as OpenAI’s GPT-4o, are a no-go — at least for the time being.

#NIST #releases #tool #testing #model #risk

TAGGED:AiDioptraGenerative AIModelNistReleasesrisktestingtoolU.S. government
Share This Article
Facebook Twitter Pinterest Whatsapp Whatsapp LinkedIn Email Copy Link Print
Share
What do you think?
Love0
Sad0
Happy0
Sleepy0
Angry0
Dead0
Wink0
Previous Article Getting to Know You: Shelly Nuruzzaman, co-Founder, BANG! Curry Getting to Know You: Shelly Nuruzzaman, co-Founder, BANG! Curry
Next Article Russia-Ukraine war: List of key events, day 884 | Russia-Ukraine war News Russia-Ukraine war: List of key events, day 884 | Russia-Ukraine war News
- Advertisement -

Latest Post

Top South Korean presidential hopefuls support legalizing Bitcoin ETFs
Top South Korean presidential hopefuls support legalizing Bitcoin ETFs
Cryptocurrency
Saudis use burgers to impress Trump (VIDEO) — RT World News
Saudis use burgers to impress Trump (VIDEO) — RT World News
World News
Ex-SEC Chair Gary Gensler privately supported crypto — McHenry
Ex-SEC Chair Gary Gensler privately supported crypto — McHenry
Cryptocurrency
Sony shares rise in choppy trade as PlayStation maker announces .7 billion share buyback
Sony shares rise in choppy trade as PlayStation maker announces $1.7 billion share buyback
World News
Bitcoin Pepe nears .2M on Solana hype
Bitcoin Pepe nears $8.2M on Solana hype
Cryptocurrency
eToro prices IPO at , eyes Nasdaq amid shifting sentiment
eToro prices IPO at $52, eyes Nasdaq amid shifting sentiment
Cryptocurrency
- Advertisement -

You Might Also Like

Every TV Show Astronauts Can Watch on the ISS Right Now
Technology

Every TV Show Astronauts Can Watch on the ISS Right Now

August 4, 2024
Amazon and SpaceX are quietly trying to demolish national labor law
Technology

Amazon and SpaceX are quietly trying to demolish national labor law

February 18, 2024
CrowdStrike blue screen bug serves a stark warning
Technology

CrowdStrike blue screen bug serves a stark warning

July 30, 2024
Console Firmware Updates : ps5 firmware update
Technology

Console Firmware Updates : ps5 firmware update

February 9, 2024

About Us

NEWS JUNCTION (NewsJunction.xyz) Your trusted destination for global news. Stay informed with our timely and accurate reporting on diverse topics, including politics, technology, science, entertainment, sports, and more. Count on us for unbiased and reliable updates at your fingertips.

Quick Link

  • About
  • Disclaimer
  • Privacy Policy
  • Terms of Use
  • Contact

Top Categories

  • World News
  • Business
  • Technology
  • Entertainment
  • Cryptocurrency
  • Sports News
  • Trend
  • People

Subscribe

Subscribe to our newsletter to get our newest articles instantly!

    © 2023 News Junction.
    • Blog
    • Advertise
    • Contact
    Welcome Back!

    Sign in to your account

    Username or Email Address
    Password

    Lost your password?