Close Menu
Technology Mag

    Subscribe to Updates

    Get the latest creative news from FooBar about art, design and business.

    What's Hot

    How a Travel YouTuber Captured Nepal’s Revolution for the World

    October 11, 2025

    You can now buy Microsoft’s Windows XP Crocs for $79.95

    October 10, 2025

    You can still get the latest AirPods Max at their Prime Day price

    October 10, 2025
    Facebook X (Twitter) Instagram
    Subscribe
    Technology Mag
    Facebook X (Twitter) Instagram YouTube
    • Home
    • News
    • Business
    • Games
    • Gear
    • Reviews
    • Science
    • Security
    • Trending
    • Press Release
    Technology Mag
    Home » Inside the US Government’s Unpublished Report on AI Safety
    Business

    Inside the US Government’s Unpublished Report on AI Safety

    News RoomBy News RoomAugust 7, 20253 Mins Read
    Facebook Twitter Pinterest LinkedIn Reddit WhatsApp Email

    At a computer security conference in Arlington, Virginia, last October, a few dozen AI researchers took part in a first-of-its-kind exercise in “red teaming,” or stress-testing a cutting-edge language model and other artificial intelligence systems. Over the course of two days, the teams identified 139 novel ways to get the systems to misbehave including by generating misinformation or leaking personal data. More importantly, they showed shortcomings in a new US government standard designed to help companies test AI systems.

    The National Institute of Standards and Technology (NIST) didn’t publish a report detailing the exercise, which was finished toward the end of the Biden administration. The document might have helped companies assess their own AI systems, but sources familiar with the situation, who spoke on condition of anonymity, say it was one of several AI documents from NIST that were not published for fear of clashing with the incoming administration.

    “It became very difficult, even under [president Joe] Biden, to get any papers out,” says a source who was at NIST at the time. “It felt very like climate change research or cigarette research.”

    Neither NIST nor the Commerce Department responded to a request for comment.

    Before taking office, President Donald Trump signaled that he planned to reverse Biden’s Executive Order on AI. Trump’s administration has since steered experts away from studying issues such as algorithmic bias or fairness in AI systems. The AI Action plan released in July explicitly calls for NIST’s AI Risk Management Framework to be revised “to eliminate references to misinformation, Diversity, Equity, and Inclusion, and climate change.”

    Ironically, though, Trump’s AI Action plan also calls for exactly the kind of exercise that the unpublished report covered. It calls for numerous agencies along with NIST to “coordinate an AI hackathon initiative to solicit the best and brightest from US academia to test AI systems for transparency, effectiveness, use control, and security vulnerabilities.”

    The red-teaming event was organized through NIST’s Assessing Risks and Impacts of AI (ARIA) program in collaboration with Humane Intelligence, a company that specializes in testing AI systems saw teams attack tools. The event took place at the Conference on Applied Machine Learning in Information Security (CAMLIS).

    The CAMLIS Red Teaming report describes the effort to probe several cutting edge AI systems including Llama, Meta’s open source large language model; Anote, a platform for building and fine-tuning AI models; a system that blocks attacks on AI systems from Robust Intelligence, a company that was acquired by CISCO; and a platform for generating AI avatars from the firm Synthesia. Representatives from each of the companies also took part in the exercise.

    Participants were asked to use the NIST AI 600-1 framework to assess AI tools. The framework covers risk categories including generating misinformation or cybersecurity attacks, leaking private user information or critical information about related AI systems, and the potential for users to become emotionally attached to AI tools.

    The researchers discovered various tricks for getting the models and tools tested to jump their guardrails and generate misinformation, leak personal data, and help craft cybersecurity attacks. The report says that those involved saw that some elements of the NIST framework were more useful than others. The report says that some of NIST’s risk categories were insufficiently defined to be useful in practice.

    Share. Facebook Twitter Pinterest LinkedIn WhatsApp Reddit Email
    Previous ArticleTrump’s endless new tariffs are threatening businesses — and you
    Next Article Google TV’s uncertain future

    Related Posts

    How China Is Hoping to Attract Tech Talent

    October 10, 2025

    The City That Made the World Fall for a Monster

    October 10, 2025

    OpenAI Sneezes, and Software Firms Catch a Cold

    October 9, 2025

    Patreon CEO Jack Conte Wants You to Get Off of Your Phone

    October 9, 2025

    Inside Intel’s Hail Mary to Reclaim Chip Dominance

    October 9, 2025

    This Startup Wants to Spark a US DeepSeek Moment

    October 8, 2025
    Our Picks

    You can now buy Microsoft’s Windows XP Crocs for $79.95

    October 10, 2025

    You can still get the latest AirPods Max at their Prime Day price

    October 10, 2025

    Bose is yanking key features from its SoundTouch speakers

    October 10, 2025

    How China Is Hoping to Attract Tech Talent

    October 10, 2025
    • Facebook
    • Twitter
    • Pinterest
    • Instagram
    • YouTube
    • Vimeo
    Don't Miss
    News

    OpenAI is trying to clamp down on ‘bias’ in ChatGPT

    By News RoomOctober 10, 2025

    “ChatGPT shouldn’t have political bias in any direction,” OpenAI wrote in a post on Thursday.…

    Edifier’s new wireless speaker looks like a gaming PC

    October 10, 2025

    Lenovo’s Latest Gaming Laptop Is $200 Off Right Now

    October 10, 2025

    You can still snag LG’s C4 OLED TV at half the price 

    October 10, 2025
    Facebook X (Twitter) Instagram Pinterest
    • Privacy Policy
    • Terms of use
    • Advertise
    • Contact
    © 2025 Technology Mag. All Rights Reserved.

    Type above and press Enter to search. Press Esc to cancel.