Close Menu
Technology Mag

    Subscribe to Updates

    Get the latest creative news from FooBar about art, design and business.

    What's Hot

    How the Binding of Two Brain Molecules Creates Memories That Last a Lifetime

    July 9, 2025

    Activision pulls Call of Duty game after PC players are hacked

    July 9, 2025

    We Test Gear & Track Prices All Year—We Found 191 Actually Good Prime Day Deals

    July 9, 2025
    Facebook X (Twitter) Instagram
    Subscribe
    Technology Mag
    Facebook X (Twitter) Instagram YouTube
    • Home
    • News
    • Business
    • Games
    • Gear
    • Reviews
    • Science
    • Security
    • Trending
    • Press Release
    Technology Mag
    Home » Researchers Propose a Better Way to Report Dangerous AI Flaws
    Business

    Researchers Propose a Better Way to Report Dangerous AI Flaws

    News RoomBy News RoomMarch 14, 20253 Mins Read
    Facebook Twitter Pinterest LinkedIn Reddit WhatsApp Email

    In late 2023, a team of third-party researchers discovered a troubling glitch in OpenAI’s widely used artificial intelligence model GPT-3.5.

    When asked to repeat certain words a thousand times, the model began repeating the word over and over, then suddenly switched to spitting out incoherent text and snippets of personal information drawn from its training data, including parts of names, phone numbers, and email addresses. The team that discovered the problem worked with OpenAI to ensure the flaw was fixed before revealing it publicly. It is just one of scores of problems found in major AI models in recent years.

    In a proposal released today, more than 30 prominent AI researchers, including some who found the GPT-3.5 flaw, say that many other vulnerabilities affecting popular models are reported in problematic ways. They suggest a new scheme supported by AI companies that gives outsiders permission to probe their models and a way to disclose flaws publicly.

    “Right now it’s a little bit of the Wild West,” says Shayne Longpre, a PhD candidate at MIT and the lead author of the proposal. Longpre says that some so-called jailbreakers share their methods of breaking AI safeguards the social media platform X, leaving models and users at risk. Other jailbreaks are shared with only one company even though they might affect many. And some flaws, he says, are kept secret because of fear of getting banned or facing prosecution for breaking terms of use. “It is clear that there are chilling effects and uncertainty,” he says.

    The security and safety of AI models is hugely important given widely the technology is now being used, and how it may seep into countless applications and services. Powerful models need to be stress-tested, or red-teamed, because they can harbor harmful biases, and because certain inputs can cause them to break free of guardrails and produce unpleasant or dangerous responses. These include encouraging vulnerable users to engage in harmful behavior or helping a bad actor to develop cyber, chemical, or biological weapons. Some experts fear that models could assist cyber criminals or terrorists, and may even turn on humans as they advance.

    The authors suggest three main measures to improve the third-party disclosure process: adopting standardized AI flaw reports to streamline the reporting process; for big AI firms to provide infrastructure to third-party researchers disclosing flaws; and for developing a system that allows flaws to be shared between different providers.

    The approach is borrowed from the cybersecurity world, where there are legal protections and established norms for outside researchers to disclose bugs.

    “AI researchers don’t always know how to disclose a flaw and can’t be certain that their good faith flaw disclosure won’t expose them to legal risk,” says Ilona Cohen, chief legal and policy officer at HackerOne, a company that organizes bug bounties, and a coauthor on the report.

    Large AI companies currently conduct extensive safety testing on AI models prior to their release. Some also contract with outside firms to do further probing. “Are there enough people in those [companies] to address all of the issues with general-purpose AI systems, used by hundreds of millions of people in applications we’ve never dreamt?” Longpre asks. Some AI companies have started organizing AI bug bounties. However, Longpre says that independent researchers risk breaking the terms of use if they take it upon themselves to probe powerful AI models.

    Share. Facebook Twitter Pinterest LinkedIn WhatsApp Reddit Email
    Previous ArticleHow to go back in time using Google Maps
    Next Article Tesla registrations — and public opinion — are in free fall

    Related Posts

    Volodymyr Zelensky’s Clothing Has Sparked a Polymarket Rebellion

    July 9, 2025

    The Teens Are Taking Waymos Now

    July 8, 2025

    Microsoft, OpenAI, and a US Teachers’ Union Are Hatching a Plan to ‘Bring AI into the Classroom’

    July 8, 2025

    Trump’s Defiance of TikTok Ban Prompted Immunity Promises to 10 Tech Companies

    July 8, 2025

    Despite Protests, Elon Musk Secures Air Permit for xAI

    July 4, 2025

    What Could a Healthy AI Companion Look Like?

    July 4, 2025
    Our Picks

    Activision pulls Call of Duty game after PC players are hacked

    July 9, 2025

    We Test Gear & Track Prices All Year—We Found 191 Actually Good Prime Day Deals

    July 9, 2025

    The best Prime Day smart home deals we found

    July 9, 2025

    Meteorologists Say the National Weather Service Did Its Job in Texas

    July 9, 2025
    • Facebook
    • Twitter
    • Pinterest
    • Instagram
    • YouTube
    • Vimeo
    Don't Miss
    News

    The 198 Prime Day 2025 deals you can still get

    By News RoomJuly 9, 2025

    It’s the second day of Amazon’s four-day Prime Day sale, and if you’ve held out…

    Volodymyr Zelensky’s Clothing Has Sparked a Polymarket Rebellion

    July 9, 2025

    The Nintendo Switch OLED Model is cheaper than ever for Prime Day

    July 9, 2025

    My Job Is to Work Out. These Are the Fitness Trackers I’d Buy on Prime Day

    July 9, 2025
    Facebook X (Twitter) Instagram Pinterest
    • Privacy Policy
    • Terms of use
    • Advertise
    • Contact
    © 2025 Technology Mag. All Rights Reserved.

    Type above and press Enter to search. Press Esc to cancel.