Close Menu
Technology Mag

    Subscribe to Updates

    Get the latest creative news from FooBar about art, design and business.

    What's Hot

    Taiwan Is Rushing to Make Its Own Drones Before It’s Too Late

    June 28, 2025

    The Best WIRED-Tested Cat Toys for Your Sophisticated Fur Baby

    June 28, 2025

    Facebook is starting to feed its Meta AI with private, unpublished photos

    June 27, 2025
    Facebook X (Twitter) Instagram
    Subscribe
    Technology Mag
    Facebook X (Twitter) Instagram YouTube
    • Home
    • News
    • Business
    • Games
    • Gear
    • Reviews
    • Science
    • Security
    • Trending
    • Press Release
    Technology Mag
    Home » OpenAI admits it screwed up testing its ‘sychophant-y’ ChatGPT update
    News

    OpenAI admits it screwed up testing its ‘sychophant-y’ ChatGPT update

    News RoomBy News RoomMay 5, 20252 Mins Read
    Facebook Twitter Pinterest LinkedIn Reddit WhatsApp Email

    Last week, OpenAI pulled a GPT-4o update that made ChatGPT “overly flattering or agreeable” — and now it has explained what exactly went wrong. In a blog post published on Friday, OpenAI said its efforts to “better incorporate user feedback, memory, and fresher data” could have partly led to “tipping the scales on sycophancy.”

    In recent weeks, users have noticed that ChatGPT seemed to constantly agree with them, even in potentially harmful situations. The effect of this can be seen in a report by Rolling Stone about people who say their loved ones believe they have “awakened” ChatGPT bots that support their religious delusions of grandeur, even predating the now-removed update. OpenAI CEO Sam Altman later acknowledged that its latest GPT-4o updates have made it “too sycophant-y and annoying.”

    In these updates, OpenAI had begun using data from the thumbs-up and thumbs-down buttons in ChatGPT as an “additional reward signal.” However, OpenAI said, this may have “weakened the influence of our primary reward signal, which had been holding sycophancy in check.” The company notes that user feedback “can sometimes favor more agreeable responses,” likely exacerbating the chatbot’s overly agreeable statements. The company said memory can amplify sycophancy as well.

    OpenAI says one of the “key issues” with the launch stems from its testing process. Though the model’s offline evaluations and A/B testing had positive results, some expert testers suggested that the update made the chatbot seem “slightly off.” Despite this, OpenAI moved forward with the update anyway.

    “Looking back, the qualitative assessments were hinting at something important, and we should’ve paid closer attention,” the company writes. “They were picking up on a blind spot in our other evals and metrics. Our offline evals weren’t broad or deep enough to catch sycophantic behavior… and our A/B tests didn’t have the right signals to show how the model was performing on that front with enough detail.”

    Going forward, OpenAI says it’s going to “formally consider behavioral issues” as having the potential to block launches, as well as create a new opt-in alpha phase that will allow users to give OpenAI direct feedback before a wider rollout. OpenAI also plans to ensure users are aware of the changes it’s making to ChatGPT, even if the update is a small one.

    Share. Facebook Twitter Pinterest LinkedIn WhatsApp Reddit Email
    Previous ArticleGoogle just leaked Android’s new design language
    Next Article Why I love my Brother 1034D Serger

    Related Posts

    Facebook is starting to feed its Meta AI with private, unpublished photos

    June 27, 2025

    How vulnerable is critical infrastructure to cyberattack in the US?

    June 27, 2025

    The best deals on 4K TVs

    June 27, 2025

    Google’s carbon emissions just went up again

    June 27, 2025

    Eufy’s Omni C20 mopping robovac is $300 off for a limited time

    June 27, 2025

    What Meta and Anthropic really won in court

    June 27, 2025
    Our Picks

    The Best WIRED-Tested Cat Toys for Your Sophisticated Fur Baby

    June 28, 2025

    Facebook is starting to feed its Meta AI with private, unpublished photos

    June 27, 2025

    How vulnerable is critical infrastructure to cyberattack in the US?

    June 27, 2025

    I’m an Outdoor Writer. I’m Shopping 28 Deals From REI’s July 4 Sale

    June 27, 2025
    • Facebook
    • Twitter
    • Pinterest
    • Instagram
    • YouTube
    • Vimeo
    Don't Miss
    News

    The best deals on 4K TVs

    By News RoomJune 27, 2025

    Things are looking bright for those who want to nab a great TV in 2025…

    Disney Just Threw a Punch in a Major AI Fight

    June 27, 2025

    Google’s carbon emissions just went up again

    June 27, 2025

    Eufy’s Omni C20 mopping robovac is $300 off for a limited time

    June 27, 2025
    Facebook X (Twitter) Instagram Pinterest
    • Privacy Policy
    • Terms of use
    • Advertise
    • Contact
    © 2025 Technology Mag. All Rights Reserved.

    Type above and press Enter to search. Press Esc to cancel.