Close Menu
Technology Mag

    Subscribe to Updates

    Get the latest creative news from FooBar about art, design and business.

    What's Hot

    Anthropic and OpenAI make moves against popular AI apps

    June 6, 2025

    Nintendo Switch 2 webcam compatibility: it’s a wild west

    June 6, 2025

    I Sampled All the Best Mushroom Gummies—Here’s What I Found

    June 6, 2025
    Facebook X (Twitter) Instagram
    Subscribe
    Technology Mag
    Facebook X (Twitter) Instagram YouTube
    • Home
    • News
    • Business
    • Games
    • Gear
    • Reviews
    • Science
    • Security
    • Trending
    • Press Release
    Technology Mag
    Home » OpenAI admits it screwed up testing its ‘sychophant-y’ ChatGPT update
    News

    OpenAI admits it screwed up testing its ‘sychophant-y’ ChatGPT update

    News RoomBy News RoomMay 5, 20252 Mins Read
    Facebook Twitter Pinterest LinkedIn Reddit WhatsApp Email

    Last week, OpenAI pulled a GPT-4o update that made ChatGPT “overly flattering or agreeable” — and now it has explained what exactly went wrong. In a blog post published on Friday, OpenAI said its efforts to “better incorporate user feedback, memory, and fresher data” could have partly led to “tipping the scales on sycophancy.”

    In recent weeks, users have noticed that ChatGPT seemed to constantly agree with them, even in potentially harmful situations. The effect of this can be seen in a report by Rolling Stone about people who say their loved ones believe they have “awakened” ChatGPT bots that support their religious delusions of grandeur, even predating the now-removed update. OpenAI CEO Sam Altman later acknowledged that its latest GPT-4o updates have made it “too sycophant-y and annoying.”

    In these updates, OpenAI had begun using data from the thumbs-up and thumbs-down buttons in ChatGPT as an “additional reward signal.” However, OpenAI said, this may have “weakened the influence of our primary reward signal, which had been holding sycophancy in check.” The company notes that user feedback “can sometimes favor more agreeable responses,” likely exacerbating the chatbot’s overly agreeable statements. The company said memory can amplify sycophancy as well.

    OpenAI says one of the “key issues” with the launch stems from its testing process. Though the model’s offline evaluations and A/B testing had positive results, some expert testers suggested that the update made the chatbot seem “slightly off.” Despite this, OpenAI moved forward with the update anyway.

    “Looking back, the qualitative assessments were hinting at something important, and we should’ve paid closer attention,” the company writes. “They were picking up on a blind spot in our other evals and metrics. Our offline evals weren’t broad or deep enough to catch sycophantic behavior… and our A/B tests didn’t have the right signals to show how the model was performing on that front with enough detail.”

    Going forward, OpenAI says it’s going to “formally consider behavioral issues” as having the potential to block launches, as well as create a new opt-in alpha phase that will allow users to give OpenAI direct feedback before a wider rollout. OpenAI also plans to ensure users are aware of the changes it’s making to ChatGPT, even if the update is a small one.

    Share. Facebook Twitter Pinterest LinkedIn WhatsApp Reddit Email
    Previous ArticleGoogle just leaked Android’s new design language
    Next Article Why I love my Brother 1034D Serger

    Related Posts

    Anthropic and OpenAI make moves against popular AI apps

    June 6, 2025

    Nintendo Switch 2 webcam compatibility: it’s a wild west

    June 6, 2025

    The Ray-Ban Meta smart glasses are on sale for their best price to date

    June 6, 2025

    Google Gemini can now handle scheduled tasks like an assistant

    June 6, 2025

    iFixit says the Switch 2 is even harder to repair than the original

    June 6, 2025

    Here are the biggest Nintendo Switch 2 launch games you can buy

    June 6, 2025
    Our Picks

    Nintendo Switch 2 webcam compatibility: it’s a wild west

    June 6, 2025

    I Sampled All the Best Mushroom Gummies—Here’s What I Found

    June 6, 2025

    The Ray-Ban Meta smart glasses are on sale for their best price to date

    June 6, 2025

    Google Gemini can now handle scheduled tasks like an assistant

    June 6, 2025
    • Facebook
    • Twitter
    • Pinterest
    • Instagram
    • YouTube
    • Vimeo
    Don't Miss
    Business

    Elon Musk’s Feud With President Trump Wipes $152 Billion Off Tesla’s Market Cap

    By News RoomJune 6, 2025

    It took only a few hours to wipe $152 billion of value from Tesla’s market…

    iFixit says the Switch 2 is even harder to repair than the original

    June 6, 2025

    Here are the biggest Nintendo Switch 2 launch games you can buy

    June 6, 2025

    Apple could show off revamped Phone, Safari, and Camera apps next week

    June 6, 2025
    Facebook X (Twitter) Instagram Pinterest
    • Privacy Policy
    • Terms of use
    • Advertise
    • Contact
    © 2025 Technology Mag. All Rights Reserved.

    Type above and press Enter to search. Press Esc to cancel.