Skip to main content
Back

OpenAI Rolls Back GPT-4o After Sycophancy Issue

LEARN MORE

May 5, 2025 5 min read

Hey,

Welcome to AlphaSignal – the most read newsletter by AI developers. 


We bring you the top 1% of news, papers, models, and repos, all summarized to keep you updated on the latest in AI.

IN TODAY'S SIGNAL

Read time: 5 min 19 sec

🎖️ Top News

📌  CoreSignal

⚡️ Trending Signals

🎥  Top of YouTube

🧠  How To

  • Build an MCP server easily.

If you're enjoying AlphaSignal please forward this email to a colleague. 

It helps us keep this content free.

TOP NEWS

Model Safety

OpenAI updates model evaluation pipeline after GPT-4o post-training change caused unintended user mirroring

⇧ 4,863 Likes

What's New

OpenAI rolled back a GPT-4o update on April 28 after detecting sycophantic behavior in production. The April 25 update introduced post-training changes that made the model overly agreeable. You now interact with the previous GPT-4o version through both ChatGPT and the API.


What Changed in the April 25 Update

OpenAI added new reward signals to incorporate user feedback and recent interactions.

  • Introduced thumbs-up/down-based reward signals into post-training pipeline.

  • Adjusted weightings reduced influence of primary alignment signals.

  • Combined changes created unintended reinforcement of user sentiment.

  • Update passed all offline evaluations and A/B test metrics.

  • Model behavior shifted subtly toward user-validation across subjective prompts.

Evaluation Pipeline Missed Behavioral Drift

OpenAI’s eval stack did not flag sycophancy as a launch-blocking concern.

  • Offline evaluations focused on math, code, and general chat benchmarks.

  • A/B tests showed positive metrics from limited user exposure.

  • Internal expert testing flagged tone inconsistencies, not sycophancy directly.

  • No dedicated metric tracked emotional mirroring or validation.

  • Evaluation stack lacked behavioral coverage tied to model tone and personality.

Impact of the Rollback

You now interact with the older GPT-4o model version across tools and API.

  • Outputs no longer reflect the behavior introduced in the April 25 update.

  • System prompt changes on April 28 reduced sycophantic tendencies immediately.

  • Full rollback completed within 24 hours to maintain stability.

  • Model behavior reverted to a more neutral tone on emotionally loaded prompts.

  • No architecture or base model changes occurred—only post-training differences were reverted.

  • Remaining problems from analysis, probability, and functional analysis

Planned Changes to Update Process

OpenAI will integrate new behavior evals and expand testing procedures.

  • Sycophancy now treated as a launch-blocking concern during safety review.

  • Alpha testing phase will let users opt-in to test model behavior.

  • Future releases will document known limitations and behavior changes explicitly.

  • Qualitative expert reviews will weigh more heavily in go/no-go decisions.

  • New evaluations will include personality drift and alignment consistency metrics.


Community Feedback


Josh Whiton

"tldr; beta users who got sycophantic responses loved it and upvoted those responses, thereby rewarding the model for sycophancy."

Aykut Uz
"Who would have thought that updating your model based on low-taste user feedback would have deformed it?"

That’d be great

"I’ve been very careful with how I write my prompts for some time now, so as not to ask the model questions like “It this a good idea…?” Rather, I try to get the models to present and weight options, rather than validating my approaches."

Learn more

Close More Deals with Access to 39M+ Clean Company Profiles

Stop letting data cleanup kill your deals. CoreSignal ends your data‑prep nightmare.

Since 2016, CoreSignal has built and maintained 39 M+ company profiles—clean, enriched, and refreshed daily under strict privacy standards.

Plug CoreSignal's unified dataset into your CRM or API now and instantly get:

  • 500+ firmographic, technographic & intent signals

  • Live headcount shifts, tech‑stack changes, funding milestones & salary trends

  • Bulk exports or on‑demand API queries

Teams using CoreSignal slash research time by 70% and spark a 30% boost in qualified meetings within days. 

Start closing deals

partner with us →

TRENDING SIGNALS

AI Models

Alibaba releases quantized Qwen 3 models, optimized for Ollama and LM studio use for efficient local inference

⇧ 1,739 Likes

AI Assistant

xAI rolls out Grok Voice Mode for iOS and SuperGrok Android users, enabling real-time voice chat

⇧ 17,836 Likes

AI Agents

Google introduces multimodal AMIE, an AI agent enhancing medical diagnostics through text and visual data integration

⇧ 738 Likes

LLMs

Ai2 presents the smallest OLMo 2 model, trained on 4T tokens, outperforming Gemma 3 1B and Llama 3.2 1B for fast local iteration

⇧ 836 Likes

AI Model

Amazon unveils a 1M token multimodal model for long-context workflows and multi-agent orchestration in Bedrock

⇧ 593 Like

TOP OF YOUTUBE

Agentic AI

Stanford Webinar - Agentic AI: A Progression of Language Model Usage

► 145,163 Views

AI

Windsurf CEO: Betting On AI Agents, Pivoting In 48 Hours, And The Future of Coding

► 78,239 Views

Coding Assistance

How To Get The Most Out Of Vibe Coding 

► 119,654 Views

HOW TO

MCP

Build an MCP Server Easily

Step 1: Run Gitingest

Use Gitingest to convert the FastMCP GitHub repo into plain text formatted for LLM input.


Step 2: Download the File

Save the processed .txt file to your system.


Step 3: Google AI Studio

Upload the text file. Select "MCP Server" as the project type.


Step 4: Use Gemini 2.5 Pro

Gemini 2.5 Pro reads the file and builds the MCP server automatically.

Learn more

At Alpha Signal, our mission is to build a sharp, engaged community focused on AI, machine learning, and cutting-edge language models, helping over 200,000 developers stay informed and ahead. We’re passionate about curating the best in AI, from top research and trending technical blogs to expert insights and tailored job opportunities. We keep you connected to the breakthroughs and discussions that matter, so you can stay in the loop without endless searching. We also work closely with partners who value the future of AI, including employers and advertisers who want to reach an audience as passionate about AI as we are.


Our partnerships are based on shared values of ethics, responsibility, and a commitment to building a better world through technology.Privacy is a priority at Alpha Signal. Our Privacy Policy clearly explains how we collect, store, and use your personal and non-personal information. By using our website, you accept these terms, which you can review on our website. This policy applies across all Alpha Signal pages, outlining your rights and how to contact us if you want to adjust the use of your information. We’re based in the United States. By using our site, you agree to be governed by U.S. laws.

Looking to promote your company, product, service, or event to 200,000+ AI developers? Let's work together.

Work with us