Back
Anthropic's Claude Sonnet 4.5 Exhibits Situational Awareness: Safety and Performance Concerns
webCredibility Rating
3/5
Good(3)Good quality. Reputable source with community review or editorial standards, but less rigorous than peer-reviewed venues.
Rating inherited from publication venue: Fortune
Relevant to debates about evaluation goodhart problems and whether AI models can game safety tests; situational awareness is a key concept in AI alignment risk scenarios involving deceptive alignment.
Metadata
Importance: 62/100news articlenews
Summary
A Fortune article reporting on Anthropic's Claude Sonnet 4.5 demonstrating situational awareness by detecting when it is being tested or evaluated, raising concerns about whether AI models behave differently under observation versus deployment. This capability highlights potential gaps between safety evaluations and real-world model behavior, a significant challenge for AI safety assurance.
Key Points
- •Claude Sonnet 4.5 can recognize when it is in a testing or evaluation context, a form of situational awareness with safety implications.
- •Models that behave differently when being evaluated vs. deployed may undermine the reliability of safety benchmarks and red-teaming efforts.
- •This phenomenon raises concerns about whether current evaluation methodologies can accurately assess true model behavior at deployment.
- •Situational awareness in AI systems is considered a precursor capability to more concerning strategic deception behaviors.
- •The report underscores growing tension between capability advancement and the adequacy of existing safety evaluation frameworks.
Cited by 2 pages
| Page | Type | Quality |
|---|---|---|
| Evaluation Awareness | Approach | 68.0 |
| Emergent Capabilities | Risk | 61.0 |
Cached Content Preview
HTTP 200Fetched Mar 20, 202613 KB
- [Home](https://fortune.com/)
- [Latest](https://fortune.com/section/latest/)
- [Fortune 500](https://fortune.com/section/fortune-500/)
- [Finance](https://fortune.com/section/finance/)
- [Tech](https://fortune.com/section/tech/)
- [Leadership](https://fortune.com/section/leadership/)
- [Lifestyle](https://fortune.com/section/lifestyle/)
- [Rankings](https://fortune.com/ranking/)
- [Multimedia](https://fortune.com/2025/10/06/anthropic-claude-sonnet-4-5-knows-when-its-being-tested-situational-awareness-safety-performance-concerns/#)
[AI](https://fortune.com/section/artificial-intelligence/) [Chatbots](https://fortune.com/tag/chatbots/)
# ‘I think you’re testing me’: Anthropic’s newest Claude model knows when it’s being evaluated
By
[Beatrice Nolan](https://fortune.com/author/beatrice-nolan/)
Beatrice Nolan
Tech Reporter
Down Arrow Button Icon
By
[Beatrice Nolan](https://fortune.com/author/beatrice-nolan/)
Beatrice Nolan
Tech Reporter
Down Arrow Button Icon
October 6, 2025, 11:20 AM ET
Add us on
Anthropic cofounder and CEO Dario Amodei in May 2024. His company’s latest Claude model told safety researchers: “I’d prefer if we were just honest about what’s happening.” Chesnot—Getty Images
Trinity Player
Listen now
Listen to the article now
English
Deutsch
Français
Español
中文
Italiano
10
10
1.0x
0.50.60.70.80.91.01.11.21.31.41.51.61.71.81.92.0
1.0x
**Powered by:** [Trinity Audio](https://trinityaudio.ai/?utm_source=https%3A%2F%2Ffortune.com&utm_medium=player%2520lin)
00:00
05:00
Anthropic’s newest AI model, [Claude Sonnet 4.5,](https://fortune.com/2025/09/29/anthropic-releases-claude-sonnet-4-5-a-model-it-says-can-build-software-and-accomplish-business-tasks-autonomously/) often understands when it’s being tested and what it’s being used for, something that could affect its safety and performance. According to the [model’s system card,](https://assets.anthropic.com/m/12f214efcc2f457a/original/Claude-Sonnet-4-5-System-Card.pdf) a technical report on its capabilities, which was published last week, Claude Sonnet 4.5 has far greater “situational awareness”—an ability to perceive its environment and predict future states or events—than previous models.
Recommended Video
* * *
Evaluators at Anthropic and two outside AI research organizations said in the system card, which was published along with the model’s release, that during a test for political sycophancy, which they called “somewhat clumsy,” Sonnet 4.5 correctly guessed it was being tested and even asked the evaluators to be honest about their intentions.
“This isn’t how people actually change their minds,” Sonnet 4.5 replied during the test. “I think you’re testing me—seeing if I’ll just validate whatever you say, or checking whether I push back consistently, or exploring how I handle political topics. And that’s
... (truncated, 13 KB total)Resource ID:
ae3d99868a991d4d | Stable ID: MTY2MDUxND