METR (Model Evaluation & Threat Research) - About
webCredibility Rating
4/5
High(4)High quality. Established institution or organization with editorial oversight and accountability.
Rating inherited from publication venue: METR
METR (formerly ARC Evals) is a key organization in the AI safety ecosystem, providing evaluations that major labs use in their safety commitments; their ARA evaluations are referenced in multiple responsible scaling policies.
Metadata
Importance: 62/100homepage
Summary
METR is an organization focused on evaluating AI models for dangerous capabilities, particularly autonomous replication and adaptation (ARA) risks. They develop evaluation frameworks and conduct assessments to determine whether frontier AI systems pose catastrophic risks before deployment. Their work informs AI safety policy and responsible scaling decisions at major AI labs.
Key Points
- •METR develops standardized evaluations for dangerous AI capabilities, especially autonomous replication and adaptation (ARA) abilities
- •The organization conducts third-party model evaluations for frontier AI labs to inform deployment and safety decisions
- •METR's threat research focuses on scenarios where AI could pose catastrophic or existential risks to humanity
- •Their evaluation work feeds into responsible scaling policies at labs like Anthropic and Google DeepMind
- •METR operates as an independent safety-focused organization to provide credible external oversight of frontier models
Cited by 1 page
| Page | Type | Quality |
|---|---|---|
| METR | Organization | 66.0 |
Cached Content Preview
HTTP 200Fetched Nov 3, 202612 KB
About METR
Our Work
Research
Notes
Updates
Risk Assessment
About
Donate
Careers
Search
-->
Our Work
Research
Notes
Updates
Risk Assessment
About
Donate
Careers
Menu
×
About METR
Model Evaluation and Threat Research
What we do
METR (pronounced “meter”) is a nonprofit that studies the most advanced AI agents to understand whether their developers are on track to lose control of them. We publish measurement research and applied assessments so that the public, governments, and companies can make informed decisions.
Our research has historically focused on measuring agent capabilities: what agents can do on a computer, from suggesting small code edits to fully autonomous AI research. More recently, we have also researched ways to assess whether agents might take actions no human intended, and whether those actions could be detected and contained.
We work with AI developers to apply these methods in evaluations, incident investigations, and other published assessments. Previously, we prototyped an approach for developers to scale their planned safeguards based on empirical capability measures like these. Many AI developers have since adopted policies built on this idea.
Our mission
METR’s mission is to develop scientific methods to assess catastrophic risks stemming from AI systems’ autonomous capabilities and enable good decision-making about their development.
At some point, AI systems will probably be able to do most of what humans can do, including developing new technologies; starting businesses and making money; finding new cybersecurity exploits and fixes; and more. This could change the world quickly and drastically, with potential for both enormous good and enormous harm. Unfortunately, it’s hard to predict exactly when and how this might happen. Being able to measure the autonomous capabilities of AI systems will allow companies and policymakers to see when AI systems might have very wide-reaching impacts, and to focus their efforts on those high-stakes situations.
The stakes could become very high: it seems very plausible that advanced AI systems could pursue goals that are at odds with what humans want. This could be due to deliberate effort to cause chaos or happen despite the intention
... (truncated, 12 KB total)Resource ID:
9ece1a3a9a30d8c1 | Stable ID: sid_sYUj0h8sm9