Skip to content
Longterm Wiki has not been actively maintained since May 2026. Some data is still updated occasionally, but please don't rely on this site being current or accurate.
Longterm Wiki

METR (Model Evaluation & Threat Research) - About

web

Credibility Rating

4/5
High(4)

High quality. Established institution or organization with editorial oversight and accountability.

Rating inherited from publication venue: METR

METR (formerly ARC Evals) is a key organization in the AI safety ecosystem, providing evaluations that major labs use in their safety commitments; their ARA evaluations are referenced in multiple responsible scaling policies.

Metadata

Importance: 62/100homepage

Summary

METR is an organization focused on evaluating AI models for dangerous capabilities, particularly autonomous replication and adaptation (ARA) risks. They develop evaluation frameworks and conduct assessments to determine whether frontier AI systems pose catastrophic risks before deployment. Their work informs AI safety policy and responsible scaling decisions at major AI labs.

Key Points

  • •METR develops standardized evaluations for dangerous AI capabilities, especially autonomous replication and adaptation (ARA) abilities
  • •The organization conducts third-party model evaluations for frontier AI labs to inform deployment and safety decisions
  • •METR's threat research focuses on scenarios where AI could pose catastrophic or existential risks to humanity
  • •Their evaluation work feeds into responsible scaling policies at labs like Anthropic and Google DeepMind
  • •METR operates as an independent safety-focused organization to provide credible external oversight of frontier models

Cited by 1 page

PageTypeQuality
METROrganization66.0

Cached Content Preview

HTTP 200Fetched Nov 3, 202612 KB
About METR 

 

 

 

 
 

 

 
 
 
 
 
 
 

 
 

 

 
 

 

 
 
 
 
 
 
 
 

 

 

 
 

 

 

 

 
 
 
 
 
 
 
 
 
 
 
 

 
 
 
 
 
 
 
 
 
 
 
 
 Our Work 
 
 
 
 
 
 
 
 
 
 
 Research 
 

 
 
 
 
 
 
 
 Notes 
 

 
 
 
 
 
 
 
 Updates 
 

 
 
 
 
 
 
 
 Risk Assessment 
 

 
 
 
 

 
 
 
 
 
 
 
 
 About 
 

 
 
 
 
 
 
 
 
 Donate 
 

 
 
 
 
 
 
 
 
 Careers 
 

 
 
 

 
 
 Search 
 

 
 

 
 
 
 

 

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 -->
 
 
 
 

 

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 Our Work 
 
 

 
 
 
 
 
 
 
 
 
 

 
 Research 
 
 

 

 
 
 
 
 
 
 
 
 

 
 Notes 
 
 

 

 
 
 
 
 
 
 
 
 

 
 Updates 
 
 

 

 
 
 
 
 
 
 
 
 

 
 Risk Assessment 
 
 

 

 
 

 

 
 
 
 
 
 
 
 
 
 
 About 
 

 
 
 
 
 
 
 
 
 
 
 Donate 
 

 
 
 
 
 
 
 
 
 
 
 Careers 
 

 
 

 

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

 
 

 

 
 

 
 Menu 
 

 
 

 

 
 
 
 
 
 × 
 
 

 
 About METR 
 Model Evaluation and Threat Research 
 
 
 
 

 
 
 
 
 
 What we do

 
 METR (pronounced “meter”) is a nonprofit that studies the most advanced AI agents to understand whether their developers are on track to lose control of them. We publish measurement research and applied assessments so that the public, governments, and companies can make informed decisions.

 Our research has historically focused on measuring agent capabilities: what agents can do on a computer, from suggesting small code edits to fully autonomous AI research. More recently, we have also researched ways to assess whether agents might take actions no human intended, and whether those actions could be detected and contained.

 We work with AI developers to apply these methods in evaluations, incident investigations, and other published assessments. Previously, we prototyped an approach for developers to scale their planned safeguards based on empirical capability measures like these. Many AI developers have since adopted policies built on this idea.

 
 

 

 
 Our mission

 

 METR’s mission is to develop scientific methods to assess catastrophic risks stemming from AI systems’ autonomous capabilities and enable good decision-making about their development. 

 At some point, AI systems will probably be able to do most of what humans can do, including developing new technologies; starting businesses and making money; finding new cybersecurity exploits and fixes; and more. This could change the world quickly and drastically, with potential for both enormous good and enormous harm. Unfortunately, it’s hard to predict exactly when and how this might happen. Being able to measure the autonomous capabilities of AI systems will allow companies and policymakers to see when AI systems might have very wide-reaching impacts, and to focus their efforts on those high-stakes situations.

 The stakes could become very high: it seems very plausible that advanced AI systems could pursue goals that are at odds with what humans want. This could be due to deliberate effort to cause chaos or happen despite the intention

... (truncated, 12 KB total)
Resource ID: 9ece1a3a9a30d8c1 | Stable ID: sid_sYUj0h8sm9