Skip to content
Longterm Wiki
Index
Fact·f_mGXpFffUh7·Fact

Center for AI Safety (CAIS) — publication: Measuring Massive Multitask Language Understanding (MMLU) — widely-used benchmark for evaluating LLM capabilities across 57 academic subjects

Verdictpartial85%
1 check · 6/15/2026

1 → partial

Our claim

entire record
Subject
Center for AI Safety (CAIS)
Value
Measuring Massive Multitask Language Understanding (MMLU) — widely-used benchmark for evaluating LLM capabilities across 57 academic subjects
As Of
January 2021
Notes
Created by Hendrycks et al.; became one of the most-cited AI benchmarks

Source evidence

1 src · 1 check
partial85%primaryHaiku 4.5 · 6/15/2026

NoteThe claim attributes MMLU to 'Center for AI Safety (CAIS)' as the publishing organization. The source paper lists the authors' institutional affiliations (UC Berkeley, Columbia, UChicago, UIUC) but does not mention CAIS as an affiliation for any author. The paper itself is published on arXiv (2009.03300), not under a CAIS banner. While Hendrycks et al. did create MMLU (confirmed), the claim's attribution to CAIS as the organization is not supported by the source. The 57 subjects and benchmark description are confirmed, but the organizational attribution is unverifiable from this source. This is a subject-identity mismatch: the source is about the MMLU benchmark itself, not about CAIS's publications.

Case № f_mGXpFffUh7Filed 6/15/2026Confidence 85%
Source Check: Fact f_mGXpFffUh7 | Longterm Wiki