Index
Center for AI Safety (CAIS) — publication: Measuring Massive Multitask Language Understanding (MMLU) — widely-used benchmark for evaluating LLM capabilities across 57 academic subjects
Verdictpartial85%
1 check · 6/15/20261 → partial
Our claim
entire record- Subject
- Center for AI Safety (CAIS)
- Value
- Measuring Massive Multitask Language Understanding (MMLU) — widely-used benchmark for evaluating LLM capabilities across 57 academic subjects
- As Of
- January 2021
- Notes
- Created by Hendrycks et al.; became one of the most-cited AI benchmarks
Source evidence
1 src · 1 checkpartial85%primaryHaiku 4.5 · 6/15/2026
NoteThe claim attributes MMLU to 'Center for AI Safety (CAIS)' as the publishing organization. The source paper lists the authors' institutional affiliations (UC Berkeley, Columbia, UChicago, UIUC) but does not mention CAIS as an affiliation for any author. The paper itself is published on arXiv (2009.03300), not under a CAIS banner. While Hendrycks et al. did create MMLU (confirmed), the claim's attribution to CAIS as the organization is not supported by the source. The 57 subjects and benchmark description are confirmed, but the organizational attribution is unverifiable from this source. This is a subject-identity mismatch: the source is about the MMLU benchmark itself, not about CAIS's publications.
Case № f_mGXpFffUh7Filed 6/15/2026Confidence 85%