Longterm Wiki has not been actively maintained since May 2026. Some data is still updated occasionally, but please don't rely on this site being current or accurate.
Framework by Aviv Ovadya and 13 co-authors for evaluating the degree to which decisions in a given domain are made democratically. Provides milestones toward meaningfully democratic AI. Published November 2024 (arxiv 2411.09222).
Nonprofit designing and testing democratic processes for AI governance and alignment. Led by Aviv Ovadya. Key projects include the Democracy Levels framework (evaluating how democratically decisions are made), Case Law for AI (judicial-inspired approaches to connecting deliberative input into alignment), and Safeguarded AI (ARIA partnership for formal safety specifications through deliberation). 11 staff members.
The US AI Safety Institute (US AISI), renamed to the Center for AI Standards and Innovation (CAISI) in June 2025, is a government agency within the National Institute of Standards and Technology (NIST) established in 2023 to develop standards, evaluations, and guidelines for safe and trustworthy artificial intelligence.
OpenAI is the AI research company that brought large language models into mainstream consciousness through ChatGPT. Founded in December 2015 as a non-profit with the mission to ensure artificial general intelligence benefits all of humanity, OpenAI has undergone dramatic evolution - from non-profit to "capped-profit," from research lab to produc...
Founder and CEO of the AI & Democracy Foundation. Coined "infocalypse" (2016) to describe AI-generated misinformation crisis. Created the Democracy Levels framework for evaluating democratic AI governance. Leads ARIA-funded "Deliberative AI Specifications and Infrastructure" project. Affiliated with Harvard Berkman Klein Center, Centre for Governance of AI, and newDemocracy Foundation. MIT MEng in CS.
Research Scientist (Ethics) at Google DeepMind. Author of "Artificial Intelligence, Values, and Alignment" (Minds and Machines, 2020). Contributed to the Democratic AI experiment (Koster, Balaguer et al., Nature Human Behaviour, 2022) where RL-designed redistribution won majority human votes over expert-designed alternatives.
First functional futarchy governance on mainnet. Participants trade on prediction markets about whether proposals will increase token value, replacing traditional voting. Generates ~$4,825/day in revenue. 11 projects using "Futarchy as a Service."
US Executive Order on Safe, Secure, and Trustworthy AIPolicyUS Executive Order on Safe, Secure, and Trustworthy AIExecutive Order 14110 (Oct 2023) established compute thresholds (10^26 FLOP general, 10^23 biological) and created AISI, but was revoked after 15 months with ~85% completion. The 10^26 threshold wa...Quality: 91/100Voluntary AI Safety CommitmentsPolicyVoluntary AI Safety CommitmentsComprehensive empirical analysis of voluntary AI safety commitments showing 53% mean compliance rate across 30 indicators (ranging from 13% for Apple to 83% for OpenAI), with strongest adoption in ...Quality: 91/100
Approaches
AI Safety CasesApproachAI Safety CasesSafety cases are structured arguments adapted from nuclear/aviation to justify AI system safety, with UK AISI publishing templates in 2024 and 3 of 4 frontier labs committing to implementation. Apo...Quality: 91/100AI EvaluationApproachAI EvaluationComprehensive overview of AI evaluation methods spanning dangerous capability assessment, safety properties, and deception detection, with categorized frameworks from industry (Anthropic Constituti...Quality: 72/100Third-Party Model AuditingApproachThird-Party Model AuditingThird-party auditing organizations (METR, Apollo, UK/US AISIs) now evaluate all major frontier models pre-deployment, discovering that AI task horizons double every 7 months (GPT-5: 2h17m), 5/6 mod...Quality: 64/100
Organizations
US AI Safety Institute (now CAISI)OrganizationUS AI Safety Institute (now CAISI)The US AI Safety Institute (AISI), established November 2023 within NIST with $10M budget (FY2025 request $82.7M), conducted pre-deployment evaluations of frontier models through MOUs with OpenAI a...Quality: 91/100OpenAIOrganizationOpenAIComprehensive organizational profile of OpenAI documenting evolution from 2015 non-profit to Public Benefit Corporation, with detailed analysis of governance crisis, 2024-2025 ownership restructuri...Quality: 62/100
Risks
AI Authoritarian ToolsRiskAI Authoritarian ToolsComprehensive analysis documenting AI-enabled authoritarian tools across surveillance (350M+ cameras in China analyzing 25.9M faces daily per district), censorship (22+ countries mandating AI conte...Quality: 91/100AI-Driven Institutional Decision CaptureRiskAI-Driven Institutional Decision CaptureComprehensive analysis of how AI systems could capture institutional decision-making across healthcare, criminal justice, hiring, and governance through systematic biases. Documents 85% racial bias...Quality: 73/100Compute ConcentrationRiskCompute ConcentrationAll six major AI infrastructure spenders (Amazon, Alphabet, Microsoft, Meta, Oracle, xAI) are US companies subject to CLOUD Act and FISA 702, giving the US government effective legal access to the ...Quality: 70/100AI Development Racing DynamicsRiskAI Development Racing DynamicsRacing dynamics analysis shows competitive pressure has shortened safety evaluation timelines by 40-60% since ChatGPT's launch, with commercial labs reducing safety work from 12 weeks to 4-6 weeks....Quality: 72/100AI-Driven Concentration of PowerRiskAI-Driven Concentration of PowerDocuments how AI development is concentrating in ~20 organizations due to $100M+ compute costs, with 5 firms controlling 80%+ of cloud infrastructure and projections reaching $1-10B per model by 20...Quality: 65/100
Other
Iason GabrielPersonIason GabrielResearch Scientist (Ethics) at Google DeepMind. Author of "Artificial Intelligence, Values, and Alignment" (Minds and Machines, 2020). Contributed to the Democratic AI experiment (Koster, Balaguer ...
Analysis
OpenAI Foundation Governance ParadoxAnalysisOpenAI Foundation Governance ParadoxThe OpenAI Foundation holds Class N shares giving it exclusive power to appoint/remove all OpenAI Group PBC board members. However, 7 of 8 Foundation board members also serve on the for-profit boar...Quality: 75/100US Government Authority Over Commercial AI InfrastructureAnalysisUS Government Authority Over Commercial AI InfrastructureSurveys US legal authority (DPA, IEEPA, CLOUD Act, FISA 702) over $700B+ in commercial AI infrastructure concentrated in 5-6 companies, concluding the government has extensive but not unlimited pow...Quality: 64/100MetaDAO Futarchy ProtocolProjectMetaDAO Futarchy ProtocolFirst functional futarchy governance on mainnet. Participants trade on prediction markets about whether proposals will increase token value, replacing traditional voting. Generates ~$4,825/day in r...
Concepts
Governance-Focused WorldviewConceptGovernance-Focused WorldviewThis worldview argues governance/coordination is the bottleneck for AI safety (not just technical solutions), estimating 10-30% P(doom) by 2100. Evidence includes: compute export controls reduced H...Quality: 67/100
Historical
International AI Safety Summit SeriesEventInternational AI Safety Summit SeriesThree international AI safety summits (2023-2025) achieved first formal recognition of catastrophic AI risks from 28+ countries, established 10+ AI Safety Institutes with $100-400M combined budgets...Quality: 63/100
Key Debates
Open vs Closed Source AICruxOpen vs Closed Source AIComprehensive analysis of open vs closed source AI debate, documenting that open model performance gap narrowed from 8% to 1.7% in 2024, with 1.2B+ Llama downloads by April 2025 and DeepSeek R1 dem...Quality: 60/100Government Regulation vs Industry Self-GovernanceCruxGovernment Regulation vs Industry Self-GovernanceComprehensive comparison of government regulation versus industry self-governance for AI, documenting that US federal AI regulations doubled to 59 in 2024 while industry lobbying surged 141% to 648...Quality: 54/100