6-month salary to translate AGI safety-related texts, e.g. LessWrong and AI Alignment Forum, into Russian $13K Maksim Vymenets 2022-01 funds.effectivealtruism.org [Long-Term Future Fund] 6-month salary to translate AGI safety-related texts, e.g. LessWrong and AI Alignment Forum, into Russian xng_1vsce_ Not checked Working on long-term macrostrategy and AI Alignment, and up-skilling and career transition towards that goal $40K Tushant Jha Person Tushant Jha AI ethics and value alignment researcher at Future of Humanity Institute (FHI). Foresight Fellow (2022). 2020-01 funds.effectivealtruism.org [Long-Term Future Fund] Working on long-term macrostrategy and AI Alignment, and up-skilling and career transition towards that goal xng_1vsce_ Not checked Characterizing the properties and constraints of complex systems and their external interactions to inform AI safety research $20K Alexander Siegenfeld 2019-07 funds.effectivealtruism.org [Long-Term Future Fund] Characterizing the properties and constraints of complex systems and their external interactions to inform AI safety research xng_1vsce_ Not checked 6-month salary to write a book on philosophy + history of longtermist thinking, while longer-term funding is arranged $28K Thomas Moynihan 2021-10 funds.effectivealtruism.org [Long-Term Future Fund] 6-month salary to write a book on philosophy + history of longtermist thinking, while longer-term funding is arranged xng_1vsce_ Not checked 12-month salary for researching value learning $50K Charlie Steiner 2022-01 funds.effectivealtruism.org [Long-Term Future Fund] 12-month salary for researching value learning xng_1vsce_ Not checked Conducting a computational study on using a light-to-vibrations mechanism as a targeted antiviral. $30K Gavin Taylor 2020-07 funds.effectivealtruism.org [Long-Term Future Fund] Conducting a computational study on using a light-to-vibrations mechanism as a targeted antiviral. xng_1vsce_ Not checked Support Sam's participation in ‘Mid-term AI impacts’ research project $4.5K Sam Clarke 2020-10 funds.effectivealtruism.org [Long-Term Future Fund] Support Sam's participation in ‘Mid-term AI impacts’ research project xng_1vsce_ Not checked PhD at Cambridge $150K Richard Ngo Person Richard Ngo Richard Ngo is an AI governance researcher who has worked at both OpenAI and Google DeepMind. He has written influential essays on AI alignment, the case for AI risk, and AGI safety. He is known fo... 2020-07 funds.effectivealtruism.org [Long-Term Future Fund] PhD at Cambridge xng_1vsce_ Not checked Funding a nordic conference for senior X-risk researchers and junior talents interested in entering the field $4.6K Effektiv Altruism Sverige (EA Sweden) Organization Effektiv Altruism Sverige (EA Sweden) Swedish chapter of the effective altruism movement. 2021-10 funds.effectivealtruism.org [Long-Term Future Fund] Funding a nordic conference for senior X-risk researchers and junior talents interested in entering the field xng_1vsce_ Not checked Funding for a degree in the Biological Sciences at UCSD (University of California San Diego) $250K Kristaps Zilgalvis 2021-10 funds.effectivealtruism.org [Long-Term Future Fund] Funding for a degree in the Biological Sciences at UCSD (University of California San Diego) xng_1vsce_ Not checked I would like to produce a research paper about the history of philanthropy-driven national-scale movement-building strategy to inform how EA funders might go about building movements for good. $2K Ruth Grace Wong 2022-01 funds.effectivealtruism.org [Long-Term Future Fund] I would like to produce a research paper about the history of philanthropy-driven national-scale movement-building strategy to inform how EA funders might go about building movements for good. xng_1vsce_ Not checked Research on AI safety $30K Marius Hobbhahn 2022-01 funds.effectivealtruism.org [Long-Term Future Fund] Research on AI safety xng_1vsce_ Not checked Living costs stipend for extra US semester + funding for open-source intelligence (OSINT) equipment & software $11K George Green 2021-10 funds.effectivealtruism.org [Long-Term Future Fund] Living costs stipend for extra US semester + funding for open-source intelligence (OSINT) equipment & software xng_1vsce_ Not checked Design and implement simulations of human cultural acquisition as both an analog of and testbed for AI alignment $150K Nick Hay 2021-10 funds.effectivealtruism.org [Long-Term Future Fund] Design and implement simulations of human cultural acquisition as both an analog of and testbed for AI alignment xng_1vsce_ Not checked Buy out of teaching assistant duties for the remaining two years of my PhD program $50K Michael Zlatin 2022-01 funds.effectivealtruism.org [Long-Term Future Fund] Buy out of teaching assistant duties for the remaining two years of my PhD program xng_1vsce_ Not checked Support to make videos and podcasts about AI Safety/Alignment, and build a community to help new people get involved $82K Robert Miles 2022-01 funds.effectivealtruism.org [Long-Term Future Fund] Support to make videos and podcasts about AI Safety/Alignment, and build a community to help new people get involved xng_1vsce_ Not checked Support to work on biosecurity $11K Sculpting Evolution Group, MIT 2022-01 funds.effectivealtruism.org [Long-Term Future Fund] Support to work on biosecurity xng_1vsce_ Not checked Funding to trial a new London organization aiming to 10x the number of AI safety researchers $234K Jessica Cooper 2022-01 funds.effectivealtruism.org [Long-Term Future Fund] Funding to trial a new London organization aiming to 10x the number of AI safety researchers xng_1vsce_ Not checked Time costs over six months to publish a paper on the interaction of open science practices and bio-risk $8.3K James Smith 2021-10 funds.effectivealtruism.org [Long-Term Future Fund] Time costs over six months to publish a paper on the interaction of open science practices and bio-risk xng_1vsce_ Not checked Research into the nature of optimization, knowledge, and agency, with relevance to AI alignment $80K Alex Flint 2021-07 funds.effectivealtruism.org [Long-Term Future Fund] Research into the nature of optimization, knowledge, and agency, with relevance to AI alignment xng_1vsce_ Not checked Producing video content on AI alignment $39K Robert Miles 2019-04 funds.effectivealtruism.org [Long-Term Future Fund] Producing video content on AI alignment xng_1vsce_ Not checked Participation in a 2-weeks summer school on science diplomacy to advane my profile in the science-policy interface $1.6K Fabio Haenel 2021-07 funds.effectivealtruism.org [Long-Term Future Fund] Participation in a 2-weeks summer school on science diplomacy to advane my profile in the science-policy interface xng_1vsce_ Not checked Research project through the Legal Priorities Project, to understand and advise legal practitioners on the long-term challenges of AI in the judiciary $24K Nick Hollman 2020-10 funds.effectivealtruism.org [Long-Term Future Fund] Research project through the Legal Priorities Project, to understand and advise legal practitioners on the long-term challenges of AI in the judiciary xng_1vsce_ Not checked Open Online Course on “The Economics of AI” for Anton Korinek $72K University of Virginia Organization University of Virginia University in Charlottesville. Home to Anton Korinek (AI economics). 2021-01 funds.effectivealtruism.org [Long-Term Future Fund] Open Online Course on “The Economics of AI” for Anton Korinek xng_1vsce_ Not checked Organizing a workshop aimed at highlighting recent successes in the development of verified software. $5K Gopal Sarma 2020-01 funds.effectivealtruism.org [Long-Term Future Fund] Organizing a workshop aimed at highlighting recent successes in the development of verified software. xng_1vsce_ Not checked Hiring staff to carry out longtermist academic legal research and increase the operational capacity of the organization. $135K Legal Priorities Project Organization Legal Priorities Project Research organization studying legal questions relevant to reducing existential and catastrophic risks. 2021-01 funds.effectivealtruism.org [Long-Term Future Fund] Hiring staff to carry out longtermist academic legal research and increase the operational capacity of the organization. xng_1vsce_ Not checked 4-month salary for a research assistant to help with a surrogate outcomes project on estimating long-term effects $12K David Rhys Bernard 2021-10 funds.effectivealtruism.org [Long-Term Future Fund] 4-month salary for a research assistant to help with a surrogate outcomes project on estimating long-term effects xng_1vsce_ Not checked A study of safe exploration and robustness to distributional shift in biological complex systems $30K Nikhil Kunapuli 2019-04 funds.effectivealtruism.org [Long-Term Future Fund] A study of safe exploration and robustness to distributional shift in biological complex systems xng_1vsce_ Not checked Conducting independent research into AI forecasting and strategy questions $40K Tegan McCaslin 2019-10 funds.effectivealtruism.org [Long-Term Future Fund] Conducting independent research into AI forecasting and strategy questions xng_1vsce_ Not checked Conducting independent research on cause prioritization $33K Michael Dickens 2020-01 funds.effectivealtruism.org [Long-Term Future Fund] Conducting independent research on cause prioritization xng_1vsce_ Not checked Building towards a "Limited Agent Foundations" thesis on mild optimization and corrigibility $30K Alex Turner 2019-04 funds.effectivealtruism.org [Long-Term Future Fund] Building towards a "Limited Agent Foundations" thesis on mild optimization and corrigibility xng_1vsce_ Not checked 6 month salary for JJ to continue providing 1on1 support to early AI safety researchers and transition AISS $25K AI Safety Support Organization AI Safety Support Organization providing career guidance, mentoring, and community support for people transitioning into AI safety careers. 2021-07 funds.effectivealtruism.org [Long-Term Future Fund] 6 month salary for JJ to continue providing 1on1 support to early AI safety researchers and transition AISS xng_1vsce_ Not checked DPhil project in AI that addresses safety concerns in ML algorithms and positions Kai to work on China-West AI relations $78K University of Oxford, Department of Experimental Psychology 2021-10 funds.effectivealtruism.org [Long-Term Future Fund] DPhil project in AI that addresses safety concerns in ML algorithms and positions Kai to work on China-West AI relations xng_1vsce_ Not checked Build a theory of abstraction for embedded agency using real-world systems for a tight feedback loop $30K John Wentworth Person John Wentworth Independent alignment researcher. Known for work on natural abstractions and agent foundations. Previously associated with MIRI. 2019-10 funds.effectivealtruism.org [Long-Term Future Fund] Build a theory of abstraction for embedded agency using real-world systems for a tight feedback loop xng_1vsce_ Not checked Surveying the neglectedness of broad-spectrum antiviral development $18K Jaspreet Pannu (Jassi) 2019-10 funds.effectivealtruism.org [Long-Term Future Fund] Surveying the neglectedness of broad-spectrum antiviral development xng_1vsce_ Not checked Create a toolkit that enables researchers to bootstrap from zero to competence in ambiguous fields, beginning with a review of individual books $19K Elizabeth Van Nostrand Person Elizabeth Van Nostrand Consultant who worked with QURI (2019-2020) on evaluation-related posts and the Amplifying Generalist Research experiment. Writes the Aceso Under Glass blog. 2019-10 funds.effectivealtruism.org [Long-Term Future Fund] Create a toolkit that enables researchers to bootstrap from zero to competence in ambiguous fields, beginning with a review of individual books xng_1vsce_ Not checked 12-month salary for a software developer to create a library for Seldonian (safe and fair) machine learning algorithms $250K Berkeley Existential Risk Initiative Organization Berkeley Existential Risk Initiative Nonprofit supporting university-based existential risk research by providing operational and financial support. 2021-10 funds.effectivealtruism.org [Long-Term Future Fund] 12-month salary for a software developer to create a library for Seldonian (safe and fair) machine learning algorithms xng_1vsce_ Not checked Exploring crucial considerations for decision-making around information hazards $25K Will Bradshaw 2020-01 funds.effectivealtruism.org [Long-Term Future Fund] Exploring crucial considerations for decision-making around information hazards xng_1vsce_ Not checked Help InterACT when university systems cannot, supporting InterACT’s work enabling human-compatible robots and AI agents $135K Berkeley Existential Risk Initiative Organization Berkeley Existential Risk Initiative Nonprofit supporting university-based existential risk research by providing operational and financial support. 2022-01 funds.effectivealtruism.org [Long-Term Future Fund] Help InterACT when university systems cannot, supporting InterACT’s work enabling human-compatible robots and AI agents xng_1vsce_ Not checked Aiming to implement AI alignment concepts in real-world applications $10K Elicit (AI Research Tool) Organization Elicit (AI Research Tool) Elicit is an AI research assistant with 5M+ researchers that searches 138M papers and automates literature reviews, founded by AI alignment researchers from Ought and funded by Coefficient Giving (... Quality: 63/100 2018-10 funds.effectivealtruism.org [Long-Term Future Fund] Aiming to implement AI alignment concepts in real-world applications xng_1vsce_ Not checked Funding for building agents with causal models of the world and using those models for impact minimization. $10K Vincent Luczkow 2020-01 funds.effectivealtruism.org [Long-Term Future Fund] Funding for building agents with causal models of the world and using those models for impact minimization. xng_1vsce_ Not checked Upskilling in ML in order to be able to do productive AI safety research sooner than otherwise $10K Joar Skalse 2019-07 funds.effectivealtruism.org [Long-Term Future Fund] Upskilling in ML in order to be able to do productive AI safety research sooner than otherwise xng_1vsce_ Not checked Identifying and resolving tensions between competition law and long-term AI strategy $32K Shin-Shin Hua and Haydn Belfield 2020-01 funds.effectivealtruism.org [Long-Term Future Fund] Identifying and resolving tensions between competition law and long-term AI strategy xng_1vsce_ Not checked Stipends, work hours, and retreat costs for four extra students of CHERI’s summer research program $11K Effective Altruism Geneva Organization Effective Altruism Geneva Geneva-based chapter of the effective altruism movement. 2021-07 funds.effectivealtruism.org [Long-Term Future Fund] Stipends, work hours, and retreat costs for four extra students of CHERI’s summer research program xng_1vsce_ Not checked Supporting 3-month research period $7.9K Charlie Rogers-Smith 2020-07 funds.effectivealtruism.org [Long-Term Future Fund] Supporting 3-month research period xng_1vsce_ Not checked PhD in Computer Science working on AI-safety $250K Amon Elders 2021-01 funds.effectivealtruism.org [Long-Term Future Fund] PhD in Computer Science working on AI-safety xng_1vsce_ Not checked 4 month salary to upskill in biosecurity and explore possible career paths in biosecurity. $12K Finan Adamson 2021-10 funds.effectivealtruism.org [Long-Term Future Fund] 4 month salary to upskill in biosecurity and explore possible career paths in biosecurity. xng_1vsce_ Not checked New way to fight pandemics: 1-3 months of salaries for app R&D and communications in pilots and to mass public $100K Expii, Inc. 2021-01 funds.effectivealtruism.org [Long-Term Future Fund] New way to fight pandemics: 1-3 months of salaries for app R&D and communications in pilots and to mass public xng_1vsce_ Not checked 3-month funding for part-time research into US ability to maintain food supply in an extreme pandemic $3.1K Adin Richards 2022-01 funds.effectivealtruism.org [Long-Term Future Fund] 3-month funding for part-time research into US ability to maintain food supply in an extreme pandemic xng_1vsce_ Not checked Grant to cover fees for a master's program in machine learning $28K Andrei Alexandru 2021-10 funds.effectivealtruism.org [Long-Term Future Fund] Grant to cover fees for a master's program in machine learning xng_1vsce_ Not checked Funding to trade money for saving the time or increasing the productivity of their employees (e.g. subsidizing electronics upgrades or childcare) $91K 80,000 Hours Organization 80,000 Hours 80,000 Hours is the largest EA career organization, reaching 10M+ readers and reporting 3,000+ significant career plan changes, with 80% of $10M+ funding from Coefficient Giving. Since 2016 they've... Quality: 45/100 2018-07 funds.effectivealtruism.org [Long-Term Future Fund] Funding to trade money for saving the time or increasing the productivity of their employees (e.g. subsidizing electronics upgrades or childcare) xng_1vsce_ Not checked Supporting Vanessa with her AI alignment research $100K Vanessa Kosoy 2020-10 funds.effectivealtruism.org [Long-Term Future Fund] Supporting Vanessa with her AI alignment research xng_1vsce_ Not checked Create a value learning benchmark with contextualized scenarios by leveraging a recent breakthrough in natural language processing $55K — 2020-01 funds.effectivealtruism.org [Long-Term Future Fund] Create a value learning benchmark with contextualized scenarios by leveraging a recent breakthrough in natural language processing xng_1vsce_ Not checked Building understanding of the structure of risks from AI to inform prioritization $80K David Manheim 2021-10 funds.effectivealtruism.org [Long-Term Future Fund] Building understanding of the structure of risks from AI to inform prioritization xng_1vsce_ Not checked Write a SF/F novel based on the EA community. $15K Timothy Underwood 2022-01 funds.effectivealtruism.org [Long-Term Future Fund] Write a SF/F novel based on the EA community. xng_1vsce_ Not checked Educational scholarship in AI safety $13K Paul Colognese 2022-01 funds.effectivealtruism.org [Long-Term Future Fund] Educational scholarship in AI safety xng_1vsce_ Not checked Scaling up scenario role-play for AI strategy research and training; improving the pipeline for new researchers $40K Shahar Avin 2019-01 funds.effectivealtruism.org [Long-Term Future Fund] Scaling up scenario role-play for AI strategy research and training; improving the pipeline for new researchers xng_1vsce_ Not checked Support to build a forecasting platform based on user-created play-money prediction markets $200K Stephen Grugett, James Grugett, Austin Chen 2022-01 funds.effectivealtruism.org [Long-Term Future Fund] Support to build a forecasting platform based on user-created play-money prediction markets xng_1vsce_ Not checked Summer research program on global catastrophic risks for Swiss (under)graduate students $34K Effective Altruism Geneva Organization Effective Altruism Geneva Geneva-based chapter of the effective altruism movement. 2021-01 funds.effectivealtruism.org [Long-Term Future Fund] Summer research program on global catastrophic risks for Swiss (under)graduate students xng_1vsce_ Not checked Building infrastructure to give existential risk researchers superforecasting ability with minimal overhead $27K Jacob Lagerros Person Jacob Lagerros Board Member of QURI. Has worked on forecasting initiatives and at the Future of Humanity Institute. Subsequently worked at LessWrong. 2019-04 funds.effectivealtruism.org [Long-Term Future Fund] Building infrastructure to give existential risk researchers superforecasting ability with minimal overhead xng_1vsce_ Not checked Strategic research and studying programming $30K Eli Tyre 2019-04 funds.effectivealtruism.org [Long-Term Future Fund] Strategic research and studying programming xng_1vsce_ Not checked Free health coaching to optimize the health and wellbeing, and thus capacity/productivity, of those working on AI safety $80K AI Safety Support Organization AI Safety Support Organization providing career guidance, mentoring, and community support for people transitioning into AI safety careers. 2022-01 funds.effectivealtruism.org [Long-Term Future Fund] Free health coaching to optimize the health and wellbeing, and thus capacity/productivity, of those working on AI safety xng_1vsce_ Not checked 1.5-month salary to write a paper/blog post on cognitive and evolutionary insights for AI alignment $2.5K Marc-Everin Carauleanu 2021-01 funds.effectivealtruism.org [Long-Term Future Fund] 1.5-month salary to write a paper/blog post on cognitive and evolutionary insights for AI alignment xng_1vsce_ Not checked 4-month salary to research empirical and theoretical extensions of Cohen & Hutter’s pessimistic/conservative RL agent $3.3K David Reber 2021-01 funds.effectivealtruism.org [Long-Term Future Fund] 4-month salary to research empirical and theoretical extensions of Cohen & Hutter’s pessimistic/conservative RL agent xng_1vsce_ Not checked 7-month salary & tuition to fund the first part of a DPhil at Oxford in modelling viral pandemics $18K Toby Bonvoisin 2021-01 funds.effectivealtruism.org [Long-Term Future Fund] 7-month salary & tuition to fund the first part of a DPhil at Oxford in modelling viral pandemics xng_1vsce_ Not checked Performing independent research on modern institutional incentive failures and their dependencies and vital factors for aligned institutional design in collaboration with John Salvatier $20K Connor Flexman 2019-04 funds.effectivealtruism.org [Long-Term Future Fund] Performing independent research on modern institutional incentive failures and their dependencies and vital factors for aligned institutional design in collaboration with John Salvatier xng_1vsce_ Not checked Investigate humans’ lack of robust task alignment in amplification, and the implications for acceptability predicates $35K Joe Collman 2021-07 funds.effectivealtruism.org [Long-Term Future Fund] Investigate humans’ lack of robust task alignment in amplification, and the implications for acceptability predicates xng_1vsce_ Not checked Researching plans to allow humanity to meet nutritional needs after a nuclear war that limits conventional agriculture $3.6K Alliance to Feed the Earth in Disasters Organization Alliance to Feed the Earth in Disasters Research organization focused on food supply resilience during global catastrophic events. 2021-07 funds.effectivealtruism.org [Long-Term Future Fund] Researching plans to allow humanity to meet nutritional needs after a nuclear war that limits conventional agriculture xng_1vsce_ Not checked Replacing reduction in income due to moving from full- to part-time work in order to pursue an AI safety-related PhD $100K Aryeh Englander 2021-10 funds.effectivealtruism.org [Long-Term Future Fund] Replacing reduction in income due to moving from full- to part-time work in order to pursue an AI safety-related PhD xng_1vsce_ Not checked Independent research on forecasting and optimal paths to improve the long-term - LTF fund $41K — 2020-10 funds.effectivealtruism.org [Long-Term Future Fund] Independent research on forecasting and optimal paths to improve the long-term - LTF fund xng_1vsce_ Not checked Payment for AI researchers when I interview / survey them about their perceptions of safety $9.9K Vael Gates 2022-01 funds.effectivealtruism.org [Long-Term Future Fund] Payment for AI researchers when I interview / survey them about their perceptions of safety xng_1vsce_ Not checked Cataloging the History of U.S. High-Consequence Pathogen Regulations, Evaluating Their Performance, and Charting a Way Forward $35K Michael Parker 2022-01 funds.effectivealtruism.org [Long-Term Future Fund] Cataloging the History of U.S. High-Consequence Pathogen Regulations, Evaluating Their Performance, and Charting a Way Forward xng_1vsce_ Not checked Unrestricted donation $150K Center for Applied Rationality Organization Center for Applied Rationality Berkeley nonprofit founded 2012 teaching applied rationality through workshops ($3,900 for 4.5 days), trained 1,300+ alumni reporting 9.2/10 satisfaction and 0.17σ life satisfaction increase at 1-y... Quality: 62/100 2019-04 funds.effectivealtruism.org [Long-Term Future Fund] Unrestricted donation xng_1vsce_ Not checked Funding to trade money for saving the time or increasing the productivity of their employees (e.g. subsidizing electronics upgrades or childcare) $489K — 2018-07 funds.effectivealtruism.org [Long-Term Future Fund] Funding to trade money for saving the time or increasing the productivity of their employees (e.g. subsidizing electronics upgrades or childcare) xng_1vsce_ Not checked researching methods to continuously monitor and analyse artificial agents for the purpose of control. $45K Lee Sharkey 2020-10 funds.effectivealtruism.org [Long-Term Future Fund] researching methods to continuously monitor and analyse artificial agents for the purpose of control. xng_1vsce_ Not checked Identifying white space opportunities for technical projects to improve biosecurity and pandemic preparedness $30K Kyle Fish 2019-10 funds.effectivealtruism.org [Long-Term Future Fund] Identifying white space opportunities for technical projects to improve biosecurity and pandemic preparedness xng_1vsce_ Not checked 2-year funding to run public and expert surveys on AI governance and forecasting $232K Noemi Dreksler 2021-10 funds.effectivealtruism.org [Long-Term Future Fund] 2-year funding to run public and expert surveys on AI governance and forecasting xng_1vsce_ Not checked Persuasion Tournament for Existential Risk $200K Philip Tetlock, Ezra Karger, Pavel Atanasov 2021-07 funds.effectivealtruism.org [Long-Term Future Fund] Persuasion Tournament for Existential Risk xng_1vsce_ Not checked Support to work towards developing an early-warning system for future biological risks $9K Michael McLaren 2022-01 funds.effectivealtruism.org [Long-Term Future Fund] Support to work towards developing an early-warning system for future biological risks xng_1vsce_ Not checked Develop a research project on how to infer human's internal mental models from their behaviour using cognitive science modeling $7.7K Sofia Jativa Vega 2020-01 funds.effectivealtruism.org [Long-Term Future Fund] Develop a research project on how to infer human's internal mental models from their behaviour using cognitive science modeling xng_1vsce_ Not checked Testing how the accuracy of impact forecasting varies with the timeframe of prediction. $55K David Rhys Bernard 2020-10 funds.effectivealtruism.org [Long-Term Future Fund] Testing how the accuracy of impact forecasting varies with the timeframe of prediction. xng_1vsce_ Not checked Surveying experts on AI risk scenarios and working on other projects related to AI safety. $5K Alexis Carlier 2020-07 funds.effectivealtruism.org [Long-Term Future Fund] Surveying experts on AI risk scenarios and working on other projects related to AI safety. xng_1vsce_ Not checked Funds for a 6-month project contributing to the clarification of goal-directedness $22K Morgan Rogers 2022-01 funds.effectivealtruism.org [Long-Term Future Fund] Funds for a 6-month project contributing to the clarification of goal-directedness xng_1vsce_ Not checked Two-year funding for a top-tier PhD in public policy in Europe with a focus on promoting AI safety $122K Caroline Jeanmaire Person Caroline Jeanmaire AI governance researcher at UC Berkeley Center for Human-Compatible AI (CHAI). Foresight Fellow (2020). 2021-01 funds.effectivealtruism.org [Long-Term Future Fund] Two-year funding for a top-tier PhD in public policy in Europe with a focus on promoting AI safety xng_1vsce_ Not checked Funding to cover a visit to Boston for biosecurity work $16K Will Bradshaw 2021-10 funds.effectivealtruism.org [Long-Term Future Fund] Funding to cover a visit to Boston for biosecurity work xng_1vsce_ Not checked Retroactive funding for running an alignment theory mentorship program with Evan Hubinger $3.6K Oliver Zhang Person Oliver Zhang Co-founder and Managing Director of the Center for AI Safety (CAIS). Co-founded CAIS in 2022 alongside Dan Hendrycks. Also co-founded ML Alignment Theory Scholars (MATS). Oversees organizational op... 2022-01 funds.effectivealtruism.org [Long-Term Future Fund] Retroactive funding for running an alignment theory mentorship program with Evan Hubinger xng_1vsce_ Not checked Funding to trade money for saving the time or increasing the productivity of their employees (e.g. subsidizing electronics upgrades or childcare) $174K Center for Applied Rationality Organization Center for Applied Rationality Berkeley nonprofit founded 2012 teaching applied rationality through workshops ($3,900 for 4.5 days), trained 1,300+ alumni reporting 9.2/10 satisfaction and 0.17σ life satisfaction increase at 1-y... Quality: 62/100 2018-07 funds.effectivealtruism.org [Long-Term Future Fund] Funding to trade money for saving the time or increasing the productivity of their employees (e.g. subsidizing electronics upgrades or childcare) xng_1vsce_ Not checked Supporting aspiring researchers of AI alignment to boost themselves into productivity $25K Johannes Heidecke 2019-04 funds.effectivealtruism.org [Long-Term Future Fund] Supporting aspiring researchers of AI alignment to boost themselves into productivity xng_1vsce_ Not checked Human Progress for Beginners children's book $25K Jason Crawford 2019-10 funds.effectivealtruism.org [Long-Term Future Fund] Human Progress for Beginners children's book xng_1vsce_ Not checked Replacement salary for teaching during economics Ph.D., freeing time for conduct research into forecasting and pandemics $42K Joel Becker 2021-01 funds.effectivealtruism.org [Long-Term Future Fund] Replacement salary for teaching during economics Ph.D., freeing time for conduct research into forecasting and pandemics xng_1vsce_ Not checked Research to enable transition to AI Safety $43K Vojtěch Kovařík 2019-10 funds.effectivealtruism.org [Long-Term Future Fund] Research to enable transition to AI Safety xng_1vsce_ Not checked Formalizing the side effect avoidance problem research $30K Alex Turner 2020-01 funds.effectivealtruism.org [Long-Term Future Fund] Formalizing the side effect avoidance problem research xng_1vsce_ Not checked Productivity coaching for effective altruists to increase their impact $23K Lynette Bye 2019-07 funds.effectivealtruism.org [Long-Term Future Fund] Productivity coaching for effective altruists to increase their impact xng_1vsce_ Not checked 50% of 9-month salary for bioinformatician at BugSeq to democratize analysis of nanopore metagenomic sequencing data $38K BugSeq Bioinformatics Inc. 2021-01 funds.effectivealtruism.org [Long-Term Future Fund] 50% of 9-month salary for bioinformatician at BugSeq to democratize analysis of nanopore metagenomic sequencing data xng_1vsce_ Not checked 6-week grant (July 15-August 31, 2021) for full-time research on existential risks associated with running simulations $3.5K Rutgers University, Department of Philosophy 2021-07 funds.effectivealtruism.org [Long-Term Future Fund] 6-week grant (July 15-August 31, 2021) for full-time research on existential risks associated with running simulations xng_1vsce_ Not checked Support for self-study in data science and forecasting, to upskill within a GCBR research career $2.2K Benjamin Stewart 2021-10 funds.effectivealtruism.org [Long-Term Future Fund] Support for self-study in data science and forecasting, to upskill within a GCBR research career xng_1vsce_ Not checked Create AI safety videos, and offer communication and media support to AI safety orgs. $60K Robert Miles 2020-07 funds.effectivealtruism.org [Long-Term Future Fund] Create AI safety videos, and offer communication and media support to AI safety orgs. xng_1vsce_ Not checked We’re unleashing the problem-solving potential of our democracy with a simple electoral reform, approval voting. $50K The Center for Election Science Organization The Center for Election Science Nonprofit advancing approval voting and other voting method reforms. Funded by SFF and Open Philanthropy. 2021-10 funds.effectivealtruism.org [Long-Term Future Fund] We’re unleashing the problem-solving potential of our democracy with a simple electoral reform, approval voting. xng_1vsce_ Not checked Developing algorithms, environments and tests for AI safety via debate. $25K Joe Collman 2020-07 funds.effectivealtruism.org [Long-Term Future Fund] Developing algorithms, environments and tests for AI safety via debate. xng_1vsce_ Not checked 2-month costs of setting up a research company in AI alignment, including buying out the time of the two co-founders $34K Aligned AI 2022-01 funds.effectivealtruism.org [Long-Term Future Fund] 2-month costs of setting up a research company in AI alignment, including buying out the time of the two co-founders xng_1vsce_ Not checked Writing fiction to convey EA and rationality-related topics $20K Miranda Dixon-Luinenburg 2019-07 funds.effectivealtruism.org [Long-Term Future Fund] Writing fiction to convey EA and rationality-related topics xng_1vsce_ Not checked Research on the links between short- and long-term AI policy while skilling up in technical ML $75K Jess Whittlestone 2019-07 funds.effectivealtruism.org [Long-Term Future Fund] Research on the links between short- and long-term AI policy while skilling up in technical ML xng_1vsce_ Not checked 3-month compensation to drive time sensitive policy paper: "Managing the Transition to Universal Genomic Surveillance" $5K Chelsea Liang 2021-10 funds.effectivealtruism.org [Long-Term Future Fund] 3-month compensation to drive time sensitive policy paper: "Managing the Transition to Universal Genomic Surveillance" xng_1vsce_ Not checked Funding for full-time, independent research on agent foundations $30K Daniel Demski 2019-10 funds.effectivealtruism.org [Long-Term Future Fund] Funding for full-time, independent research on agent foundations xng_1vsce_ Not checked PhD in machine learning with a focus on AI alignment $86K Dmitrii Krasheninnikov 2021-07 funds.effectivealtruism.org [Long-Term Future Fund] PhD in machine learning with a focus on AI alignment xng_1vsce_ Not checked Buying out one year of my academic teaching so that I can spend time on AI alignment research instead $12K David Udell 2022-01 funds.effectivealtruism.org [Long-Term Future Fund] Buying out one year of my academic teaching so that I can spend time on AI alignment research instead xng_1vsce_ Not checked Funding to promote rationality and AI safety to medallists of IMO 2020 and EGMO 2019. $28K Mikhail Yagudin 2019-04 funds.effectivealtruism.org [Long-Term Future Fund] Funding to promote rationality and AI safety to medallists of IMO 2020 and EGMO 2019. xng_1vsce_ Not checked For Remmelt Ellen to run a virtual and physical camp where selected applicants prioritise AIS research & test their fit $85K Remmelt Ellen 2021-01 funds.effectivealtruism.org [Long-Term Future Fund] For Remmelt Ellen to run a virtual and physical camp where selected applicants prioritise AIS research & test their fit xng_1vsce_ Not checked Provides various forms of support to researchers working on existential risk issues (administrative, expert consultations, technical support) $15K Berkeley Existential Risk Initiative Organization Berkeley Existential Risk Initiative Nonprofit supporting university-based existential risk research by providing operational and financial support. 2017-01 funds.effectivealtruism.org [Long-Term Future Fund] Provides various forms of support to researchers working on existential risk issues (administrative, expert consultations, technical support) xng_1vsce_ Not checked Additional funding for AI strategy PhD at Oxford / FHI $37K Sören Mindermann 2019-07 funds.effectivealtruism.org [Long-Term Future Fund] Additional funding for AI strategy PhD at Oxford / FHI xng_1vsce_ Not checked 6-month salary to develop tools to test the natural abstractions hypothesis $35K John Wentworth Person John Wentworth Independent alignment researcher. Known for work on natural abstractions and agent foundations. Previously associated with MIRI. 2021-01 funds.effectivealtruism.org [Long-Term Future Fund] 6-month salary to develop tools to test the natural abstractions hypothesis xng_1vsce_ Not checked A biorisk summit for the Bay Area biotech industry, DIY biologists, and biosecurity researchers $26K Tessa Alexanian Person Tessa Alexanian Responsible biotechnology researcher and advocate. Foresight Fellow (2020). 2019-04 funds.effectivealtruism.org [Long-Term Future Fund] A biorisk summit for the Bay Area biotech industry, DIY biologists, and biosecurity researchers xng_1vsce_ Not checked Conducting independent research into AI forecasting and strategy questions $30K Tegan McCaslin 2019-04 funds.effectivealtruism.org [Long-Term Future Fund] Conducting independent research into AI forecasting and strategy questions xng_1vsce_ Not checked One year's salary for developing and sharing an investigative method to improve traction in pre-theoretic fields. $80K Logan Strohl 2021-01 funds.effectivealtruism.org [Long-Term Future Fund] One year's salary for developing and sharing an investigative method to improve traction in pre-theoretic fields. xng_1vsce_ Not checked Formalizing perceptual complexity with application to safe intelligence amplification $30K Anand Srinivasan 2019-04 funds.effectivealtruism.org [Long-Term Future Fund] Formalizing perceptual complexity with application to safe intelligence amplification xng_1vsce_ Not checked Three months of blogging and movement building at the intersection of EA/longtermism and progress studies $18K Nicholas (Nick) Whitaker 2021-10 funds.effectivealtruism.org [Long-Term Future Fund] Three months of blogging and movement building at the intersection of EA/longtermism and progress studies xng_1vsce_ Not checked Support multiple SPARC project operations during 2021 $15K SPARC 2021-01 funds.effectivealtruism.org [Long-Term Future Fund] Support multiple SPARC project operations during 2021 xng_1vsce_ Not checked Funding for research assistance in gathering data on the persistence, expansion, and reversal of laws over 5+ decades $11K Zach Freitas-Groff 2021-07 funds.effectivealtruism.org [Long-Term Future Fund] Funding for research assistance in gathering data on the persistence, expansion, and reversal of laws over 5+ decades xng_1vsce_ Not checked A two-day, career-focused workshop to inform and connect European EAs interested in AI governance $18K Alex Lintz 2019-01 funds.effectivealtruism.org [Long-Term Future Fund] A two-day, career-focused workshop to inform and connect European EAs interested in AI governance xng_1vsce_ Not checked To spend the next year leveling up various technical skills with the goal of becoming more impactful in AI safety $23K Stag Lynn 2019-07 funds.effectivealtruism.org [Long-Term Future Fund] To spend the next year leveling up various technical skills with the goal of becoming more impactful in AI safety xng_1vsce_ Not checked Funding towards a 2 year postdoctoral stint to work on Safety in AI, with a focus on developing value aligned systems $275K Kush Bhatia 2022-01 funds.effectivealtruism.org [Long-Term Future Fund] Funding towards a 2 year postdoctoral stint to work on Safety in AI, with a focus on developing value aligned systems xng_1vsce_ Not checked 10-month salary for research on AI safety/alignment, scaling laws, and potentially interpretability $19K Benedikt Hoeltgen 2021-10 funds.effectivealtruism.org [Long-Term Future Fund] 10-month salary for research on AI safety/alignment, scaling laws, and potentially interpretability xng_1vsce_ Not checked Increasing usefulness and availability of Metaculus, a fully-functional quantitative forecasting/prediction platform with >170,000 predictions and >1500 questions to date. $65K Anthony Aguirre Person Anthony Aguirre Physicist and AI safety advocate serving as Executive Director of the Future of Life Institute and President of the Future of Life Foundation. Faggin Presidential Professor for Physics of Informati... 2020-01 funds.effectivealtruism.org [Long-Term Future Fund] Increasing usefulness and availability of Metaculus, a fully-functional quantitative forecasting/prediction platform with >170,000 predictions and >1500 questions to date. xng_1vsce_ Not checked Multi-model approach to corporate and state actors relevant to existential risk mitigation $30K David Manheim 2019-07 funds.effectivealtruism.org [Long-Term Future Fund] Multi-model approach to corporate and state actors relevant to existential risk mitigation xng_1vsce_ Not checked 1-year salary for Adam Shimi to conduct independent research in AI Alignment $60K Adam Shimi 2021-01 funds.effectivealtruism.org [Long-Term Future Fund] 1-year salary for Adam Shimi to conduct independent research in AI Alignment xng_1vsce_ Not checked A research agenda rigorously connecting the internal and external views of value synthesis $30K David Girardo 2019-04 funds.effectivealtruism.org [Long-Term Future Fund] A research agenda rigorously connecting the internal and external views of value synthesis xng_1vsce_ Not checked BERI will support SERI when university systems are unable to help $60K Berkeley Existential Risk Initiative Organization Berkeley Existential Risk Initiative Nonprofit supporting university-based existential risk research by providing operational and financial support. 2021-01 funds.effectivealtruism.org [Long-Term Future Fund] BERI will support SERI when university systems are unable to help xng_1vsce_ Not checked Financial support for work on a biosecurity research project and workshop, and travel expenses $15K Simon Grimm 2022-01 funds.effectivealtruism.org [Long-Term Future Fund] Financial support for work on a biosecurity research project and workshop, and travel expenses xng_1vsce_ Not checked 3-12 month stipend for pursuing longtermist research and/or upskilling in things such as ML, the Chinese language, and cybersecurity $15K Caleb Withers 2022-01 funds.effectivealtruism.org [Long-Term Future Fund] 3-12 month stipend for pursuing longtermist research and/or upskilling in things such as ML, the Chinese language, and cybersecurity xng_1vsce_ Not checked Support to create language model (LM) tools to aid alignment research through feedback and content generation $40K Logan Smith 2022-01 funds.effectivealtruism.org [Long-Term Future Fund] Support to create language model (LM) tools to aid alignment research through feedback and content generation xng_1vsce_ Not checked Upskilling in contemporary AI techniques, deep RL, and AI safety, before pursuing a ML PhD $10K Orpheus Lummis 2019-04 funds.effectivealtruism.org [Long-Term Future Fund] Upskilling in contemporary AI techniques, deep RL, and AI safety, before pursuing a ML PhD xng_1vsce_ Not checked Longtermist lessons from COVID $5.6K Gavin Leech 2022-01 funds.effectivealtruism.org [Long-Term Future Fund] Longtermist lessons from COVID xng_1vsce_ Not checked Writing preliminary content for an encyclopedia of effective altruism $17K Pablo Stafforini 2020-01 funds.effectivealtruism.org [Long-Term Future Fund] Writing preliminary content for an encyclopedia of effective altruism xng_1vsce_ Not checked Understanding the Impact of Lifting Government Interventions against COVID-19 Transmission $9.8K Mrinank Sharma 2020-10 funds.effectivealtruism.org [Long-Term Future Fund] Understanding the Impact of Lifting Government Interventions against COVID-19 Transmission xng_1vsce_ Not checked Unrestricted donation $50K Elicit (AI Research Tool) Organization Elicit (AI Research Tool) Elicit is an AI research assistant with 5M+ researchers that searches 138M papers and automates literature reviews, founded by AI alignment researchers from Ought and funded by Coefficient Giving (... Quality: 63/100 2019-04 funds.effectivealtruism.org [Long-Term Future Fund] Unrestricted donation xng_1vsce_ Not checked An offline community hub for rationalists and EAs $50K Vyacheslav Matyuhin 2019-04 funds.effectivealtruism.org [Long-Term Future Fund] An offline community hub for rationalists and EAs xng_1vsce_ Not checked Upskilling investigation of AI Safety via debate and ML training $10K Joe Collman 2019-10 funds.effectivealtruism.org [Long-Term Future Fund] Upskilling investigation of AI Safety via debate and ML training xng_1vsce_ Not checked Computing resources and researcher salaries at a new deep learning + AI alignment research group at Cambridge $200K David Krueger Person David Krueger David Krueger is an assistant professor at the University of Cambridge working on AI alignment and safety. His research focuses on understanding and mitigating risks from advanced AI, including wor... 2021-01 funds.effectivealtruism.org [Long-Term Future Fund] Computing resources and researcher salaries at a new deep learning + AI alignment research group at Cambridge xng_1vsce_ Not checked Funding to pay participants to test a forecasting training program $3.2K Logan McNichols 2021-10 funds.effectivealtruism.org [Long-Term Future Fund] Funding to pay participants to test a forecasting training program xng_1vsce_ Not checked Building infrastructure for the future of effective forecasting efforts $70K Ozzie Gooen Person Ozzie Gooen Founder and Executive Director of QURI (Quantified Uncertainty Research Institute). Created Guesstimate (2016) and leads development of Squiggle, a probabilistic programming language for estimation... 2019-04 funds.effectivealtruism.org [Long-Term Future Fund] Building infrastructure for the future of effective forecasting efforts xng_1vsce_ Not checked Subsidized therapy/coaching/mediation for rationalists, EA, and startups that are working on things like x-risks. $40K Damon Pourtahmaseb-Sasi 2019-10 funds.effectivealtruism.org [Long-Term Future Fund] Subsidized therapy/coaching/mediation for rationalists, EA, and startups that are working on things like x-risks. xng_1vsce_ Not checked 8-month salary to work on technical AI safety research, working closely with a DPhil candidate at Oxford/FHI $28K James Bernardi 2021-07 funds.effectivealtruism.org [Long-Term Future Fund] 8-month salary to work on technical AI safety research, working closely with a DPhil candidate at Oxford/FHI xng_1vsce_ Not checked 6-month salary to work with Dan Hendrycks on research projects relevant to AI alignment $50K Thomas Woodside Person Thomas Woodside 2022-01 funds.effectivealtruism.org [Long-Term Future Fund] 6-month salary to work with Dan Hendrycks on research projects relevant to AI alignment xng_1vsce_ Not checked 12-month funding for personal career reorientation and helping individuals and organizations in the existential risk community orient towards and achieve their goals $20K Lauren Lee 2019-04 funds.effectivealtruism.org [Long-Term Future Fund] 12-month funding for personal career reorientation and helping individuals and organizations in the existential risk community orient towards and achieve their goals xng_1vsce_ Not checked Conducting postdoctoral research at Harvard on the psychology of EA/long-termism $50K Lucius Caviola 2019-04 funds.effectivealtruism.org [Long-Term Future Fund] Conducting postdoctoral research at Harvard on the psychology of EA/long-termism xng_1vsce_ Not checked 12-month salary to provide runway after finishing RSP $55K The Future of Humanity Institute 2021-01 funds.effectivealtruism.org [Long-Term Future Fund] 12-month salary to provide runway after finishing RSP xng_1vsce_ Not checked Educational Scholarship in AI Alignment $22K Jaeson Booker 2022-01 funds.effectivealtruism.org [Long-Term Future Fund] Educational Scholarship in AI Alignment xng_1vsce_ Not checked Fund 2 FTE of longtermism-focused researchers for 1 year to do policy/security, forecasting, & message testing research $70K Rethink Priorities Organization Rethink Priorities Rethink Priorities is a research organization founded in 2018 that grew from 2 to ~130 people by 2022, conducting evidence-based analysis across animal welfare, global health, and AI governance. Th... Quality: 60/100 2021-01 funds.effectivealtruism.org [Long-Term Future Fund] Fund 2 FTE of longtermism-focused researchers for 1 year to do policy/security, forecasting, & message testing research xng_1vsce_ Not checked Funding to trade money for saving the time or increasing the productivity of their employees (e.g. subsidizing electronics upgrades or childcare) $163K Centre for Effective Altruism Organization Centre for Effective Altruism Oxford-based organization that coordinates the effective altruism movement, running EA Global conferences, supporting local groups, and maintaining the EA Forum. Quality: 78/100 2018-07 funds.effectivealtruism.org [Long-Term Future Fund] Funding to trade money for saving the time or increasing the productivity of their employees (e.g. subsidizing electronics upgrades or childcare) xng_1vsce_ Not checked Ad campaign for "Optimal Policies Tend To Seek Power" to ML researchers on Twitter $1.1K Alex Turner 2022-01 funds.effectivealtruism.org [Long-Term Future Fund] Ad campaign for "Optimal Policies Tend To Seek Power" to ML researchers on Twitter xng_1vsce_ Not checked Unrestricted donation $50K — 2019-04 funds.effectivealtruism.org [Long-Term Future Fund] Unrestricted donation xng_1vsce_ Not checked Support David Reber -9.5 months of strategic outsourcing to read up on AI Safety and find mentors $20K David Reber 2021-10 funds.effectivealtruism.org [Long-Term Future Fund] Support David Reber -9.5 months of strategic outsourcing to read up on AI Safety and find mentors xng_1vsce_ Not checked 12-month salary for independent research, upskilling, and finding a stable position in AI-Safety $24K Robert Kralisch 2022-01 funds.effectivealtruism.org [Long-Term Future Fund] 12-month salary for independent research, upskilling, and finding a stable position in AI-Safety xng_1vsce_ Not checked A major expansion of the Metaculus prediction platform and its community $70K Anthony Aguirre Person Anthony Aguirre Physicist and AI safety advocate serving as Executive Director of the Future of Life Institute and President of the Future of Life Foundation. Faggin Presidential Professor for Physics of Informati... 2019-04 funds.effectivealtruism.org [Long-Term Future Fund] A major expansion of the Metaculus prediction platform and its community xng_1vsce_ Not checked Research project on the longevity and decay of universities, philanthropic foundations, and catholic orders $3.6K Maximilian Negele 2020-10 funds.effectivealtruism.org [Long-Term Future Fund] Research project on the longevity and decay of universities, philanthropic foundations, and catholic orders xng_1vsce_ Not checked Organising immersive workshops on meta skills and x-risk for STEM students at top universities. $33K Tamara Borine 2020-10 funds.effectivealtruism.org [Long-Term Future Fund] Organising immersive workshops on meta skills and x-risk for STEM students at top universities. xng_1vsce_ Not checked Support for alignment theory agenda evaluation $25K Jack Ryan 2022-07 funds.effectivealtruism.org [Long-Term Future Fund] Support for alignment theory agenda evaluation xng_1vsce_ Not checked AI safety dinners $10K Neil Crawford 2022-07 funds.effectivealtruism.org [Long-Term Future Fund] AI safety dinners xng_1vsce_ Not checked AI safety research $1.5K Lukas Berglund 2022-10 funds.effectivealtruism.org [Long-Term Future Fund] AI safety research xng_1vsce_ Not checked Compensation for a non-fiction book on threat of AGI for a general audience $50K Darren McKee 2022-07 funds.effectivealtruism.org [Long-Term Future Fund] Compensation for a non-fiction book on threat of AGI for a general audience xng_1vsce_ Not checked Funding to perform human evaluations for evaluating different machine learning methods for aligning language models $10K Robert Kirk 2022 funds.effectivealtruism.org [Long-Term Future Fund] Funding to perform human evaluations for evaluating different machine learning methods for aligning language models xng_1vsce_ Not checked Travel Support to BWC RevCon & Side Events $3.5K Theo Knopfer Person Theo Knopfer Researcher on emerging technology terrorism risk. Foresight Fellow (2023). 2022-10 funds.effectivealtruism.org [Long-Term Future Fund] Travel Support to BWC RevCon & Side Events xng_1vsce_ Not checked travel funding for participants in a workshop on the science of consciousness and current and near-term AI systems $11K Robert Long 2023-01 funds.effectivealtruism.org [Long-Term Future Fund] travel funding for participants in a workshop on the science of consciousness and current and near-term AI systems xng_1vsce_ Not checked Funding to host additional fellows for PIBBSS research fellowship (currently funded: 12 fellows; desired: 20 fellows) $100K Nora Ammann Person Nora Ammann Guaranteed Safe AI researcher at PIBBSS. Foresight Fellow (2024). 2023-01 funds.effectivealtruism.org [Long-Term Future Fund] Funding to host additional fellows for PIBBSS research fellowship (currently funded: 12 fellows; desired: 20 fellows) xng_1vsce_ Not checked Neural network interpretability research $13K Nicholas Greig 2022-07 funds.effectivealtruism.org [Long-Term Future Fund] Neural network interpretability research xng_1vsce_ Not checked Flight and accomodation costs to spend a month working with Will Bradshaw's team at the NAO $4.9K Jacob Mendel 2023-01 funds.effectivealtruism.org [Long-Term Future Fund] Flight and accomodation costs to spend a month working with Will Bradshaw's team at the NAO xng_1vsce_ Not checked 6 months of independent alignment research and upskilling $30K Zhengbo Xiang (Alana) 2022 funds.effectivealtruism.org [Long-Term Future Fund] 6 months of independent alignment research and upskilling xng_1vsce_ Not checked Research into the international viability of FHI's Windfall Clause $3K John Bridge 2022-07 funds.effectivealtruism.org [Long-Term Future Fund] Research into the international viability of FHI's Windfall Clause xng_1vsce_ Not checked 6-month salary for research into preventing steganography in interpretable representations using multiple agents $20K Hoagy Cunningham 2022-10 funds.effectivealtruism.org [Long-Term Future Fund] 6-month salary for research into preventing steganography in interpretable representations using multiple agents xng_1vsce_ Not checked Research on EA and longtermism $70K Aaron Bergman 2022-07 funds.effectivealtruism.org [Long-Term Future Fund] Research on EA and longtermism xng_1vsce_ Not checked 6-month salary to interpret neurons in language models & build tools to accelerate this process. The aim is to understand all features and circuits in a model and use this understanding to predict out of distribution performance in high-stake situations. $40K Logan Smith 2023-01 funds.effectivealtruism.org [Long-Term Future Fund] 6-month salary to interpret neurons in language models & build tools to accelerate this process. The aim is to understand all features and circuits in a model and use this understanding to predict out of distribution performance in high-stake situations. xng_1vsce_ Not checked 1-year stipend and compute for conducting a research project focused on AI safety via debate in the context of LLMs. $50K Paul Bricman 2022 funds.effectivealtruism.org [Long-Term Future Fund] 1-year stipend and compute for conducting a research project focused on AI safety via debate in the context of LLMs. xng_1vsce_ Not checked 6-month part-time (20h/week) salary to further develop and refine the feature visualization library Lucent $23K Tom Lieberum 2022-01 funds.effectivealtruism.org [Long-Term Future Fund] 6-month part-time (20h/week) salary to further develop and refine the feature visualization library Lucent xng_1vsce_ Not checked This grant will support Naoya Okamoto upskill in AI Safety research. Naoya will take the Mathematics of Machine Learning course offered by the University of Illinois at Urbana-Champaign. $7.5K Naoya Okamoto 2023-01 funds.effectivealtruism.org [Long-Term Future Fund] This grant will support Naoya Okamoto upskill in AI Safety research. Naoya will take the Mathematics of Machine Learning course offered by the University of Illinois at Urbana-Champaign. xng_1vsce_ Not checked Support to maintain a copy of the alignment research dataset etc in the Arctic World Archive for 5 years $3K David Staley 2023-01 funds.effectivealtruism.org [Long-Term Future Fund] Support to maintain a copy of the alignment research dataset etc in the Arctic World Archive for 5 years xng_1vsce_ Not checked Support for Marius Hobbhahn for piloting a program that approaches and nudges promising people to get into AI safety faster $50K Marius Hobbhahn 2022-07 funds.effectivealtruism.org [Long-Term Future Fund] Support for Marius Hobbhahn for piloting a program that approaches and nudges promising people to get into AI safety faster xng_1vsce_ Not checked 12-month salary to study and get into AI Safety Research and work on related EA projects $14K Luca De Leo 2022-10 funds.effectivealtruism.org [Long-Term Future Fund] 12-month salary to study and get into AI Safety Research and work on related EA projects xng_1vsce_ Not checked 4 month salary to support an early-career alignment researcher, who is taking a year to pursue research and test fit $20K Max Kaufmann 2022 funds.effectivealtruism.org [Long-Term Future Fund] 4 month salary to support an early-career alignment researcher, who is taking a year to pursue research and test fit xng_1vsce_ Not checked Exploratory grant for preliminary research into the civilizational dangers of a contemporary nuclear strike $5K Isabel Johnson 2022-07 funds.effectivealtruism.org [Long-Term Future Fund] Exploratory grant for preliminary research into the civilizational dangers of a contemporary nuclear strike xng_1vsce_ Not checked 6 months funding for supervised research on the probability of humanity becoming interstellar given non-existential catastrophe $36K Sasha Cooper 2022-07 funds.effectivealtruism.org [Long-Term Future Fund] 6 months funding for supervised research on the probability of humanity becoming interstellar given non-existential catastrophe xng_1vsce_ Not checked 6-month salary for me to continue the SERI MATS project on expanding the "Discovering Latent Knowledge" paper $33K Jonathan Ng 2023-01 funds.effectivealtruism.org [Long-Term Future Fund] 6-month salary for me to continue the SERI MATS project on expanding the "Discovering Latent Knowledge" paper xng_1vsce_ Not checked Financial support to help productivity and increase time of early career alignment researcher $7K Max Kaufmann 2022-07 funds.effectivealtruism.org [Long-Term Future Fund] Financial support to help productivity and increase time of early career alignment researcher xng_1vsce_ Not checked 5-month part time salary for collaborating on a research paper analyzing the implications of compute access $2.5K Sage Bergerson 2022 funds.effectivealtruism.org [Long-Term Future Fund] 5-month part time salary for collaborating on a research paper analyzing the implications of compute access xng_1vsce_ Not checked Support for living expenses while doing PhD in AI safety - technical research and community building work $2.3K Francis Rhys Ward 2022 funds.effectivealtruism.org [Long-Term Future Fund] Support for living expenses while doing PhD in AI safety - technical research and community building work xng_1vsce_ Not checked 6-month salary for self-study to be more effective at AI alignment research $15K Thomas Kehrenberg 2022-07 funds.effectivealtruism.org [Long-Term Future Fund] 6-month salary for self-study to be more effective at AI alignment research xng_1vsce_ Not checked The Alignable Structures workshop in Philadelphia $9K Quinn Dougherty Person Quinn Dougherty Software Engineer who worked at QURI (2021-2022). Focused on epistemic public goods with involvement in AGI alignment and community-building projects. 2022-10 funds.effectivealtruism.org [Long-Term Future Fund] The Alignable Structures workshop in Philadelphia xng_1vsce_ Not checked New laptop for technical AI safety research $4.1K Peter Barnett 2022-07 funds.effectivealtruism.org [Long-Term Future Fund] New laptop for technical AI safety research xng_1vsce_ Not checked 10-month funding to study ML at university and AIS independently $500 Patricio Vercesi 2023-01 funds.effectivealtruism.org [Long-Term Future Fund] 10-month funding to study ML at university and AIS independently xng_1vsce_ Not checked 6 month salary to improve the US regulatory environment for prediction markets $138K Solomon Sia 2022-07 funds.effectivealtruism.org [Long-Term Future Fund] 6 month salary to improve the US regulatory environment for prediction markets xng_1vsce_ Not checked Develop and market video game to explain the Stop Button Problem to the public & STEM individuals $100K Lone Pine Games, LLC 2022-07 funds.effectivealtruism.org [Long-Term Future Fund] Develop and market video game to explain the Stop Button Problem to the public & STEM individuals xng_1vsce_ Not checked A 2-day workshop to connect alignment researchers from the US, UK, and AI researchers and entrepreneurs from Japan $73K — 2022 funds.effectivealtruism.org [Long-Term Future Fund] A 2-day workshop to connect alignment researchers from the US, UK, and AI researchers and entrepreneurs from Japan xng_1vsce_ Not checked Paid internships for promising Oxford students to try out supervised AI Safety research projects $60K AI Safety Hub Ltd 2022-07 funds.effectivealtruism.org [Long-Term Future Fund] Paid internships for promising Oxford students to try out supervised AI Safety research projects xng_1vsce_ Not checked Starting funds and moving costs for a DPhil project in AI that addresses safety concerns in ML algorithms and positions $4K Kai Sandbrink 2022-07 funds.effectivealtruism.org [Long-Term Future Fund] Starting funds and moving costs for a DPhil project in AI that addresses safety concerns in ML algorithms and positions xng_1vsce_ Not checked Funds to cover speaker fees and event costs for EA community building tied in with my MA course on longtermism in 2022 $23K William D'Alessandro 2022-01 funds.effectivealtruism.org [Long-Term Future Fund] Funds to cover speaker fees and event costs for EA community building tied in with my MA course on longtermism in 2022 xng_1vsce_ Not checked Website visualizing x-risk as a tree of branching futures per Metaculus predictions: EA counterpoint to Doomsday Clock $3.5K Conor Barnes 2022-07 funds.effectivealtruism.org [Long-Term Future Fund] Website visualizing x-risk as a tree of branching futures per Metaculus predictions: EA counterpoint to Doomsday Clock xng_1vsce_ Not checked 2 months of part-time salary for a trial + developer costs to maintain and improve the AI governance document sharing hu $15K Max Räuker 2022 funds.effectivealtruism.org [Long-Term Future Fund] 2 months of part-time salary for a trial + developer costs to maintain and improve the AI governance document sharing hu xng_1vsce_ Not checked Organize the third Human-Aligned AI Summer School, a 4-day summer school for 150 participants in Prague, summer 2022 $110K Czech Association for Effective Altruism Organization Czech Association for Effective Altruism Czech chapter of the effective altruism movement (CZEA). 2022-07 funds.effectivealtruism.org [Long-Term Future Fund] Organize the third Human-Aligned AI Summer School, a 4-day summer school for 150 participants in Prague, summer 2022 xng_1vsce_ Not checked 8 weeks scholars program to pair promising alignment researchers with renowned mentors $316K AI Safety Support Organization AI Safety Support Organization providing career guidance, mentoring, and community support for people transitioning into AI safety careers. 2022-10 funds.effectivealtruism.org [Long-Term Future Fund] 8 weeks scholars program to pair promising alignment researchers with renowned mentors xng_1vsce_ Not checked Stanford Artificial Intelligence Professional Program tution $4.8K Mario Peng Lee 2022-07 funds.effectivealtruism.org [Long-Term Future Fund] Stanford Artificial Intelligence Professional Program tution xng_1vsce_ Not checked (professional development grant) New laptop for technical AI safety research $2.5K Max Lamparth 2022 funds.effectivealtruism.org [Long-Term Future Fund] (professional development grant) New laptop for technical AI safety research xng_1vsce_ Not checked