Trustees of Boston University — LLM Research Benchmark

[Navigating Transformative AI] Open Philanthropy recommended a grant of $756,396 over two years to Boston University to support a project evaluating the abilities of large language models (LLMs) at performing academic machine learning research, led by Professor Najoung Kim and Professor Sebastian Schuster.  This grant was funded via a request for proposals for projects benchmarking LLM agents on consequential real-world tasks and falls within our focus area of potential risks from advanced artificial intelligence.