ARENA 5.0 Impact Report

x This website requires javascript to properly function. Consider activating javascript to get access to all site functionality. ARENA 5.0 Impact Report — LessWrong AI Frontpage 25

 ARENA 5.0 Impact Report 

 by JScriven , JamesH , James Fox 11th Aug 2025 24 min read 0 25

 The impact report from ARENA’s prior iteration, ARENA 4.0, is available here. 

 Summary: 

 The purpose of this report is to evaluate ARENA 5.0’s impact according to ARENA’s four success criteria:

 Source high-quality participants; 
 Upskill these talented participants in ML skills for AI safety work; 
 Integrate participants with the existing AI safety community; 
 Accelerate participants’ career transition into AI safety. 
 Overall, this iteration of ARENA was highly successful according to our success criteria. We are delighted that our 28 in-person programme participants rated their overall enjoyment of the ARENA programme at 9.3/10 , representing our highest satisfaction score to date.

 Criterion 1:  Our participants were of a strong calibre, coming from diverse backgrounds and bringing a wealth of different expertise with them. Notably, 11 participants either held or were pursuing doctoral degrees in technical fields, and 5 had over one year’s professional experience as software engineers. Other participants came from diverse backgrounds including data science, forecasting, computer engineering and neuroscience. Compared to ARENA 4.0, this iteration included fewer software engineers and similar professionals but more participants holding or pursuing doctoral degrees. This was not a deliberate choice, but our selection process placed high value on those who could demonstrate substantial engagement with technical AI safety and safety-relevant topics, which may explain this shift in demographic.

 Criterion 2: Our in-person programme delivered substantial upskilling across all technical domains; when asked to rate out of 10 how satisfied they were that they had achieved their pre-programme goals, participants responded with an average of 8.8/10, with 9 out of 28 respondents responding with a 10/10 score. After the programme’s conclusion, participants were significantly more confident in mechanistic interpretability (improving from 3.4 to 6.1 on average), reinforcement learning (3.2 to 6.4 on average), and LLM evaluations (3.9 to 7.5 on average) – see Figure 1 for these statistics. Most impressively, participants’ confidence in specific LLM evaluation design tasks increased from 4.2/10 to 9.0/10 (Figure 18), demonstrating our curriculum’s effectiveness in developing practical AI safety skills.

 Our in-person taught programme lasts 4 weeks. On average, participants estimated their counterfactual time to learn the full ARENA content unsupervised would have been 9.3 weeks. Two participants felt the programme was too short; another two felt it was too long. The rest felt that the duration was ‘just right’.

 Criterion 3: Participants rated the value of being in the LISA env

... (truncated, 39 KB total)