ARENA 4.0 Impact Report

x This website requires javascript to properly function. Consider activating javascript to get access to all site functionality. ARENA 4.0 Impact Report — LessWrong AI Alignment Fieldbuilding Postmortems & Retrospectives AI Frontpage 45

 ARENA 4.0 Impact Report 

 by Chloe Li , JamesH , James Fox 27th Nov 2024 15 min read 3 45

 If you're interested in helping to run the ARENA program, note that we're currently hiring for an Operations Lead! For more details, and to apply, see here . 

 Summary 

 The purpose of this report is to evaluate ARENA 4.0’s impact according to our four success criteria:

 Source high-quality participants
 Upskill these talented participants in ML skills for AI safety work
 Integrate participants with the existing AI safety community and legitimise AI safety as a compelling field to work in
 Accelerate participants’ career transition into AI safety
 Overall, this iteration of ARENA was successful according to our success criteria.

 We are happy that our 33  in-person programme participants rated their overall enjoyment of the ARENA programme at 9.1/10 .
 Criteria 1: Our participants were of high calibre, with ten having more than 4 years  of experience as software engineers at top companies and four having a PhD-level academic qualification or higher.
 Criteria 2: Our in-person programme lasts 4 weeks. The majority of participants felt they achieved the challenging concrete learning goals for each topic. Participants estimated the counterfactual time needed to learn the full ARENA content outside the programme as 10.2 weeks (even if they had access to ARENA’s material). We were particularly impressed with the capstone projects completed in the programme’s final week, two of which can be found here: capstone 1 , capstone 2 . We expect to see even more great work in the future!
 Criteria 3: Participants rated the value of being in the LISA  environment as 8.9/10 . The top cited “most valuable gain” from the programme was meeting talented and like-minded peers in the AI safety community, emphasising the importance of running the programme in person at an AI safety hub. We are also glad that many participants commented on now feeling confident to take on ML safety research projects independently.
 Criteria 4: Four participants had full-time AI safety roles at the end of the programme, and a further 24/33  participants planned to or were actively applying to AI safety roles at the end of the programme.
 The structure of the report is as follows:

 ARENA 4.0’s programme details 
 Method used for analysis 
 Criteria 1 - Source high-quality participants 
 Criteria 2 - Upskilling 
 Criteria 3 - Integration 
 Criteria 4 - Career Acceleration 
 Overall Programme Experience 
 Improvements for ARENA’s future in-person programmes 
 Programme Information 

 First, we outline when this programme occurred, what topics were covered, and the main changes made to the programme in contrast to previous iterations. For more informa

... (truncated, 28 KB total)