Concept-Testing X-Risk Arguments
- Fellow:
- Wim Howson Creutzberg
Projects
Explore the projects our fellows work on with their mentors, cohort by cohort.
2022
Cooperative AI Leveraging Group Identity and Team Reasoning to Frame Cooperative Equilibria
- Fellow:
- Gianluca Pontonio
Data for IRL: What do we need to learn human values?
- Fellow:
- Jan Wehner
Design Considerations for AI Ethics Boards to Decrease Existential Risks
- Fellow:
- Anka Reuel
- Output:
- Read the output
Emergent in-context learning: hypotheses and experiments on the link between norm growth and induction heads
- Fellow:
- Pierre Peigné
How New Biotechnologies Can Strengthen the BWC
- Fellow:
- Theo Knopfer
Improving Institutional Decision-Making: Which Improvements?
- Fellow:
- Tao Burga Montoya
Incentive Compatibility Dilemma in Multi-Agent Inverse Reinforcement Learning
- Fellow:
- Guerdon Ligon
Investigating Inverse Scaling
- Fellow:
- Orfeas Ioannis Liossatos
Narrative Empathy and Moral Circle Expansion
- Fellow:
- Anna-Sofia Schaller
On the normative intuitions of Xi Jinping's political thought and what it implies for the future of humanity.
- Fellow:
- Maxime Ligeret
Optimal GCR mitigation through different decision frameworks.
- Fellow:
- Isaak Mengesha
Policy Advocacy Projects for AI Governance
- Fellow:
- Tobias Häberli
Proliferation and Catastrophic Risks from Generation IV Nuclear Reactors / SMRs
- Fellow:
- Joel Christoph
Psychology of AI Risk Perception
- Fellow:
- Daniel Friedrich
Saving Species
- Fellow:
- Jesper Magnusson
Socio-psychological Variables that Impact Decision-Making in Food-scarce Post-disaster Scenarios
- Fellow:
- Isla Gibson
Space settlement and the Existential Risk Landscape
- Fellow:
- Christopher Stewart Lankhof
The Central Challenge to Global Catastrophic Biological Risks: A Reconsideration of Epidemic Sovereignty
- Fellow:
- Hamza Tariq Chaudhry
The Macro-strategy of Space Expansion
- Fellow:
- Yannick Mühlhäuser
- Output:
- Read the output
Training Language Models with Natural Language Feedback
- Fellow:
- Kay Kozaronek
What are some ideal structures of AGI governance?
- Fellow:
- Yung-Hsuan Wu
Get involved
Join our team
Work with us directly to advance AI safety research. No roles are open at the moment. If you think you may be a good fit for the team, introduce yourself and we will reach out when something opens up.
Mentor top emerging researchers
Guide a fellow on a research project, share your expertise, and help them grow as a researcher. We handle recruitment, logistics, and day-to-day research support.
Participate in a fellowship
Join our in-person research fellowship in London and work with experienced mentors on AI safety, AI governance, AIxBio, or biodefense.