Merlin Stein
Loss of control risk modelling, UK AI Security Institute
Mentor:
Projects
Research Direction: Automating AI governance
Fellows will work with Merlin Stein and Kevin Wei to develop a practically useful dataset, benchmark, and deployable AI auditor. The project will focus on automating tasks in AI governance or closely related domains, such as biosecurity or cybersecurity.
Related reading: an example of work informing this project
What We're Looking for in a Mentee
We are looking for three fellows: one technical researcher and two domain experts working in the same domain.
- Technical researcher: experience implementing agentic systems and building benchmarks.
- Domain experts: extensive experience performing the tasks being automated, with the ability to assess output quality and write evaluation rubrics and task-specific skills.
Relevant domains include risk modelling, writing and reviewing system cards, government risk assessments, incident reports, and safety cases. Evidence of relevant expertise could include published analyses of risk scenarios.