- Ongoing
- AI Governance
A benchmark for AI agent compliance with US sanctions law
A benchmark evaluating whether AI agents comply with US sanctions law.
- Fellow:
- Arjun Sharma
- Mentor:
- Kevin Wei
AI might be the most consequential technology humanity builds. Whether it goes well depends in large part on how many talented people are working seriously on making it go well. The fellowship exists to grow that group.
Weekly 1-on-1s with established researchers providing methodological expertise, critical feedback, and strategic direction.
Pivotal's dedicated research managers help you scope projects, stay on track, navigate blockers, and plan your career.
In-person co-working at the London Initiative for Safe AI. Lunch and dinner included weekdays.
£15k–£18k stipend. Plus travel to London, £1,800/month housing for fellows based outside of London, and the compute you need for your research to succeed.
Q&A sessions with leading domain experts and hands-on workshops to sharpen your thinking and expand your network.
A focused, full-time programme with sustained support to take your research from a promising idea to meaningful progress.
GovAI, SaferAI, UK AISI, IAPS, AI Futures Project, Anthropic Fellowship, Timaeus, Google DeepMind, Cooperative AI Foundation, Beneficial AI Foundation, FLI, the Institute for Progress, among others.
PRISM Evals, Catalyze Impact, Moirai, and Principia. More to come, stay tuned.
University of Oxford, Stanford University, EPFL, Max Planck Institute, among others.
In top academic venues and policy forums.
“Pivotal helped me grow my professional network and launch my career in AI governance.”
“The fellowship allowed me to work with top AI safety researchers — a great privilege early in my career. People were surprised what can be accomplished in two months, including me.”
“I'm more bullish on starting projects or a startup compared to research since starting at Pivotal. [I am also] more confident now that AI governance is the most important thing.”
“I thought I would like it and it would be good for my career, but I actually liked it more than I thought and think it was better for my career than I thought.”
“I think the Pivotal research fellowship accelerated my AI safety career by 15 months in expectation.”
“The fellowship sharpened my thinking on AI security and helped me figure out where I can have the most impact in AI policy.”
“Tremendously educational, inspirational, and fun. I'd highly recommend joining — it was one of the most enjoyable work environments of my life.”
“My first independent AI safety project since university. I was intimidated, but the team was supportive, and I surprised myself by how much I achieved.”

Senior Technology Fellow, Institute for Progress

Associate Professor, University of Warwick

Founder and Director, Allelo

Head of Policy & Strategy, Lucid Computing

Research Lead, Arcadia Impact

Researcher, Institute for AI Policy and Strategy

Director of Policy and Research, ALTER

Member of Technical Staff, Geodesic Research
A benchmark evaluating whether AI agents comply with US sanctions law.
Building a benchmark that probes whether and how models engage in "deal-making" — offering a potentially-scheming model something in exchange for revealing misalignment — with a focus on qualitatively analysing the model's reasoning about credibility, cheating and being evaluated.
Developing a framework to help AI-lab insiders judge whether and when to disclose high-impact information.
Designing a privacy-preserving side-channel monitor for AI compute — hardware-level monitoring that could help verify how chips are being used.
Designing and prototyping a simpler, smaller-attack-surface "cross-domain solution" for securely moving data — the kind of security-critical infrastructure needed to protect model weights against sophisticated state-level attackers under the SL5 standard.
Working toward a taxonomy for compositional interpretability and hierarchical concepts — top-down interpretability techniques aimed at pragmatic alignment goals.
You apply to work with as many mentors as you're excited about. Shortlisted candidates move on to the video interview, a work task, and a personal interview.
You, your interests, mentor preferences. · 1–2h
Short recorded interview. · <10m
Mentor-specific research exercise. · 1–3h
With the team or your mentors. · 30–45m
Anyone 18 or older. We've had fellows from ML, philosophy, policy, physics, biology. Your background matters less than motivation and ability.
If you're reading this, probably yes. Our fellowship is selective, but that alone shouldn't put you off. If your interests and background seem like a plausible fit, applying is often worth it.
You need to apply to at least one mentor. That said, there's often room to shape the project together with the guidance of your mentor.
A written application (~1–2 hours), then for shortlisted candidates: a short video interview, a mentor-specific work task, and a personal interview.
Senior Fellows have significant experience, such as a PhD, industry track record, or strong publications, and receive £18,000 instead of £15,000. The fellowship experience is otherwise the same.
It's an in-person programme in London. We make rare exceptions for people with a strong independent research track record. If you can't fully be in-person, apply either way and flag it in the form.
The fellowship is full-time. Small side commitments are usually fine and you can mention them in your application.
Some mentors have fellows work in teams, others work one-on-one. Either way, collaboration between fellows is common and encouraged.
Usually a research paper, but we're open to blog posts, policy briefs, or other formats if they suit the project. In any case, you retain ownership over your research.
No, Pivotal will not employ you, but we'll have a stipend agreement. Meeting entry requirements is your responsibility — we have an info doc on entry requirements and can sometimes help with the process.
We cover travel to and from London. If you don't already live here, you'll get £1,800/month towards accommodation on top of the stipend.
The field needs more good researchers working on AI safety and governance. The fellowship is the main way we try to make that happen.
Yes, have a look at Get involved on our About page, or just get in touch.