Anthropic: Anthropic Fellows Program, AI Safety & Security
Headquarters: London, UK; Ontario, CAN; Remote-Friendly, United States; San Francisco, CA
Status: Applications are currently closed. We will update this page when they re-open.
About Anthropic
Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems.
Anthropic Fellows Program Overview
The Anthropic Fellows Program is designed to foster AI research and engineering talent. We provide funding and mentorship to promising technical talent—regardless of previous experience.
Fellows will primarily use external infrastructure (e.g., open-source models, public APIs) to work on an empirical project aligned with our research priorities, with the goal of producing a public output (e.g., a paper submission). In one of our earlier cohorts, over 80% of fellows produced papers. We run multiple cohorts of Fellows each year and review applications on a rolling basis.
What to Expect
- Duration: 4 months of full-time research.
- Mentorship: Direct mentorship from Anthropic researchers.
- Workspace: Access to a shared workspace (in either Berkeley, California or London, UK).
- Community: Connection to the broader AI safety and security research community.
- Stipend: 3,850 USD / 2,310 GBP / 4,300 CAD per week.
- Research Funding: Funding for compute (~$15k/month) and other research expenses.
Compensation
The expected base stipend for this role is 3,850 USD / 2,310 GBP / 4,300 CAD per week, with an expectation of 40 hours per week for 4 months (with possible extension).
Fellows Workstreams
We are expanding the program across teams at Anthropic. We expect significant overlap in skills and responsibilities and will by default consider candidates for all workstreams. Please indicate your preferences in the application.
Current Workstreams:
- AI Safety Fellows
- AI Security Fellows
- ML Systems & Performance Fellows
- Reinforcement Learning Fellows
- The Anthropic Institute Fellows (Economics & Policy)
Note: This page is specific to one of the Anthropic Fellows Workstreams. See also the main Anthropic Fellows posting.
Qualifications
You may be a good fit if you:
- Are motivated by making sure AI is safe and beneficial for society as a whole.
- Are excited to transition into empirical AI research and would be interested in a full-time role at Anthropic.
- Have a strong technical background in computer science, mathematics, or physics.
- Thrive in fast-paced, collaborative environments.
- Can implement ideas quickly and communicate clearly.
Strong candidates may also have:
- A strong background in a discipline relevant to a specific Fellows workstream (e.g., economics, social sciences, or cybersecurity).
- Experience in areas of research or engineering related to their workstream.
Candidates must be:
- Fluent in Python programming.
- Available to work full-time on the Fellows program.
AI Safety Fellows
Potential Mentors: Sam Bowman, Sara Price, Alex Tamkin, Nina Panickssery, Trenton Bricken, Logan Graham, Jascha Sohl-Dickstein, Joe Benton, Collin Burns, Fabien Roger, Samuel Marks, Kyle Fish, Ethan Perez.
Research Areas:
- Scalable Oversight: Developing techniques to keep highly capable models helpful and honest.
- Adversarial Robustness and AI Control: Creating methods to ensure advanced AI systems remain safe and harmless.
- Model Organisms: Creating model organisms of misalignment to improve empirical understanding.
- Model Internals / Mechanistic Interpretability: Advancing understanding of internal workings of LLMs.
- AI Welfare: Improving understanding of potential AI welfare and developing evaluations/mitigations.
Unique Candidate Criteria:
- Motivated by reducing catastrophic risks from advanced AI systems.
- Experience with empirical ML research projects.
- Experience working with large language models.
- Track record of open-source contributions.
AI Security Fellows
Potential Mentors: Nicholas Carlini, Keri Warr, Evyatar Ben Asher, Keane Lucas, Newton Cheng.
Unique Candidate Criteria:
- Motivated by reducing catastrophic risks from advanced AI systems.
- Contributed to open-source projects in LLM- or security-adjacent repositories.
- Demonstrated success in bringing clarity and ownership to ambiguous technical problems.
- Experience with pentesting, vulnerability research, or other offensive security work.
- Demonstrated willingness to do the "dirty work" that produces high-quality outputs.
- Reported CVEs or awarded bug bounties.
- Experience with empirical ML research projects and deep learning frameworks.
Logistics
- Work Authorization: You must have work authorization in the US, UK, or Canada and be located in that country during the program.
- Visa Sponsorship: We are not currently able to sponsor visas for fellows.
- Workspace: We have designated shared workspaces in London and Berkeley. We are also open to remote fellows in the UK, US, or Canada.
- Duration: 4 months, full-time.
- Hiring: We do not guarantee full-time offers, though strong performance may lead to opportunities. In previous cohorts, 25-50% of fellows received a full-time offer.
Interview Process
The process includes an initial application and reference check, technical assessments and interviews, and a research discussion.
We encourage you to apply even if you do not believe you meet every single qualification. We strive to include a range of diverse perspectives on our team.
To apply: https://weworkremotely.com/remote-jobs/anthropic-anthropic-fellows-program-ai-safety-security