METR
Measures frontier-model capabilities, autonomy, and loss-of-control risks.
Berkeley · Independent nonprofitMAP THE ECOSYSTEM
Explore projects
& organizations.
Browse organizations by theme, discover AI safety projects and upcoming events, and find grants to support the work.
Filter by focusSelect one or more themes. Showing matches from any selected theme.
34 organizations · 6 themes
ORGANIZATIONS
Who is doing the work.
Independent evaluators, research labs, public institutions, standards bodies, security groups, and field-building organizations.
Evaluation & research
7 organizationsRedwood Research
Develops AI control methods, studies strategic deception, and investigates risks from misaligned AI agents.
Berkeley · Independent nonprofitForethought Research
Studies how to navigate rapid AI progress and the transition to a world with superintelligent systems.
Oxford + Berkeley + Remote · Research nonprofitApollo Research
Researches scheming, deception, evaluations, and frontier AI security.
London + San FranciscoFAR.AI
Incubates and conducts technical AI safety research and red-teaming.
Berkeley · Independent nonprofitCenter for AI Safety
Conducts safety research, builds the field, and develops safety standards.
San Francisco · NonprofitCenter for Human-Compatible AI
Studies how advanced AI systems can reliably act in line with human values.
Berkeley · AcademicGovernment & standards
8 organizationsAdvanced Research + Invention Agency
Funds ambitious R&D, including large programs in scalable AI trust and coordination.
United Kingdom · Public R&DUK AI Security Institute
Evaluates advanced systems and builds public infrastructure for frontier AI security.
United Kingdom · GovernmentNational Institute of Standards and Technology
Develops AI measurement, risk-management, evaluation, and interoperability standards.
United States · GovernmentDefense Advanced Research Projects Agency
Runs advanced programs in cyber defense, autonomy, resilience, and contested systems.
United States · Public R&DEuropean AI Office
Implements EU AI governance and coordinates general-purpose AI oversight.
European Union · GovernmentEuropean Union Agency for Cybersecurity
Builds cybersecurity capability, guidance, and cross-border operational cooperation.
European Union · AgencyCyber Security Agency of Singapore
Leads national cybersecurity work and practical assurance for emerging systems.
Singapore · GovernmentRAND
Studies AI governance, national security, institutions, and public policy.
United States · Policy researchFrontier labs
2 organizationsAnthropic
Develops frontier models alongside alignment, interpretability, and safeguards research.
United States + United KingdomMicrosoft Research
Studies reliable, secure, and human-centered AI systems at deployment scale.
Global · Research labField-building & training
3 organizationsCooperative AI Foundation
Funds and connects research on cooperation, coordination, and multi-agent safety.
International · NonprofitApart Research
Runs open research programs that help new contributors produce useful safety work.
Remote · Research nonprofitBlueDot Impact
Offers AI safety and governance courses, community, and career support.
London + RemoteSecurity & assurance
5 organizationsAgentic AI Foundation
Stewards open agent protocols and neutral infrastructure across vendors.
Global · Industry consortiumOWASP GenAI Security Project
Turns emerging agent and model threats into practical security guidance and tests.
Global · Open communityCloud Security Alliance
Develops practitioner-led cloud and AI security controls, including MAESTRO.
Global · Industry nonprofitMITRE ATLAS
Catalogues adversarial tactics and techniques for machine-learning systems.
United States · Public-interest R&DCoalition for Secure AI
Coordinates open, cross-company work on secure AI development and deployment.
Global · Industry coalitionUS–China collaboration
9 organizationsPeople convening dialogue and cooperation, alongside researchers who help explain the US–China AI relationship. Track II means unofficial dialogue between experts. Open a card's contact details to see how the groups connect.
Concordia AI
Dialogue & cooperationAdvances AI safety and governance through research, policy advice, risk monitoring, and international dialogue, with deep knowledge of China’s AI ecosystem.
Beijing + Singapore · Social enterprisePeople, connections & contact
Co-convened a Shanghai AI crisis-coordination workshop with Oxford AIGI, Carnegie, and Tsinghua. Kwan Yee Ng is also an Oxford AIGI affiliate.
- Kwan Yee NgHead of International AI Governance
- Brian TseFounder and CEO · Strategic partnerships
- Jonathan M. LeeInternational AI Governance Project Manager · Singapore
- Sitong LyuEvent Specialist · Conferences and events
Safe AI Forum
Dialogue & cooperationOrganizes the International Dialogues on AI Safety (IDAIS), connecting Chinese and international scientists around extreme AI risks and shared governance approaches.
UK + North America · In-person roles in London and San FranciscoPeople, connections & contact
IDAIS is its flagship programme. SAIF became independent from FAR.AI in 2025; Oxford AIGI co-hosted IDAIS London in 2026.
- Fynn HeideExecutive Director · Strategic partnershipsfynn@saif.org
- Sophie ThomsonDirector of Programmes · Programme partnershipssophie@saif.org
- Lilian HughesHead of Events · Convenings and venueslilian@saif.org
- Harsimrandeep MalhiHead of Operations · Operational supportharsimran@saif.org
- Saad SiddiquiSenior Researcher · Also an Oxford AIGI affiliatesaad@saif.org
Carnegie China AI Initiative
Dialogue & cooperationCombines Chinese-language research, fieldwork, and policy analysis with dialogue among US, Chinese, and international AI experts.
Washington, DC · Carnegie Endowment for International PeacePeople, connections & contact
Scott Singer connects Carnegie’s China AI Initiative with Oxford AIGI as a research affiliate. Carnegie also co-convened the Shanghai workshop with Concordia and Tsinghua.
- Scott SingerCo-Director · AI dialogue and diplomacy
- Matt SheehanCo-Director · China’s AI ecosystem
Brookings John L. Thornton China Center
Dialogue & cooperationStudies US–China relations and AI competition and cooperation. Brookings’ Foreign Policy programme convenes a bilateral dialogue on AI and national security.
Washington, DC · Policy researchPeople, connections & contact
Brookings and Tsinghua CISS have jointly convened the unofficial Track II dialogue since 2019. This is a separate series from IDAIS.
Public roles and sources reviewed September 6, 2026. Suggested contact roles do not imply a current request for support.Tsinghua Center for International Security and Strategy
Dialogue & cooperationConducts international security research and convenes exchanges on AI governance, strategic stability, and US–China relations.
Beijing · 217 Mingzhai, Tsinghua UniversityPeople, connections & contact
Brookings’ Chinese partner for the bilateral AI dialogue. Xiao Qian also serves as Vice Dean of Tsinghua’s Institute for AI International Governance (I-AIIG).
Public roles and sources reviewed September 6, 2026. Suggested contact roles do not imply a current request for support.Oxford Martin AI Governance Initiative
Dialogue & cooperationStudies international AI governance and potential cooperation with Chinese actors, and convenes researchers and policymakers across jurisdictions.
Oxford · Oxford Martin School, 34 Broad StreetPeople, connections & contact
Co-hosted IDAIS London with SAIF. Its China governance network includes Scott Singer (Carnegie), Kwan Yee Ng (Concordia), and Saad Siddiqui (SAIF).
- Nikki SunResearch and Programme Manager · Public contactnikki.sun@oxfordmartin.ox.ac.uk
- Robert TragerAIGI Co-Director · International governance
National Committee on US–China Relations
Dialogue & cooperationBuilds bilateral relationships through exchanges, delegations, public events, and Track II dialogues, including AI and the digital economy.
New York · 52 Vanderbilt Avenue, 16th FloorPeople, connections & contact
Its digital-economy dialogue partners with the China-U.S. Green Fund. Dennis Blair leads the US delegation; Xu Lin leads the Chinese delegation.
- Haini GuoSenior Director, Track II Dialogues
- Emily TangDirector, Development · Support and partnerships
Digital-economy dialogue ↗Staff ↗Contact & in-kind support ↗
Public roles and sources reviewed September 6, 2026. Suggested contact roles do not imply a current request for support.Georgetown Center for Security and Emerging Technology
Policy & research contextProvides analysis of China’s AI ecosystem, emerging-technology security, and translations of Chinese policy documents.
Georgetown University · United StatesPeople, connections & contact
A source of evidence and policy context for understanding the bilateral relationship. Included for research expertise; no joint IDAIS organizing role is claimed.
- Ben MurphyTranslation Manager · Chinese-source researchben.murphy@georgetown.edu
Institute for AI Policy and Strategy
Policy & research contextResearches advanced AI, national security, international coordination, and US–China competition and its implications for global stability.
United States · Washington, DC mailing address; visitor office unverifiedPeople, connections & contact
Its International Strategy team provides policy context. Inclusion here does not imply a bilateral exchange programme or an IDAIS organizing role.
- Karson ElmgrenResearch Manager, International Strategy
- Renan AraujoDirector of Programs
PROJECTS & INITIATIVES
Specific efforts already underway.
Programs, collaborations, standards work, evaluation infrastructure, and research networks. Select one for its role, contribution opportunities, and key questions.
01
New · August 25Partner
ECRI AI error reporting
AI incident reporting and independent patient-safety investigation
ECRIECRI and ISMP PSOHealthcare providers
02
New · August 20Watch / condition
AI Agency Protocol
Purpose-bound, expiring authority for autonomous AI agents
CausumKanjani AI ResearchAIAP
03
New · August 19Partner
Frontier AI Critical Defense Program
Virtual patching for AI-discovered critical-infrastructure vulnerabilities
Palo Alto NetworksAnthropicOpenAI+2
04
New · August 18Partner
Democratic AI oversight initiative
Capacity, training, and tools for oversight of government AI use
OpenAIDemocratic oversight bodiesCivil society+1
05
Anchor
Cooperative AI Foundation
Field builder, funder, and research network
Cooperative AI Foundation
06
Anchor
ARIA Scaling Trust
Large R&D program and planned Arena
ARIAScaling Trust
07
Anchor
UK AISI / Inspect Cyber
Open evaluation infrastructure and international testing
UK AI Security InstituteInspectInspect Cyber
08
Anchor
NIST / CAISI / NCCoE
Standards, measurement, identity, and authority
NISTCAISINCCoE
09
Anchor
Agentic AI Foundation ecosystem
Protocols, tool connectivity, gateways, and neutral governance
AAIFA2AMCP+1
10
Anchor / partner
DARPA agentic cyber programs
Advanced contested-autonomy and cyber R&D
DICEAI ForgeAIxCC+1
11
Partner
Independent AI safety evaluators
Independent evaluation and strategic-behavior research
FAR.AIMETRApollo Research+1
12
Partner
Academic cooperative AI network
Foundational mechanisms and measurement
FOCALFLAIRCHAI+1
13
Partner
Commercial system-safety research
Empirical system-safety research and open tools
AnthropicMicrosoft Research
14
Partner
Agentic security standards ecosystem
Threat models and practitioner translation
OWASP Agentic SecurityCSA MAESTROCoSAI+1
15
Partner
International AI safety testing network
International testing, regulatory translation, and capacity building
NAAIMESEU AI OfficeENISA+1
16
Watch / condition
Agentic security vendors
Deployment laboratories and operational data holders
GoogleMicrosoft SecurityCisco+5
Project map seeded by Yondon Fu's ecosystem research and expanded from primary announcements, reviewed August 27, 2026.
CONFERENCES & EVENTS
Meet the people doing the work.
Upcoming research, governance, and international dialogue events. Each listing links to its organizer and distinguishes announced dates from plans still taking shape.
Technical safety & alignmentAnnounced
Cambridge AI Research Directions (CAIRD) Workshop
September 28, 2026
Cambridge, Massachusetts
FAR.AI and the Cambridge Boston Alignment Initiative bring academic researchers together to explore AI safety research and form collaborations.
Invite-only; expressions of interest are reviewed on a rolling basis.
Official event details ↗Governance & practiceAnnounced
AI Governance Online 2026
September 30, 2026 · 8:00 am–2:30 pm Pacific
Online
A practical conference on organizational AI governance. Useful for governance implementation and professional connections; broader than frontier AI safety.
Free virtual conference; register through the organizer.
Official event details ↗Ethics & societal impactsAnnounced
AAAI/ACM Conference on AI, Ethics, and Society
October 12–14, 2026
Malmö Live · Malmö, Sweden
An interdisciplinary research conference on the ethical and societal implications of AI.
See the conference website for attendance and programme details.
Official event details ↗US–China relationsAnnounced
NCUSCR 2026 Gala Dinner
November 10, 2026
New York City
A broader US–China relationship-building event hosted by the National Committee on US–China Relations; not an AI-specific conference.
Tickets and sponsorship information are published by NCUSCR.
Official event details ↗Governance & practiceAnnounced
DGIQ East + AI Governance Conference
November 16–19, 2026
Omni Providence Hotel · Providence, Rhode Island
Co-located data and AI governance conferences focused on organizational practice, data quality, and responsible deployment.
See the organizer for registration and programme details.
Official event details ↗Machine learning researchAnnounced
NeurIPS 2026
December 6–12 (Sydney); December 9–13 (satellites)
Sydney · Satellites in Atlanta and Paris
A major machine learning conference with evaluations, datasets, and workshops. A broad research gathering; consult the programme for specific safety sessions.
Registration rules and availability vary by site; use the official conference website.
Official event details ↗US–China collaboration & AI safetyPlanned · Details TBA
Sixth International Dialogues on AI Safety
2026 · Date not announced
Location TBA
Safe AI Forum’s official IDAIS page lists a sixth dialogue planned in the coming months. The latest completed dialogue was London, April 17–19, 2026.
No public registration details listed. Ask the organizers about participation or support.
Ask the organizers ↗Official sources reviewed September 6, 2026. Dates and attendance terms can change; confirm with the organizer before making travel plans.
FUNDING & GRANTS
Find backing for work that should exist.
Rolling funds, fixed grant rounds, research support, and compute programs. We distinguish what is accepting applications now from programs we are watching for reopening.
7funders tracked
5accepting applications
6 hrsbetween official-source checks
AAFFunding + support
Alignment Research Support
Offers funding and, where useful, dedicated engineering teams to help alignment researchers move promising agendas forward.
SUPPORTFunding and dedicated engineering support
WHO CAN APPLYResearchers and research teams working on technical AI alignment
Rolling applicationApply or learn more ↗
PrincipiaCompute credits
Compute Grants
Provides compute resources for independent research on agentic systems, mechanistic interpretability, and alignment-adjacent topics.
SUPPORTCompute resources and credits
WHO CAN APPLYIndependent researchers and small teams with a scoped technical project
Rolling; responses typically within two weeksApply or learn more ↗
ManifundCash grant
Manifund Open Call
Create a public proposal for donors interested in technical AI safety, AI governance, global catastrophic risks, and adjacent work.
SUPPORTApplicant sets the amount requested
WHO CAN APPLYIndependent researchers, builders, organizers, and nonprofit projects
Open call; proposals can be created at any timeApply or learn more ↗
OpenAICompute credits
Researcher Access Program
Provides API credits for research on responsible deployment, risk mitigation, societal impact, and related independent investigations.
SUPPORTAPI credits valid for 12 months
WHO CAN APPLYResearchers working on questions aligned with the program’s areas of interest
Applications reviewed every three monthsApply or learn more ↗
EA FundsCash grant
Transformative AI Fund
Supports work that could reduce catastrophic risks from transformative AI across technical research, policy, training, and field-building.
SUPPORTTypically $10k–$150k; larger grants considered
WHO CAN APPLYIndividuals, new organizations, and existing organizations with new projects
Applications accepted year-roundApply or learn more ↗
grantmaking.aiCash grant
Launch Round
An experimental open grant round that distributed support across high-impact projects. The launch deadline has passed and the next round is being monitored.
SUPPORT$5k–$50k grants in the launch round
WHO CAN APPLYHigh-impact projects, including AI safety and catastrophic-risk work
Launch round closed June 30, 2026View official program ↗
UK AISICash grant
The Alignment Project
A major public grant program for AI alignment research. The first application round is closed; future AISI academic grants are being monitored.
SUPPORTFirst round offered grants up to £1m
WHO CAN APPLYAcademic and independent research teams working on AI alignment
Closed; monitoring for future roundsView official program ↗
Status is checked against each program's official page every six hours; last successful check Sep 24, 2026. Grant terms can change, so confirm details with the funder before applying.
FIND YOUR WAY IN
Turn exploration into a concrete next step.
Browse current paid roles, fellowships, volunteer projects, grants, and other ways to contribute across the ecosystem.