Carl Shulman is an artificial intelligence researcher and policy expert. He is a co-founder of Open Philanthropy, a grantmaking organization that advises donors on high-impact giving, and has been a key figure in the development of the effective altruism movement. His work focuses on the long-term risks and opportunities of advanced AI, including existential risk and AI governance.
Shulman's research and policy contributions have centered on the intersection of AI safety, forecasting, and philanthropy. He has been a prominent voice in discussions about the potential for AI to pose catastrophic risks, and has worked to direct funding and attention toward mitigating these risks. He has also been involved in the academic study of these topics, contributing to the field of AI alignment and the broader discourse on the future of technology.
Early Life and Education
Shulman's early academic background is in law and philosophy. He earned a law degree and subsequently became interested in the ethical implications of emerging technologies, particularly AI. This interest led him to the University of Oxford, where he became involved with the Future of Humanity Institute (FHI), an interdisciplinary research centre focused on big-picture questions about humanity's long-term future. At FHI, he worked alongside researchers such as Nick Bostrom and Toby Ord, contributing to the institute's research on existential risk and the philosophy of AI.
Career at Open Philanthropy
Shulman is a co-founder of Open Philanthropy, an organization that emerged from the effective altruism community. Open Philanthropy was established to conduct in-depth research and make large grants to address some of the world's most pressing problems, with a significant focus on AI risk and policy. Shulman has served as a senior advisor and researcher at the organization, helping to shape its grantmaking strategy in the AI field. His work has involved identifying promising research directions, evaluating the potential impact of various AI safety initiatives, and supporting organizations working on AI governance and technical alignment.
Contributions to AI Risk and Policy
Shulman has been a prolific writer and speaker on AI risk. He has argued that the development of artificial intelligence could lead to outcomes ranging from tremendous benefits to existential catastrophe, and that the choices made by researchers, policymakers, and funders today are crucial. He has emphasized the importance of technical research on AI alignment, as well as the need for robust governance mechanisms to ensure that AI development proceeds safely. His work has influenced the priorities of major philanthropic efforts in the AI space, including those of the Open Philanthropy and the Future of Life Institute.
Views on AI Alignment and Governance
Shulman's perspective on AI alignment is characterized by a focus on practical, near-term actions that can reduce long-term risks. He has advocated for increased investment in technical research on topics such as machine learning interpretability, robustness, and the development of safe neural networks. He has also highlighted the importance of policy research, including the design of international agreements and the role of organizations like OpenAI and Anthropic in shaping industry norms. He has been a proponent of "precautionary" approaches that prioritize safety over speed, while also acknowledging the potential benefits of AI for solving global problems.
Role in Effective Altruism
Shulman is a central figure in the effective altruism community, which seeks to use evidence and reason to do the most good possible. His work at Open Philanthropy has been a model for how to apply these principles to the field of AI. He has written extensively on the moral importance of the far future, arguing that the long-term trajectory of humanity is a key consideration for ethical decision-making. This perspective has led him to focus on existential risks, which he sees as the most pressing issue of our time.
Selected Publications and Talks
Shulman has authored or co-authored numerous articles and essays on AI risk, forecasting, and philanthropy. He has given talks at major AI conferences and workshops, including those organized by the Berkeley AI Research lab and the Stanford AI Lab. His written work often appears in venues such as the Effective Altruism Forum and academic journals. He has also been a contributor to the Future of Humanity Institute's research output, including work on the Fermi paradox and the simulation argument.
Impact and Legacy
Shulman's influence extends beyond his own research. Through his role at Open Philanthropy, he has helped channel hundreds of millions of dollars into AI safety research and policy initiatives. This funding has supported the growth of organizations like Anthropic and the Machine Intelligence Research Institute, as well as academic groups at institutions such as Oxford and Carnegie Mellon University. His ideas have shaped the strategic thinking of many in the AI field, and he is widely regarded as a key thinker on the long-term risks of AI.
Personal Life
Shulman is known for his intellectual rigor and his commitment to using his skills to address the most important problems facing humanity. He is based in the United States and continues to work on AI policy and philanthropy. He is also a frequent collaborator with other researchers in the effective altruism and AI safety communities, including Nick Bostrom and Toby Ord.
See Also
- Future of Humanity Institute
- Open Philanthropy
- Existential risk
- AI alignment
References
- Open Philanthropy. "Carl Shulman." Accessed 2023.
- Future of Humanity Institute. "People." University of Oxford.
- Shulman, Carl. "AI and the Far Future." Effective Altruism Forum, 2019.