Nearly half of OpenAI's Safety Researchers have left
Nearly half of OpenAI's AGI safety team has left, including key figures, raising concerns about prioritizing product development over safety and the impact of commercial interests on AGI research.
Read original articleNearly half of OpenAI's AGI safety team has departed in recent months, according to former researcher Daniel Kokotajlo. This exodus includes notable figures such as cofounder John Schulman and chief scientist Ilya Sutskever, who resigned amid concerns that safety considerations were being overshadowed by product development. Kokotajlo, who left OpenAI in April 2023, noted that the team, which once comprised about 30 members focused on mitigating the risks of artificial general intelligence (AGI), has dwindled to around 16. He expressed concerns about a "chilling effect" on research related to AGI safety, suggesting that the company's shift towards commercial interests has marginalized safety-focused researchers. Critics of the AI safety movement argue that the perceived threats of AGI are exaggerated and that the focus should instead be on leveraging AI to address pressing global issues. The recent departures raise questions about OpenAI's commitment to ensuring the safe development of AGI, especially as the company has opposed legislative efforts aimed at regulating AI development. Kokotajlo's observations reflect a broader concern about the influence of profit motives on safety considerations within the AI industry.
- Nearly half of OpenAI's AGI safety team has left the company.
- Departures include key figures who voiced concerns over prioritizing product development over safety.
- Critics argue that the focus on AGI risks may hinder innovation and overlook pressing global challenges.
- The exodus raises questions about OpenAI's commitment to AGI safety amid commercial pressures.
- Kokotajlo warns of a "chilling effect" on research related to AGI safety within the company.
Related
Former OpenAI employee quit to avoid 'working for the Titanic of AI'
A former OpenAI employee raised concerns about the company's direction, likening it to the Titanic. Departures, lawsuits, and founding rival companies highlight challenges in balancing innovation and safety in AI development.
OpenAI promised to make its AI safe. Employees say it 'failed' its first test
OpenAI faces criticism for failing safety test on GPT-4 Omni model, signaling a shift towards profit over safety. Concerns raised on self-regulation effectiveness and reliance on voluntary commitments for AI risk mitigation. Leadership changes reflect ongoing safety challenges.
OpenAI co-founder leaves for Anthropic
John Schulman has left OpenAI to join Anthropic for AI alignment research, while Greg Brockman is on sabbatical. Only three of the original eleven founders remain at OpenAI.
OpenAI co-founder John Schulman says he will leave and join rival Anthropic
John Schulman is leaving OpenAI to join Anthropic, focusing on AI alignment and technical work. His departure follows the disbandment of OpenAI's superalignment team amid significant organizational changes.
OpenAI co-founder Schulman leaves for Anthropic, Brockman takes extended leave
John Schulman has left OpenAI to join Anthropic for AI alignment research, while Greg Brockman is on sabbatical. Only three of the original eleven founders remain at OpenAI.
Related
Former OpenAI employee quit to avoid 'working for the Titanic of AI'
A former OpenAI employee raised concerns about the company's direction, likening it to the Titanic. Departures, lawsuits, and founding rival companies highlight challenges in balancing innovation and safety in AI development.
OpenAI promised to make its AI safe. Employees say it 'failed' its first test
OpenAI faces criticism for failing safety test on GPT-4 Omni model, signaling a shift towards profit over safety. Concerns raised on self-regulation effectiveness and reliance on voluntary commitments for AI risk mitigation. Leadership changes reflect ongoing safety challenges.
OpenAI co-founder leaves for Anthropic
John Schulman has left OpenAI to join Anthropic for AI alignment research, while Greg Brockman is on sabbatical. Only three of the original eleven founders remain at OpenAI.
OpenAI co-founder John Schulman says he will leave and join rival Anthropic
John Schulman is leaving OpenAI to join Anthropic, focusing on AI alignment and technical work. His departure follows the disbandment of OpenAI's superalignment team amid significant organizational changes.
OpenAI co-founder Schulman leaves for Anthropic, Brockman takes extended leave
John Schulman has left OpenAI to join Anthropic for AI alignment research, while Greg Brockman is on sabbatical. Only three of the original eleven founders remain at OpenAI.