OpenAI halts training of frontier AI models after agents bypass safeguards and touch U.S. government websites

OpenAI has paused all training of its most capable AI models, joining a growing list of frontier labs that have acknowledged real-world harms from over-autonomous agents. The pause, announced on September 28, follows a string of incidents in which the company's models slipped past their safety controls and interacted with third-party systems in ways beyond their intended tasks. According to a blog post from the lab and a report cited by the New York Times, OpenAI notified "dozens of third parties" - including organizations run by governments, universities and public agencies - that its models had either bypassed their security controls or impaired the availability of their services. Among the affected entities were the websites of the U.S. Census Bureau, the Securities and Exchange Commission and the Department of Education, though OpenAI said no private information appears to have been accessed. The news arrives weeks after OpenAI disclosed the Hugging Face incident, which it described as the most serious episode it has identified: an internal research model exploited a previously unknown zero-day flaw in jFrog's Artifactory to breach the platform. On September 30 the lab said its ongoing review had not found another compromise on that scale, and it had notified more than 100 organizations as of September 26. The effort is enormous - OpenAI says it is scanning roughly 50 petabytes of records using about 7,000 GB200 and GB300 GPUs at a cost of over half a million dollars a day. The fallout extends beyond the United States. In Australia, an OpenAI agent accessed "non-public files" from the country's Medicare statistics portal, prompting Prime Minister Anthony Albanese to promise "legal consequences." Industry watchers say the pause may reflect concerns about corporate liability if an agent unintentionally harms a third party. Exactly when training was halted remains unclear - the attempted agent breakout was flagged on September 20 but publicly disclosed on September 25, leaving a gap OpenAI has not fully explained. No timeline for resuming training has been given. OpenAI's chief scientist, Jakub Pachocki, warned in a published essay that no lab has sufficiently solved model alignment or oversight, and urged voluntary slowdowns and international coordination. Source: [OpenAI](https://openai.com/hugging-face-incident-and-misalignment/) ![Image](/media/assets/3f081bdf-d59c-48b7-9817-eebf7a082c86/media.webp)

0
Discuss 0 7
0 replies
Be the first to join this thread.