Big AI sets out its terms for regulatory capture and calls it ‘Pace the frontier’
Amodei, Altman, Nadella and Musk agree on how government can tame the monster they created
READ MORE
The myth of killer AI is a self-serving attempt at regulatory capture 1 hour ago
AI more likely to kill animals if it saves fuel or money 2 days ago
OpenAI arms devs with AI conversation tool that can talk and listen at the same time 3 days ago
Latest Anthropic horror story chills with tales of kamikaze drone swarms and bioweapons research 3 days ago
Hundreds of AI agents helped PaperCut attacker hit 395+ orgs, and some went off script 3 days ago
The leaders of major AI labs spent the weekend agreeing on a plan to capture regulators, make more money, and avoid responsibility for their dangerous behaviour. They call it “pacing the frontier.”
Anthropic CEO Dario Amodei set the ball rolling with a post in which he professed alarm at how quickly AI is improving and suggested the attack on Hugging Face caused by rogue agents run by his rival OpenAI (OAI-HF) represented a moment that proved something needs to change at so-called “frontier” AI companies – essentially the big US model-makers.
“It’s also easy to dismiss OAI-HF as the failure of one company, but I believe that would be a mistake,” he wrote. “I believe it’s incumbent on every frontier AI company to act as if OAI-HF had happened to them,” he added, because he worries that before long a swarm of agents “could be capable of taking over the entire internet with a persistent botnet.”
Amodei therefore suggested “We must slow the pace at which we improve the capabilities of AI models. Progress will still seem fast, and we must make wise use of the time we gain.”
The CEO proposed a three-point plan to regulate AI:
Requiring AI labs to host “embedded evaluators” whose job is to “verify adherence to safety practices and commitments, report incidents, and help assess the alignment of not just completed AI models but training pipelines and processes.”
Frontier AI companies that operate in democratic countries collaborating “to establish common safety standards as well as limits on the rate of unchecked AI progress,” with undefined “forms of coordination” that would be “legally challenging” and “require government support.”
A vague call for democratic governments “to coordinate with authoritarian governments, to the extent this is possible, while taking seriously the challenges of verifying compliance.”
OpenAI boss Sam Altman endorsed Amodei’s ideas. So did Elon Musk . Microsoft's Satya Nadella signed up, too .
And just like that, four billionaires all signed up to the same set of rules they think the world’s governments should adopt to regulate their activities.
Amodei even gave democracies a threat/villain to unite against – authoritarians willing to use AI unethically.
This new consensus comes after years during which Big AI argued for light oversight and used that time to build tech that generates child sexual abuse material , dispenses terrible health advice , and made the OAI-HF incident possible.
Big AI has also argued it will deliver a productivity revolution. Daryl Plummer, chief of research at analyst firm Gartner, used his keynote speech at the company’s annual Symposium in Australia today to cite research that found software vendors are pitching 50 percent productivity gains from AI, but customers report a 16 percent lift.
Plummer also doubted that Amodei’s promise to slow development is real.
“I will believe that when I see it,” he said in the keynote, adding that he does not trust billionaires to ever be altruistic.
Write your own rules
Amodei’s ideas read like an attempt at “regulatory capture” – the situation in which vested interests find a way to define the rules their regulators impose. Those supine regulators then make decisions that benefit the entities they oversee more than they benefit the rest of us.
In this case, Anthropic, SpaceX, Microsoft and OpenAI are arguing for regulations they have defined and which amount to a cease fire during which they don’t need to compete so fiercely.
OpenAI boss Sam Altman also all-but-admitted that regulation will be good for investors when he used a weekend interview with the billionaires’ bible Fortune to reveal his company won’t seek a public listing this year because it is inopportune to do so while AI safety concerns are unresolved.
“We got a lot of stuff to do, like meeting this moment of what is going to be required for safety and alignment, and how the industry and governments can work together,” he said.
Or in other words: Investors will make more money if OpenAI pauses its IPO until confidence is higher, while its CEO moves to generate that confidence by backing a regulatory capture proposal.
Amodei, meanwhile, outlined some very specific things he wants from Washington: Stop selling Nvidia chips to China so its AI companies can’t build better models, and a crackdown on model distillation.
“If we execute these measures well, I believe they would slow China’s progress enough to widen America’s lead significantly over the next 3–5 years — the window when AI becomes geopolitically most important,” he wrote.
This plan would, of course, also mean that Chinese companies’ AI services would be inferior to Anthropic’s for a longer period – at a time when Chinese clouds are pushing into the rapidly growing middle eastern and southeast Asian markets.
Pacing the frontier landed badly in Washington. Speaker Mike Johnson warned Amodei’s plan could “smother innovation” and see China dominate global AI. President Trump dismissed warnings that AI can have deleterious effects and said the USA must lead the world in AI.
Such responses may reflect the fact that vast spending on AI infrastructure is delivering GDP growth in otherwise stagnant economies. Or perhaps they prove, yet again, that lawmakers are nearly always late to understand technology companies’ ambitions and the means they use to achieve them. ®
Huawei pitches near-packaged optics as co-packaged costs bite
7.2 Tbps module arrives ahead of standards, with promises of fewer repair headaches
MPs and peers tell UK to stop winging it on AI regulation
Rights committee demands watchdog with teeth as patchwork safeguards leave victims hunting for remedies
HPE makes its “unified storage” claim real as B10000 R6 hits GA
PARTNER CONTENT: Pairs block and adjacent file workloads with independent scaling of performance and capacity
Revolut falls for fake government requests, hands over customer data
Passports, selfies, transaction histories exposed as self-proclaimed culprits demand 10,000 Bitcoin
Europe's right-to-repair rules are broken, not beaten
Patchy compliance is an argument for stronger enforcement, not abandoning the project
CPython eases Rust requirements as assimilation continues
By making Rust opt-in, the Python builders hope to enjoy Rust bennies without the backlash that roiled the Linux kernel keepers
TOP STORIES
PERSONAL TECH Smartphone makers don't bother to comply with EU repairability requirements
NETWORKS Virgin Media offloads email services to third-party provider
offbeat Retired man turns spare room into Soviet-era supercomputer
CYBER-CRIME Ukrainian lawyer's second career as a Conti coder earns him 4 years behind bars
software Another Microsoft team admits it’s struggling to handle flood of AI-generated code
virtualization VMware defends ending downloads of SDK that helps VM backups – or migrations to rivals
AI
LEGAL Nvidia's Groq acquihire is on the DOJ's radar, but it's already too late Even if regulators did somehow unwind the $20B deal, there's a growing list of alternatives ready to take Groq's place, no merger required
SECURITY Watch out: Apple timepiece can grab snippets of conversation without both speakers' consent War is peace. Freedom is slavery. Privacy is surveillance
SYSTEMS d-Matrix drinks the Nvidia Kool-Aid with NVLink Fusion and MGX rack designs AI infrastructure startup joins Qualcomm, Arm, Marvell, Amazon, Fujitsu, and MediaTek as NVLink true believers
ai and ml Anthropic reveals fourth likely crime committed by its AI Claude's Felony Bench rap sheet is now as long as OpenAI's
SYSTEMS Samsung to help fortify OpenAI's semiconductor supply chain Semiconductor supply chains are hard, but Samsung offers OpenAI relief in many forms spanning compute and memory
Infosec
Security Russians are posing as Signal support to launch phishing attacks PLUS: US takes down Iranian propaganda sites; Marketing company asks 'Why Do We Have Your Information?' And more!
Security Microsoft patches failed to fix on-prem SharePoint, which is now under zero-day attack PLUS: China upgrades smartphone surveillance tools; Ring eases anti-snooping stance; and more
Black Hat and DEF CON DEF CON Franklin project enlists hackers to harden critical infrastructure Voting village reports have been so successful, says Jeff Moss, that the whole of DEF CON will now be included
Security EQT buys majority share in Swiss cybersecurity biz Acronis Went at equivalent of $3.5B+ valuation for entire firm, though portion sold not specified
Malware Month Ten years since the first corp ransomware, Mikko Hyppönen sees no end in sight On the plus side, infosec's a good bet for a long, stable career
FOSS
Shopify extends lifeline to Tailwind as vibe coding erodes web dev platform's bottom line Acquisition gives open source CSS framework 'a stable long-term home'
Switzerland tests a FOSS escape route from Microsoft 365 Swiss Army sticks a knife in American cloud apps with its own FOSS push
Feel peak Windows was 7? You might like Kumander Linux Debian and Xfce – solid, sensible choices – with a pretty skin
Canonical shuttering some of its legacy chat channels The Ubuntu Pastebin went in June, IRC gets demoted next
Audacity audio-editing app no longer looks like it's from the early 2000s The FOSS tool for audio editing has a fresh coat of paint, and new features to boot
Haiku OS rises / Beta 6 sails open web / Virtual winds fly fast A real alternative to running some kind of FOSS Unix clone