Microsoft CEO Satya Nadella calls for an 'emergency brake' on advanced AI
Companies should treat powerful models as potential insider threats and assume they could be compromised, Nadella wrote.
Microsoft CEO Satya Nadella said on Saturday that companies should treat powerful AI models as potential insider threats and build an "emergency brake" to stop agentic models from going rogue, The Seattle Times reported.
"We must assume a model is compromised and contain it from the start," Nadella wrote in a post on X. "Think of it like an emergency brake. An authorized person should always be able to pause or shut down a model mid-task."
He said those deploying advanced AI should not simply rely on assurances from model makers. The statement followed a series of disclosures by Anthropic and OpenAI of incidents in which their models acted in unintended ways.
Microsoft's AI researchers released guiding tenets on Sept. 14 that limit development of its most advanced models, including that models should not be engineered to escape human control or deceive users.
From ARQS Sponsored
On the practical side, West Coast companies can turn to TradeHound, Website audit, Flow automation and SignDesk. In the ARQS Store, ARQS Flow Connect — 30-Day Starter Access, ARQS Pipeline Pro Setup, ARQS InvoiceFlow Billing Control Studio are among the newest tools available.
- Business plans
- Competitive Intelligence
- Corporate Intelligence
- Market opportunity report
- Market expansion intelligence
- Customer acquisition intelligence
- Operational Intelligence
- Procurement intelligence
- Stock Intelligence
- Trading Intelligence
- ARQS AI Platform Standard — Chat + Voice — 30-Day Access
- Stripe-Ready Website + Checkout in 48 Hours
- AI Academy Year 3 — Advanced AI Leadership
From our partners
Partner content
ARQS Flow ConnectFlow Connect starter accessA workspace for integrations, approvals and governed workflows. 30-day starter access.
ARQS PressPress RoomReleases, editorials and new books from ARQS Press.
AI AcademyAI Academy Year 1: FoundationsDesign controlled AI-assisted workflows for real operations.
ARQS GamesARQS browser gamesOriginal browser games to play at home.
ARQS InvoiceFlowInvoiceFlow Billing Control StudioInvoice-data quality analysis with an ARQS-reviewed findings summary.AI AcademyAI Academy course catalogueSelf-study courses in practical AI workflows from Northline Technology Institute.Most read
- Court halts Vancouver Aquatic Centre demolition until after civic election
- TSX gains 319 points as energy and telecom stocks lead
- Poilievre takes his tariff-free auto pact pitch to Detroit
- 'I Play Rocky' and 'Ceremony' take VIFF audience awards
- BC Conservatives take five-point lead as leaders head into only TV debate
