Microsoft CEO Satya Nadella Calls for 'Emergency Brake' on AI Models

Nadella's Safety Proposal

Microsoft CEO Satya Nadella has called for stronger safeguards around AI models, arguing that the industry needs an "emergency brake" for systems that may behave unpredictably. In a post published on X on Saturday morning, Nadella wrote that it is time "to step back and assess the trust architecture" of AI.

"We can't treat Super Intelligence as a set of nested black boxes and simply accept or reject its recommendations, answers, and actions," Nadella wrote, using the Trump administration's preferred term for AI.

Under his proposed approach, the model would be separated from the harness that orchestrates its work, and controls and safeguards would be externalized. Nadella also called for "every meaningful model action" to be documented with "tamper-proof human readable evidence," and for systems to always allow "an authorized person" to pause or shut down a model mid-task.

"We must assume a model is compromised and contain it from the start," he said. "Think of it like an emergency brake."

Growing Industry Concern

Nadella's comments come as leading AI companies acknowledge a growing number of incidents in which they appeared to lose control of their models. His post also follows a plan for more cautious AI development published by Anthropic CEO Dario Amodei.

Sources: Techcrunch Ai · The Verge Ai