Microsoft CEO Satya Nadella called for advanced AI systems to include containment, independent controls and an emergency brake that humans operate. His comments land as tech executives warn about AI safety while President Donald Trump opposes slowing U.S. development.
Microsoft Chairman and CEO Satya Nadella on Saturday called for advanced AI systems to be built with containment, independent controls and an emergency brake that lets authorized people pause or shut a model down mid-task.
Nadella wants deterministic controls around AI models
Nadella laid out his case in a post on X. He wrote that non-deterministic models need to be surrounded with strong, deterministic system design, human controls and reliable operating procedures, with industry standards set where existing ones fall short.
He also proposed that frontier closed and open weight models be treated like insider risks. Nadella said AI systems should rest on principles of observability, including model diversity, a human-readable footprint of the model's actions, continuous system testing, independent controls and auditability, containment, and incident disclosure.
According to Nadella: "It will be the one that enables us to trust the model the least." He was describing the most trustworthy Super Intelligence system.
Industry warnings meet White House resistance
The post follows warnings from tech executives and researchers, including Bill Gates, Anthropic's Dario Amodei, OpenAI's Sam Altman and Elon Musk, about insufficient AI safety protocols and a technology moving too fast.
Trump takes the opposite view. He has repeatedly dismissed AI extinction risks and stressed that the industry needs to stay ahead of China. He also recently introduced a new AI Force, led by Director of National Intelligence Jay Clayton, to help facilitate the industry and root out bad actors.
Source: CNBC
Trading involves risk.