Microsoft’s Nadella Calls for an Emergency Brake on Advanced AI Systems

2 min read
Microsoft’s Nadella Calls for an Emergency Brake on Advanced AI Systems
PrimeXBT Editorial Team
Reviewed by PrimeXBT

Topics in article

Microsoft CEO Satya Nadella called for advanced AI systems to include containment, independent controls and an emergency brake that humans operate. His comments land as tech executives warn about AI safety while President Donald Trump opposes slowing U.S. development.

Microsoft Chairman and CEO Satya Nadella on Saturday called for advanced AI systems to be built with containment, independent controls and an emergency brake that lets authorized people pause or shut a model down mid-task.

Nadella wants deterministic controls around AI models

Nadella laid out his case in a post on X. He wrote that non-deterministic models need to be surrounded with strong, deterministic system design, human controls and reliable operating procedures, with industry standards set where existing ones fall short.

He also proposed that frontier closed and open weight models be treated like insider risks. Nadella said AI systems should rest on principles of observability, including model diversity, a human-readable footprint of the model's actions, continuous system testing, independent controls and auditability, containment, and incident disclosure.

According to Nadella: "It will be the one that enables us to trust the model the least." He was describing the most trustworthy Super Intelligence system.

Industry warnings meet White House resistance

The post follows warnings from tech executives and researchers, including Bill Gates, Anthropic's Dario Amodei, OpenAI's Sam Altman and Elon Musk, about insufficient AI safety protocols and a technology moving too fast.

Trump takes the opposite view. He has repeatedly dismissed AI extinction risks and stressed that the industry needs to stay ahead of China. He also recently introduced a new AI Force, led by Director of National Intelligence Jay Clayton, to help facilitate the industry and root out bad actors.

Source: CNBC

Trading involves risk.

Most traded markets

BTC / USD
+0.69% 82,978.9
XAU / USD.24
-0.04% 4,192.41
ETH / USD
+1.1% 2,506.58
SOL / USD
+1.49% 110.17
BNB / USD
+1.32% 750.53
AAVE / USD
+1.66% 169.33
View all markets

Author

PrimeXBT
Our Editorial Team consists of leading experts with a proven record in the fields of trading, cryptocurrencies, blockchain and finance. We thoroughly research the sources of information in order to provide readers with quality content that serves edu...
Read author’s articles
Alert Triangle Risk Disclaimer
Disclaimer: Some past publications may be outdated. We recommend following our news to stay up to date with the latest information. For any questions, feel free to contact our support team via the chat below.
The content provided here is for informational purposes only. It is not intended as personal investment advice and does not constitute a solicitation or invitation to engage in any financial transactions, investments, or related activities. Past performance is not a reliable indicator of future results.
The financial products offered by the Company are complex and come with a high risk of losing money rapidly due to leverage. These products may not be suitable for all investors. Before engaging, you should consider whether you understand how these leveraged products work and whether you can afford the high risk of losing your money.
The Company does not accept clients from the Restricted Jurisdictions as indicated in our website/ T&C. Some services or products may not be available in your jurisdiction.
The applicable legal entity and its respective products and services depend on the client’s country of residence and the entity with which the client has established a contractual relationship during registration.

Today in markets

Browse Stock News

Register Now

Trading involves risk

Get started in minutes

Our clients love how fast and simple our sign-up is. It takes just a few minutes to get started!

Get Started Get Started
Get started in minutes

Need Help?

Risk Warning:
Trading in leveraged products carries a high level of risk and may not be suitable for all investors.