AI model distillation becomes new flashpoint in US-China tech rivalry

3 min read
AI model distillation becomes new flashpoint in US-China tech rivalry
PrimeXBT Editorial Team
Reviewed by PrimeXBT

A technique called model distillation, long used to shrink large AI systems into cheaper ones, has become a new flashpoint between Washington and Beijing. U.S. firms accuse Chinese rivals of using it to extract capabilities from proprietary models without consent, while Chinese researchers have also used the same method on U.S. models in public research projects.

Washington and leading U.S. AI firms accuse Chinese rivals of using model distillation to pull capabilities out of proprietary models without permission, opening a new front in the U.S.-China contest over AI dominance. The technique trains a smaller "student" model on the outputs of a larger "teacher" model, producing a system that runs on less powerful hardware.

How the technique works

The teacher model generates examples, including answers and computer code, and the student model trains on that output. The result is not a copy of the teacher: it does not inherit the teacher's weights, architecture or full range of abilities, but instead learns select behaviors that let it handle specific tasks more efficiently. Because a distilled model can run on cheaper hardware, it appeals to companies and governments that want to deploy AI in devices, factories, vehicles and private networks without the cost of a frontier system.

Reasoning traces raise the stakes

Newer AI systems have made it possible to transfer not just final answers but the reasoning steps behind them, known as "reasoning traces". ETH Zurich machine-learning security researcher Florian Tramèr compared learning from full worked solutions to learning from answers alone, saying it is far easier for a student to progress with the steps shown. As reasoning traces have grown more valuable, access to a model's outputs has become correspondingly more sensitive, since those traces can expose the methods advanced systems use to solve hard problems.

Accusations run largely one way

Distillation itself is a standard, widely used training method: Stanford's Alpaca project and Microsoft's Orca research both relied on outputs from more advanced models to improve smaller ones, and Chinese researchers have likewise used U.S. model outputs in public projects, including efforts to build Chinese-language instruction models. The dispute centers on access rather than the method: open-weight models let outsiders inspect and modify their parameters, while closed models such as OpenAI's ChatGPT and Anthropic's Claude stay under company control.

Anthropic has accused Chinese entities including DeepSeek, Moonshot and MiniMax of running large-scale campaigns to obtain software-engineering and advanced-reasoning capabilities from Claude, and OpenAI has said it detected similar attempts by Chinese actors against its own models. No Chinese company has yet made the reverse accusation against a U.S. rival.

Source: Reuters

Trading involves risk.

Most traded markets

XAU / USD
-0.9% 4,127.61
BRENT
+1.35% 73.620
BTC / USD
+0.7% 63,151.2
EUR / USD
-0.12% 1.14269
USTEC
-0.91% 29,428.7
XAU / USD.24
-0.9% 4,127.61
View all markets

Author

PrimeXBT
Our Editorial Team consists of leading experts with a proven record in the fields of trading, cryptocurrencies, blockchain and finance. We thoroughly research the sources of information in order to provide readers with quality content that serves edu...
Read author’s articles
Alert Triangle Risk Disclaimer
Disclaimer: Some past publications may be outdated. We recommend following our news to stay up to date with the latest information. For any questions, feel free to contact our support team via the chat below.
The content provided here is for informational purposes only. It is not intended as personal investment advice and does not constitute a solicitation or invitation to engage in any financial transactions, investments, or related activities. Past performance is not a reliable indicator of future results.
The financial products offered by the Company are complex and come with a high risk of losing money rapidly due to leverage. These products may not be suitable for all investors. Before engaging, you should consider whether you understand how these leveraged products work and whether you can afford the high risk of losing your money.
The Company does not accept clients from the Restricted Jurisdictions as indicated in our website/ T&C. Some services or products may not be available in your jurisdiction.
The applicable legal entity and its respective products and services depend on the client’s country of residence and the entity with which the client has established a contractual relationship during registration.

Today in markets

Browse World News

Register Now

Trading involves risk

Get started in minutes

Our clients love how fast and simple our sign-up is. It takes just a few minutes to get started!

Get Started Get Started
Get started in minutes

Need Help?

Risk Warning:
Trading in leveraged products carries a high level of risk and may not be suitable for all investors.