Here's why AI model distillation has gained spotlight in AI race between US and China, explained

AI model distillation is a technique that allows developers to shrink powerful artificial intelligence models into cheaper, more efficient systems. This has now become the latest battleground between the US and China in the race for AI dominance. 

Livemint, Eduardo BaptistaReuters
Updated31 Jul 2026, 04:44 PM IST
Add Mint as a preferred source on Google
AI model distillation is a technique that allows developers to shrink powerful artificial intelligence models into cheaper, more efficient systems.
AI model distillation is a technique that allows developers to shrink powerful artificial intelligence models into cheaper, more efficient systems. (Pexels / Representative Photo)

AI model distillation, a technique that allows developers to shrink powerful artificial intelligence models into cheaper, more efficient systems, has now become the latest battleground between the United States and China in the race for AI dominance, as per a Reuters report.

Explaining the process, it noted that at its core, model distillation uses output generated from more powerful AI systems to train a smaller platform with relatively limited capabilities and computing resources.

It is not a new technique and has been a standard tool when it comes to AI research but has become the bone of contention over who holds the rights to advanced AI capabilities and whether these aspects can be transferred without consent of the companies involved.

Also Read | OpenAI's Sam Altman to discuss AI safety tests with White House officials today

The US government and leading AI companies have accused Chinese rivals of using the technique to extract capabilities from proprietary models, opening a new front in an increasingly bitter competition over technological leadership. Here's a look at some of the key highlights about the practice at the centre of the debate:

What is model distillation? Explained

The largest AI models, known as frontier models, require enormous amounts of computing power, data and investment to train.

Model distillation offers a way to create smaller systems by using a large "teacher" model to train a smaller "student" model.

The teacher generates examples, such as answers and computer code, which are then used as training material for the student.

The smaller model is not a replica of the teacher. It does not inherit the teacher's weights, architecture or full capabilities. Instead, it learns selected behaviours that enable it to perform specific tasks more efficiently.

Also Read | ANI vs OpenAI: so, can AI be trained on copyright protected text?

Why does distillation matter?

The appeal of distillation is that it can make AI cheaper and easier to deploy.

A frontier model may require large data centres and expensive chips to operate. Distilled models can run on less powerful hardware and be tailored for specific tasks.

That makes them appealing to companies and governments looking to deploy AI more widely, from devices and factories to vehicles and private networks.

Why are reasoning traces important?

Recent AI systems have increased interest in transferring not only final answers but also the steps used to reach them.

These "reasoning traces" can show a smaller model how to approach a difficult problem rather than simply what answer to produce.

Florian Tramèr, an assistant professor at ETH Zurich who researches machine-learning security, compared the process to human learning.

Also Read | Meta’s Zuckerberg Defends AI Bets to Skeptical Investors

"If I give you a book of complicated math problems with final solutions, you will have a much harder time learning how to solve problems than if I gave you detailed solutions that describe all steps to take," he said.

As reasoning traces have become more valuable, access to AI outputs has become more sensitive because they may expose some of the methods advanced systems use to tackle complex problems.

Who uses distillation?

Distillation is a widely used AI training technique, not an inherently improper practice.

U.S. researchers and companies have long used it, including Stanford University's Alpaca project and Microsoft's Orca research, which relied on outputs from more advanced models to improve smaller ones.

Chinese researchers have also used outputs from U.S. models in public research projects, including efforts to create Chinese-language instruction models.

Also Read | The full-stack AI strategy has a Jenga problem

The key difference lies in access. Open-weight models let researchers inspect and modify underlying parameters. Closed models, such as OpenAI's ChatGPT and Anthropic's Claude, remain under company control and are typically accessed through proprietary interfaces or APIs.

Why has distillation become a US-China issue?

The controversy is less over distillation itself and more about unauthorised extraction.

AI companies argue there is a distinction between legitimate research and systematically harvesting outputs from proprietary models to replicate commercially valuable capabilities.

Anthropic has accused Chinese entities including DeepSeek, Moonshot and MiniMax of conducting large-scale campaigns to obtain capabilities from Claude models.

The company said those efforts targeted capabilities including software engineering and advanced reasoning.

OpenAI has also said it has detected attempts by Chinese actors to use its models for distillation-related purposes.

No Chinese companies have accused U.S. rivals of distilling closed-source models so far.

(With inputs from Reuters)

About the Author

For about a decade, Livemint—News Desk has been a credible source for authentic and timely news, and well-researched analysis on national news, business, personal finance, corporates, politics and geopolitics. We bring the latest updates on all the listed companies on BSE and NSE, startups, mutual funds, Union ministries, geopolitics, and untapped human interest stories from around the world, helping our readers to stay informed on the latest developments around the globe. Our Coverage Areas 1. Companies: Comprehensive news and analysis on listed and unlisted companies, corporate announcements, corporate chatter, C-suite, business trends, hiring alerts, layoffs, work-life balance, world's top billionaires and richest and more. 2. Personal finance: Insights into mutual funds, small savings schemes like - PPF, SSY, post office savings scheme, stock to watch, personal loans, credit cards, top bank FDs, real estate, income tax and more. 3. Politics: Comprehensive coverage of general elections, state elections and bypolls, Lok Sabha, Vidhan Sabha, Parliament, PMO, PIB, finance ministry, home ministry, among other union ministries and government departments. 4. National News: From metro cities like Delhi, Mumbai, and e to untapped stories from rural India, we cover human interest, health, education, crime and courts, and law and order, among other areas of public interest. 5. Economy: In-depth analysis of India's macro and micro-economic indicators like- GDP, inflation, forex, fiscal deficit, current account deficit, interest rate cycle, economic recovery, RBI circulars, indirect taxes, GST, Insolvency and Bankruptcy imports, exports and everything that impacts Indian economy. 6. Geopolitics: Well-rounded and deeply researched coverage on US News, Oval Office European Union, Ukraine Russia War, middle-east crisis, royal families and global leaders like - Donald Trump, Vladimir Putin, Kim Jong Un, Xi Jinping and premiers of other leading economies in the world. Meet the Team 1. Gulam Jeelani, Political Affairs Editor 2. Sugam Singhal, Senior Assistant Editor 3. Chanchal, Assistant Editor 4. Sanchari Ghosh, Chief Content Producer 5. Pratik Prashant Mukane, Chief Content Producer 6. Sayantani Biswas, Chief Content Producer 7. Ravi Hari, Deputy Chief Content Producer 8. Garvit Bhirani, Deputy Chief Content Producer 9. Akriti Anand, Senior Content Producer 10. Jocelyn Felix Fernandes, Senior Content Producer 11. Swastika Das Sharma, Content Producer 12. Mausam Jha, Content Producer 13. Riya R Alex, Trainee Content Producer

Get Latest real-time updates

Catch all the Technology News and Updates on Live Mint. Download The Mint News App to get Daily Market Updates & Live Business News.

HomeTechnologyNewsHere's why AI model distillation has gained spotlight in AI race between US and China, explained
More