[ExI] AI Knowledge Distillation Problem

[BillK]

I asked Perplexity AI if Chinese developers were using distillation to copy
USA AI models.
The answer was - Yes, but not in every case.
BillK

Perplexity AI -

Yes — *distillation has become a real and widely discussed problem in the
US–China LLM race*, but it is not the same thing as “all Chinese LLMs
copying US LLMs.” The strongest current claims are that some Chinese firms
have used unauthorized model-output harvesting or “distillation attacks” to
imitate US frontier models, while other Chinese labs are also building
legitimately from open-weight models and their own research.
What the issue is

Knowledge distillation itself is a normal machine-learning technique: a
smaller “student” model learns from a larger “teacher” model’s outputs. The
controversy is when companies use that technique on proprietary US models
without permission, especially by circumventing access controls or creating
large numbers of fake accounts to collect outputs at scale.
What the evidence says

OpenAI has accused DeepSeek of trying to “free-ride” on US frontier labs by
extracting outputs from its models for training, and Reuters/Bloomberg
reported similar claims in February 2026. Anthropic also said it found
“industrial-scale” distillation attacks involving DeepSeek, Moonshot AI,
and MiniMax, with millions of interactions used to extract capabilities
from Claude.
How big the problem is

The problem appears serious enough to worry US AI firms and policymakers,
but the public evidence does not prove that Chinese progress is mainly or
entirely due to copying. Chinese labs also release strong open-weight
models and do original work, so the full picture is mixed: some capability
gains may come from distillation, while others come from genuine
engineering and algorithmic improvements.
Practical takeaway

So the best answer is: *yes, unauthorized distillation is now a major
concern*, and it is part of the broader competition between Chinese and US
LLM labs. But it is more accurate to describe this as an arms race around
model extraction, imitation, and safeguards than as a blanket claim that
Chinese LLMs are simply copying US ones.
-------------------------------
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.extropy.org/pipermail/extropy-chat/attachments/20260711/8e923247/attachment.htm>