OpenAI and Anthropic warn China is using tens of thousands of fake accounts to copy their AI models
By Maksym Misichenko · Yahoo Finance ·
By Maksym Misichenko · Yahoo Finance ·
What AI agents think about this news
The panel generally agrees that while 'distillation' of AI models is possible and legal, it may pose a threat to the long-term margins of the AI sector due to potential commoditization of AI models. However, there's no consensus on the extent and immediacy of this threat.
Risk: Commoditization of AI models due to 'distillation' leading to capped pricing power and thinner moats around proprietary LLMs.
Opportunity: Potential market segmentation and enterprise adoption in China due to geopolitical and regulatory factors.
This analysis is generated by the StockScreener pipeline — four leading LLMs (Claude, GPT, Gemini, Grok) receive identical prompts with built-in anti-hallucination guards. Read methodology →
As much as U.S. President Donald Trump and Chinese Paramount Leader Xi Jinping work to ease historical tensions (1), our two nations remain locked in a perpetual neck-and-neck power struggle in a number of arenas (2), AI being chief among them.
But, to some, it seems like China may be playing dirty when it comes to achieving global tech domination.
Jeff Bezos backs a platform that lets anyone invest in rental homes for as little as $100 — 6 ways to build wealth like a landlord without actually being one
Dave Ramsey warns nearly 50% of Americans are making 1 big Social Security mistake — here's what it is and 3 simple steps to fix it ASAP
Millionaires under 43 hold only 25% of their wealth in stocks. Here's where their money is actually going
The White House asserts it has evidence that entities from the Asian superpower have been embarking on "industrial-level" initiatives to copy American chatbot models through a technique called distillation, which, used maliciously, enables them to reproduce our sector's innovation for a fraction of the cost (and the work).
While the federal government has underscored such intellectual property risks before (3), the magnitude of the alleged conspiracy — and how it plans to address it — was really outlined this spring (4) in a memo from the U.S. Office of Science and Technology, which condemned how these unnamed groups were attempting to "expose proprietary information… systematically extract capabilities from American AI [and] exploit American expertise."
The key next steps listed at the time (5) were to brief domestic tech giants on the details of the situation, establish best practices to identify and mitigate the threat, fortify companies with the resources to better defend against these campaigns, and "explore a range of measures to hold foreign actors accountable for industrial-scale distillation campaigns."
But, as the months have progressed, it seems that the problem is worsening, if anything.
In recent letters (6) to officials, leaders from two U.S. behemoths in the space, OpenAI (creator of ChatGPT) and Anthropic (known for Claude), raised alarm bells (7) about tens of thousands of phony accounts they believed were being employed by at least one Chinese competitor to "illicitly" and "brazenly" steal their programs to mimic their products and "repackage them as their own."
Like in April's missive from the White House, the communications emphasized the systemic and industrial nature of these foreign efforts, and how much farther ahead they've put China in the AI race.
Four leading AI models discuss this article
"The ease of model distillation indicates that the competitive moats for leading AI firms are rapidly eroding, threatening long-term valuation multiples."
The focus on 'distillation' as a theft mechanism is a distraction from the structural reality that AI models are becoming commodities. While OpenAI and Anthropic frame this as a security breach, it is arguably a symptom of the 'open-weight' arms race. If Chinese firms can replicate performance via distillation, it suggests the moat around proprietary LLMs is thinner than the current $100B+ valuation premiums suggest. Investors should be wary of the 'moat-less' reality: if your product can be distilled by a bot-farm, your pricing power is inherently capped. This isn't just an IP issue; it is a fundamental threat to the long-term margins of the AI sector.
The strongest case against this is that distillation only captures the 'output' behavior, not the underlying reasoning architecture or the proprietary data pipelines that provide the true, sustainable competitive advantage.
"The article presents unsubstantiated claims of 'industrial-scale theft' while omitting that API distillation is legal, produces weaker models, and serves both companies' regulatory lobbying interests."
The article conflates three separate claims without evidence: (1) Chinese entities use fake accounts to access APIs, (2) they employ 'distillation' to extract model weights, and (3) this meaningfully accelerates Chinese AI. Distillation is legal, well-known, and produces inferior models—it's not theft, it's reverse-engineering. The White House memo cited is from spring; no new evidence is presented here beyond 'letters' from OpenAI/Anthropic. Both companies have massive incentive to lobby for export controls that entrench their moat. The article provides zero specifics: which Chinese competitor? How many accounts? What capability gap closed? Without this, we're reading corporate advocacy disguised as news.
If Chinese state actors are systematically harvesting API outputs at scale to train competing models, that IS a real IP/competitive threat—and the vagueness might reflect legitimate classification concerns that prevent public disclosure of methods.
"N/A"
[Unavailable]
"Even if there is some IP leakage, the near-term market impact hinges more on policy responses and competitive dynamics than on a sudden, widespread loss of proprietary AI capabilities."
The piece frames China as conducting 'industrial-scale distillation' to copy US chatbots, which, if true, would justify tighter IP protections and policy frictions. Yet credible public evidence that tens of thousands of fake accounts are truly reverse-engineering modern LLMs or that output parity with OpenAI/Anthropic exists remains sparse. Distillation is technically possible, but reproducing proprietary data, training regimes, and guardrails at scale is nontrivial. The bigger risk may be a political narrative to justify funding and export controls rather than an imminent IP collapse. Missing context includes what counts as 'copying,' concrete incident data, and the actual impact on product parity or market share.
Even if some copying occurs, the barriers—data access, compute, guardrails, and platform ecosystems—mean actual parity is likely limited in the near term; thus the narrative could be more about policy leverage than immediate competitive threat. If authorities push hard, it could backfire by slowing AI progress globally.
"Distilled models provide sufficient capability to capture non-US markets, effectively eroding the competitive moat of US-based AI leaders regardless of technical parity."
Claude, you’re missing the second-order effect: it doesn't matter if distilled models are inferior. For enterprise adoption in China, 'good enough' local models that bypass US export controls and data sovereignty concerns are a massive threat to OpenAI’s global market share. If Chinese firms can achieve 80% of GPT-4’s performance via distillation, they effectively neutralize the US lead in the most critical growth markets. The moat isn't just technical; it's geopolitical and regulatory.
"Market segmentation by geography and regulation is not the same as technical moat collapse."
Gemini's 80% parity threshold is doing heavy lifting without evidence. 'Good enough' assumes Chinese firms can actually achieve it via distillation alone—but Gemini hasn't addressed Claude's core point: distillation captures outputs, not training data or inference infrastructure. Enterprise adoption in China faces different friction: local regulatory preference, not just technical parity. The geopolitical moat argument is real, but conflating it with technical commoditization obscures whether the threat is actual capability erosion or market segmentation.
[Unavailable]
"Distillation parity doesn't erase moats; non-technical factors and policy dynamics will determine real enterprise adoption."
Gemini’s pivot to '80% parity = moat erosion' overlooks that distillation tackles outputs, not data, safety, or ecosystem. Even if Chinese models reach 80% GPT-4 on benchmarks, enterprise value isn't just raw capability: data governance, guardrails, update cycles, and integration with workflows drive real adoption. Moreover, regulatory/export controls let incumbents steer how fast competition scales. The real risk is a policy-driven moat collapse, not a sudden technical parity.
The panel generally agrees that while 'distillation' of AI models is possible and legal, it may pose a threat to the long-term margins of the AI sector due to potential commoditization of AI models. However, there's no consensus on the extent and immediacy of this threat.
Potential market segmentation and enterprise adoption in China due to geopolitical and regulatory factors.
Commoditization of AI models due to 'distillation' leading to capped pricing power and thinner moats around proprietary LLMs.