Small Is Beautiful

Estimates are that, to justify the AI platforms' enormous capex plans, by 2030 they need to be generating around $2T/year in revenue. If every adult resident of the US spent $20/month on AI, it would generate $68.5B/year. Clearly, only the enterprise market stands even a remote possibility of generating the bulk of the $2T.

There are three major threats to the prospect of AI platforms extracting 6% of current US GDP from the enterprise market, and thus to OpenAI's and Anthropic's ambitions to IPO in the near future. First, faced with AI's Affordability Crisis, companies have been placing strict limits on employees' spending on AI tokens.

Source

Second, the gap in performance between expensive, closed-weight US models, such as OpenAI's and Anthropic's, and much cheaper, open-weight Chinese models has been rapidly closing, with the result that the US models are losing enterprise market share. Luz Ding, Spe Chen and Hayley Warren analyze this in US Lead in the AI Race With China Is Rapidly Narrowing:

Bloomberg in partnership with researchers at Vals AI, an independent AI evaluation and benchmarking platform, tested seven models from frontier Chinese and US companies to see how they performed in a real-world task. They were asked to create a fictional coffee e-commerce site called Brewberg using the same prompts. Most of the models scored 100% functional accuracy despite occasional design misses, but with very different price tags. The experiment employed the top performing models in July from Anthropic and all the Chinese firms, as well as more affordable models from OpenAI and Google.

They all did reasonably well, but the two best were Claude Fable 5 at $48.99 and Kimi K3 at $11.99. Chinese models charging much less for almost the same performance are grabbing market share:

the use of Chinese models overtook US platforms globally for the first time in June, and accounted for more than 60% of market share last month, on OpenRouter, a tech platform that offers software developers access to hundreds of AI models. It is a widely watched gauge of model usage despite tracking just a fraction of global AI consumption. The US, parts of Europe and Asia now favor Chinese labs, according to the same data.

On Hugging Face, Chinese AI models account for 41.4% of generative model downloads among developers, 5 percentage points higher than US models.

Third, it isn't just that the Chinese models are cheaper to run remotely, but also that because they are open-weight they can be run on affordable in-house systems, which means that:

• They don't give Donald Trump a kill-switch for your busines.
• They don't give Sam Altman or Dario Amodei a kill-switch for your busines.
• They don't require giving the Chinese, Sam Altman or Dario Amodei all your business' critical data.
• They provide visibility into and control over AI costs.
• They are even cheaper.

The question is "compared to the closed-weight US models, what do you lose by running open-weight models in-house?" Below the fold I discuss a major study from Stanford that answers the question.