Main AI News
Main AI News

China’s AI Giants Put $35 Billion on Nvidia’s Waiting List—and Expose the New Compute Bottleneck

ByteDance, Alibaba and Tencent have ordered more than $35 billion of Nvidia workstation GPUs that are legal to ship to China. The catch: supply is likely to cover only a sliver of demand, turning inference hardware into the latest choke point in the AI market.

ShareWhatsAppXFacebook

# China’s AI Giants Put $35 Billion on Nvidia’s Waiting List—and Expose the New Compute Bottleneck

*October 21, 2026*

ByteDance, Alibaba and Tencent have placed orders worth more than $35 billion for Nvidia’s RTX PRO 5500 graphics cards, according to a Reuters report published October 20↗. The number is arresting. The more consequential detail is less glamorous: the orders are for workstation-class chips, not the frontier data-center parts that normally define the AI arms race.

That is not a retreat from AI spending. It is a hard-nosed adaptation to it.

U.S. restrictions keep Nvidia’s Blackwell-based B300 data-center processors out of China, while access to the preceding H200 generation is tightly controlled. The three Chinese platforms are therefore buying the equipment they can legally buy in volume, chiefly to run models rather than to train the biggest new ones. Reuters reported that the orders exceed 3 million GPUs. Supply, however, is expected to be much smaller than the demand. What looks like a giant purchase order is also a reservation queue.

The episode sharpens a change that has been easy to miss amid the parade of model launches: inference capacity—not just frontier training capacity—is becoming the commercial battlefield. The companies that can put enough serving hardware behind chat, search, advertising, video and enterprise products will have a material advantage. The firms stuck rationing compute may have excellent models and nowhere economical to run them.

China’s biggest internet companies are not merely shopping for chips. They are buying an option on keeping their AI products responsive when demand becomes real.

A $35 Billion Order Book Is Not a Delivery Schedule

The RTX PRO 5500 is an unusual protagonist for a geopolitical story. It is a professional workstation product, not the rack-scale accelerator one would choose for a giant pre-training cluster. That distinction is precisely the point. Running a trained model—answering prompts, ranking feeds, generating ads, translating text or serving an enterprise agent—has different hardware demands from assembling a vast training supercomputer.

Reuters’ reporting says ByteDance, Alibaba and Tencent are using the cards as an export-compliant route to inference capacity. The scale of their demand makes the distinction almost academic. Three million GPUs at a reported sticker value above $35 billion signals a serious scramble to secure serving capacity for domestic products and cloud customers.

The immediate constraint is manufacturing allocation. The reported order volume is larger than the near-term availability tied to this product line, and Nvidia has warned customers that only a small portion may be fulfilled. That means the headline figure should not be read as booked revenue, nor as a guarantee that China will receive a new fleet overnight. It is better understood as a measure of unmet demand.

What the order reveals

  • The market has moved downstream. Export controls most directly constrain the chips used to train the largest models, but consumer and enterprise AI services burn compute every time a user interacts with them. Serving millions of users every day can become a larger operational problem than one training run.
  • Compliance has become product strategy. A GPU’s appeal is now partly defined by whether it clears the export-control line. That gives hardware configuration and legal classification an importance that used to belong mainly to performance-per-watt charts.
  • Allocation is the new pricing power. If supply can cover only a fraction of demand, the winner is not simply the company with the best list price. It is the customer with manufacturing access, deployment sites, power, software and enough capital to carry inventory.

That last point is the uncomfortable one for would-be Nvidia challengers. Restrictions may redirect purchasing toward alternate products, but they do not automatically create a substitute ecosystem. Nvidia’s advantage remains a package: chips, the CUDA software stack, systems integration, developer familiarity and a supply chain capable of building at scale. The search for permissible hardware may broaden the market. It does not magically make the market less concentrated.

Export Controls Are Rewriting the Demand Curve

Washington has spent years attempting to block Chinese access to the most capable AI accelerators. In May, the U.S. moved to stop shipments to Chinese firms’ overseas subsidiaries, a step aimed at closing a long-discussed transshipment route. That policy move is documented in Reuters’ report on the controls↗. The policy logic is simple: restricting the most capable chips should slow the construction of frontier training clusters.

Commercial reality is less tidy. Restrictions create substitution demand. If a company cannot buy the preferred data-center chip, it can buy more of an available product, change its model architecture, use quantization, spread workloads across more machines or focus on the less compute-intensive parts of its business. Each workaround has costs. None is the same as surrendering the market.

That is why the RTX PRO order wave matters beyond its dollar figure. It shows China’s platforms responding to supply constraints with a deployment strategy, not waiting for a policy reversal. They are preserving their ability to serve models at scale—even if the economics and engineering are messier than they would be with unrestricted access to Nvidia’s top systems.

The barriers are real. Reuters previously reported↗ that restricted B300 servers were being offered in China at around $1 million per system, roughly double U.S. pricing, an illustration of how scarcity converts silicon into a geopolitical premium. Read alongside the new orders, the message is clear: legal alternatives are valuable precisely because the gray-market alternative is expensive, risky and unreliable.

The policy fight is no longer about whether China wants advanced compute. The order book answers that. It is about which class of compute gets scarce, who absorbs the inefficiency, and how long domestic substitutes take to close the gap.

Beijing has tools of its own. China has considered expanding export restrictions to dozens of technologies spanning AI, biotech and solar, as Reuters reported on October 16↗. It also has leverage in materials. China’s control over indium, used in indium-phosphide components for high-speed optical links, has already raised concerns about data-center buildouts; Reuters detailed that supply-chain pressure↗. Accelerators may get the headlines, but a data center without networking components, power equipment and grid connections is just a very expensive room.

The Inference Race Has Different Winners

For ByteDance, Alibaba and Tencent, the prize is not a single benchmark result. It is control over the distribution channels where AI becomes revenue.

ByteDance can place models inside recommendation, creation and advertising products with massive existing reach. Alibaba operates a cloud business and an e-commerce system where merchants can be sold AI tools as operating infrastructure. Tencent can put AI into messaging, gaming, cloud and enterprise software. The demand for inference capacity is therefore not an abstract hedge. It is connected to applications that already have users, data and sales teams.

That is also why the order concentrates among the biggest companies. A smaller lab may be able to build or license a competitive model. It cannot as easily finance a hardware reserve measured in tens of billions, secure racks, obtain power, recruit deployment engineers and keep utilization high. The constraint rewards distribution and balance sheets.

Who stands to gain—and who has a problem

  • Nvidia remains commercially central even where its flagship products cannot be sold. Export-compliant demand extends the company’s relevance, though fulfillment limits may prevent it from converting every order into near-term revenue.
  • China’s largest platforms gain a hedge against service bottlenecks. Hardware availability can matter as much as model quality when a product must answer users quickly and cheaply every minute of the day.
  • Domestic Chinese chip suppliers gain a clearer opening, but also a brutally high bar. Their chips must compete not only on raw performance but on software compatibility, supply certainty and the ability to support giant production fleets.
  • Smaller AI companies face the least forgiving terrain. They may access cheaper models or rented capacity, but they do not command the same procurement leverage or captive distribution.

The last group should worry. Recent competition in Chinese models has pushed down headline pricing, as Reuters noted in its examination of low-cost Chinese AI offerings↗. Cheaper model APIs are good for customers. They do not erase the cost of serving large workloads. In fact, price pressure can make high utilization even more valuable: when model output is cheap, the operator with the lowest all-in infrastructure cost has more room to cut prices without destroying margins.

Alibaba’s own posture shows the tension. It has pushed aggressively into open-model distribution while exploring ways to charge the largest commercial users; Reuters reported in August↗ that the company planned revenue-sharing terms for big users of a future open-source model. The strategic goal is plain: use openness to broaden adoption, then make scale customers pay for the economic value they extract. Hardware scarcity makes that monetization logic more urgent, not less.

Compute Is a Physical Business Again

There is a temptation to treat AI as a software contest because the products arrive as chat windows and APIs. This week’s news is a reminder that the margin structure is being set by physical constraints: wafers, packaging, optical components, racks, substations and financing.

Even outside China, those constraints are becoming harder to ignore. A Reuters analysis last week↗ described how rising rates and market volatility are testing the AI data-center deal boom. That matters because capacity is not useful merely when a chip leaves a factory. It is useful when it is installed, powered, networked and utilized.

Microsoft’s effort to deploy more of its own AI chips—reported by Reuters this month—offers a useful comparison. Custom silicon is not a declaration that Nvidia has suddenly become optional. It is a recognition that hyperscalers need more control over cost and supply for recurring workloads. The reported deployment plan↗ is the cloud incumbent’s answer to the same structural problem confronting Chinese platforms: inference at scale cannot be run indefinitely as a premium, externally priced exception.

The Real Signal: Scarcity Is Moving Closer to the User

The October 20 orders do not mean China has solved its compute challenge. They do not mean Nvidia will ship every requested card. And they do not nullify the advantage conferred by access to frontier training chips.

They do establish something more immediate: AI’s next bottleneck is arriving at the serving layer. The industry can debate which model tops the next benchmark. The companies with the clearest economic edge will be the ones able to translate models into cheap, reliable, high-volume products.

For now, the biggest Chinese platforms are trying to buy that option in bulk. Nvidia is still selling the tools—within the rules. And everyone else is learning the same lesson: in an AI market shaped by export controls and capacity limits, a model is not a business until it has somewhere to run.

#AI infrastructure#Nvidia#China#AI inference#export controls#ByteDance#Alibaba#Tencent
Marcus Okafor
Marcus Okafor

🇺🇸 Industry & Business Editor · San Francisco, USA

Follows the money, the deals, and the power moves behind the models.

Comments

Open discussion — no account needed. Be respectful.

0/4000
Loading comments…