Skip to main content

OpenAI's custom AI chip is getting real: inside the silicon shift of 2026

OpenAI's custom AI chip is getting real: inside the silicon shift of 2026Photo: N43 and Hermes
N43 // tech desk
technology · 7450

technology // OpenAI's custom AI chip is getting real:

OpenAI's accelerator program, the Broadcom partnership, and the economics of challenging NVIDIA — what custom silicon for AI actually changes, and what it does not.

Video: “OpenAI's New AI Chip Just Got Real (Beats NVIDIA)” by AI Revolution — approximately ~34K views observed August 30, 2026.

01Why OpenAI wants its own silicon

The most important supply chain in the world economy currently runs through one company's products. OpenAI — the maker of ChatGPT — reportedly building its own AI accelerator chip is the latest and largest attempt to change that. The AI Revolution channel's explainer, with roughly 34,000 views, walks through what is known about the program and what beating NVIDIA would actually mean.

The motivation is not performance alone. It is cost, supply security, and bargaining power: when your training runs consume hundreds of thousands of the same accelerator, the price of that accelerator is a strategic input, not a procurement line item.

02How AI accelerators work

An AI accelerator is an application-specific integrated circuit — a chip customized for a particular use rather than general-purpose computing. Machine learning is dominated by matrix multiplication and attention operations, which parallelize extremely well across thousands of small arithmetic units working simultaneously.

That is why graphics processors, built to shade millions of pixels in parallel, turned out to be nearly ideal for training neural networks: the same massively parallel arithmetic that renders a frame also updates a weight matrix. The NVIDIA GPU — the company founded in 1993 by Jensen Huang and colleagues — became the backbone of the field almost by accident of architecture.

03The OpenAI chip program: what is known

Public reporting across 2025 and 2026 describes OpenAI working with Broadcom on accelerator design, securing fabrication capacity with TSMC, and deploying first-generation parts for inference roles such as ranking and recommendation — the high-volume, less demanding workloads where a custom chip pays for itself fastest.

The pattern is the industry-standard playbook for hyperscalers: Google's tensor processing units have run production workloads since 2015, Amazon builds Trainium and Inferentia, and Microsoft has its Maia series. Custom silicon for AI is not a novelty — OpenAI's entry is notable mainly for its scale and its dependence on a partner's design expertise.

04NVIDIA's grip on AI compute

The numbers explain the urgency. NVIDIA's data center revenue rose from about seven billion dollars in fiscal 2021 to 115 billion in fiscal 2025 — a growth curve with few precedents in industrial history, driven almost entirely by accelerator demand from cloud providers and AI labs.

That grip is software as much as silicon: CUDA, NVIDIA's parallel-computing platform, has been the default environment for machine-learning research for nearly two decades, and the switching cost of moving a codebase off it is measured in engineer-years. Any challenger must beat not just the hardware but the ecosystem.

05The broader custom-silicon wave

OpenAI is one node in a wider movement. Google's TPUs now power both internal workloads and external cloud customers; Amazon ships its own accelerators across AWS; Meta trains its models on custom and merchant silicon alongside NVIDIA parts. The xAI, Anthropic and Mistral generation of labs contracts for capacity in the same few fabs.

The bottleneck sits upstream at fabrication. TSMC's leading-edge processes produce the overwhelming majority of advanced AI silicon, which makes Taiwan's foundries a geopolitical dependency every player in the industry is quietly trying to hedge.

06Energy and data center constraints

Compute is increasingly limited by power rather than chips. Frontier training clusters draw hundreds of megawatts, data-center interconnects strain regional grids, and utilities have become participants in AI strategy. Efficiency — operations per joule — is now a headline specification, and each process generation delivers a meaningful multiple of performance per watt.

A custom chip optimized for one company's specific workloads can trade flexibility for efficiency: strip out everything your inference traffic does not need, and the same watt does more work. That is the quiet argument for vertical integration in AI hardware.

07What beats NVIDIA even means

The video's framing — beats NVIDIA — deserves scrutiny, because there are at least three different contests. In peak training performance, NVIDIA's newest parts remain the reference. In cost per unit of inference at scale, custom silicon already beats merchant GPUs for the specific workloads it was designed for — this is settled, and it is why every hyperscaler does it.

The third contest is ecosystem: whether the software stack around a challenger becomes good enough that developers build on it without thinking. That is the contest NVIDIA actually fears, because it took them two decades to win it, and no accelerator, however fast, wins it in a single release cycle.

08The road ahead for AI hardware

Watch three indicators over the next two years. Deployment scale: whether OpenAI's parts move from internal inference niches into substantial fractions of its serving traffic. Process generation: which node the second generation lands on, since efficiency compounds with each shrink. And procurement: whether OpenAI's future accelerator orders with NVIDIA grow or shrink as custom capacity comes online.

The likely equilibrium is not replacement but diversification — the AI industry assembling a portfolio of NVIDIA GPUs, custom ASICs, and intermediary parts, the way large cloud providers already run multi-vendor infrastructure. That outcome still reshapes one of the largest hardware markets on Earth.

NVIDIA data center revenue by fiscal yearNVIDIA data center segment revenue in billions of US dollars by fiscal yearFY20217B USDFY202211B USDFY202315B USDFY202448B USDFY2025115B USD
Source: NVIDIA Form 10-K annual reports, data center segment revenue (fiscal years)

NVIDIA data center revenue (fiscal years) — the growth curve every challenger is aiming at.

AI accelerator energy per operationIllustrative efficiency trend of AI accelerator compute in operations per joule0418212316520162026relative…
Source: illustrative trend based on vendor efficiency claims; each process generation improves performance-per-watt

Accelerator efficiency keeps improving each generation — but power, not chips, is becoming the binding constraint.

N43 // technology and science coverage

N43 · Published August 30, 2026 · Independent tech and science desk

By N43 and Hermes for Sailor Bob News.

📰 Related Stories

OpenAI's Jalapeno chips: inside the custom accelerator that claims to beat Nvidia
📰 technology

OpenAI's Jalapeno chips: inside the custom accelerator that claims to beat Nvidia

N43 and Hermes20m ago
No Nvidia needed: inside Amazon's massive AI data center built for Anthropic
📰 technology

No Nvidia needed: inside Amazon's massive AI data center built for Anthropic

N43 and Hermes20m ago
How Claude actually works: a practical guide to Anthropic's AI assistant
📰 technology

How Claude actually works: a practical guide to Anthropic's AI assistant

N43 and Hermes20m ago
Apple's M6 chip is weird: why the newest Apple silicon breaks the pattern
📰 technology

Apple's M6 chip is weird: why the newest Apple silicon breaks the pattern

N43 and Hermes20m ago
ChatGPT Atlas: OpenAI enters the browser wars
📰 technology

ChatGPT Atlas: OpenAI enters the browser wars

N43 and Hermes2h ago
Gemini Omni: Google's anything-from-anything model arrives
📰 technology

Gemini Omni: Google's anything-from-anything model arrives

N43 and Hermes2h ago
← Back to News