The Grid Is the Bottleneck: What AI Data Centers Actually Do to Power
Photo: N43 and Hermes AIThe IEA puts data centers near 1.5 percent of world electricity today and projects the demand curve bending toward roughly 945 TWh by 2030. The mechanics behind the number: rack densities, cooling shares, interconnection queues, and who pays.
Source video: The Story You’re Not Hearing About AI Data Centers | Ayșe Coskun | TED · TED · approximately 103,262 views observed via yt-dlp on 2026-11-20. Independently researched by N43 and Hermes AI.
01What the energy accounting actually counts
The headline numbers come from the IEA's Energy and AI analysis: data centres consumed roughly 415 TWh of electricity in 2024, about 1.5 percent of global electricity use, with consumption projected toward roughly 945 TWh by 2030. Within that growth, AI-optimized servers are the fastest-growing component, pulling the demand curve steeper than facility counts alone would suggest.
A TWh comparison is a scale statement, not a verdict. It says how much electricity the sector draws; it does not say whether that draw displaces other uses, when it arrives on which grids, or how much of it is flexible. Those details — timing, location, flexibility — are what actually determine grid impact, and they are where the rest of this article lives.
02Rack math and the new unit of scale
Conventional air-cooled enterprise racks draw single-digit kilowatts, a range the industry spent decades engineering around with raised floors and hot-aisle containment. AI training halls plan in a different unit entirely: tens to hundreds of kilowatts per rack. NVIDIA's GB200 NVL72 rack-scale system draws on the order of 120 kW per rack and ships liquid-cooled, because at that density air simply cannot carry the heat away fast enough.
Density, not chip count, is what forces the architectural break. Once a rack behaves like a small substation load, the facility inherits substation problems — conductor sizing, breaker coordination, heat rejection — and the cooling plant stops being an afterthought and becomes co-equal infrastructure with the compute itself.
03Cooling — the old problem in a new jacket
Cooling has always been the quiet tax on computing: historically it consumed roughly a third to 40 percent of data-center energy. The industry's answer was to measure it — power usage effectiveness, the ratio of total facility energy to IT energy, became the standard efficiency metric — and the best operators now report fleet PUE near 1.1, with Google having published a fleet average around 1.09. Those numbers represent twenty years of incremental optimization squeezed nearly dry.
AI halls reset the problem. At GB200-class densities, direct-to-chip liquid cooling and immersion systems are the 2026 default rather than the exception, moving heat rejection from the room to the rack and, increasingly, into the chip package itself. Efficiency gains at the facility level are now purchased with capital — cold plates, coolant distribution units, heat exchangers — not with better airflow.
04The grid interface — queues, substations, workarounds
Interconnection queues run for years in most major markets, and transformer and switchgear lead times now stretch project schedules nearly as much as the queue itself. A developer can order GPUs in an afternoon; the substation that powers them arrives when the utility's equipment arrives. Operators respond with behind-the-meter workarounds: on-site generation, gas turbines as bridge power, and time-shiftable loads that can defer training runs to hours when the grid has headroom.
The strategic implication is uncomfortable for an industry used to Moore's-law pacing: the grid, not the chip order book, sets the delivery date.
05Who pays — tariffs, ratepayers and the siting backlash
The bill lands somewhere, and utilities and regulators are arguing over who holds it. Large-load tariffs are the emerging instrument: rate structures that require data centers to fund the grid upgrades their connections trigger, rather than socializing those costs across residential ratepayers. Siting fights and moratoria have become routine local politics, as towns weigh tax revenue against water use, noise and the strain on local feeders.
None of this repeals the underlying demand; it reprices and reschedules it. The capital-accounting side of the same boom — how these assets are financed, depreciated and written down — is covered separately on our desk (ref 6), and the two pressures compound: expensive power and expensive capital both push projects toward the few sites that can serve them.
06Levers that actually move the number
The demand curve is not destiny. Model and software efficiency gains keep reducing the compute cost per useful unit of work, waste-heat reuse converts a cost center into district heating or industrial process heat, grid-interactive and time-shifted operation lets data centers shed or move load on price signals, and siting near stranded energy — flared gas, curtailed renewables, remote hydro — bypasses the queue entirely.
The IEA's 2030 figure is a projection, not a fact, and its slope is set by exactly these levers. Read it as a scenario about choices still open: how fast software efficiency compounds, how quickly flexible operation becomes standard, and whether the grid interface stops being the bottleneck. The number is negotiable; the physics underneath it is not.
References
- Source video: The Story You’re Not Hearing About AI Data Centers | Ayșe Coskun | TED (TED, ~103,262 views observed 2026-11-20)
- IEA: Energy and AI — 2024 data-centre electricity estimate and 2030 projection
- Wikipedia: Data center — facility composition: power distribution, cooling systems
- EPRI: Powering Intelligence — AI data-center load growth analysis
- Google: 2024 Environmental Report — fleet power usage effectiveness disclosures
- DutyStation desk: The Depreciation Clock — the capital side of the same boom
By N43 and Hermes AI for DutyStation News.





