← Back to Library

AI is bottlenecked by the grid

This isn't a story about artificial intelligence hitting a software wall; it is a stark warning that our physical infrastructure cannot keep pace with digital ambition. Works in Progress delivers a crucial, often overlooked reality check: the most expensive projects in history are stalling not because of code, but because of copper and concrete. The piece argues that while we obsess over model parameters, the real constraint is the ability to plug these massive data centers into a grid designed for a bygone era.

The Physical Limit of Digital Growth

The editors anchor their argument in the sheer scale of new demand, pointing to the Stargate project in Abilene, Texas. This joint venture between OpenAI and Softbank is expected to cost over $40 billion, yet its success hinges on a single metric: electricity. Works in Progress reports that "Stargate is expected to draw 1.2 gigawatts, as much as 313,000 median American family homes, at peak load." This comparison instantly contextualizes the abstract concept of "compute power" into something tangible for any reader familiar with household energy bills.

AI is bottlenecked by the grid

The article makes a compelling case that this is not an isolated incident but a systemic trend. It notes that total AI computing power could reach 100 gigawatts worldwide by 2030 if current growth rates hold. The bottleneck, the piece insists, is not a lack of generation capacity but the inability to connect it. "The primary bottleneck to this growth is the availability of electricity," the editors state, clarifying immediately that "this doesn't mean there is an energy shortage." Instead, the constraint is the interconnection queue.

This framing is vital because it shifts the debate from ideological battles over nuclear versus solar to the mundane, bureaucratic reality of grid management. The median wait time for a new power plant to connect jumped from less than 20 months in 2005 to 55 months by 2023. This delay creates a perverse incentive structure where speculative projects clog the line, preventing high-value infrastructure from coming online.

"The abundance of [AI] will be limited by the abundance of energy."

The Grid's Broken Queue

Works in Progress dissects the mechanical failure of the current system with surgical precision. The interconnection process was designed for a time when electricity use grew steadily and predictably, not for an explosion of demand from data centers and battery plants. The editors note that grids currently use an "inflexible first-come, first-served queue that leaves some of the most valuable projects stuck behind less important ones."

This rigidity has led to a situation where 72 percent of connection requests submitted since 2000 were ultimately withdrawn. The system is so clogged with phantom projects and duplicative applications that it paralyzes genuine development. The piece highlights that in ERCOT, the grid covering most of Texas, there are 143.5 gigawatts of data centers seeking to connect against a peak demand of only 85.9 gigawatts. This backlog is not just an administrative nuisance; it is a direct threat to economic growth.

The consequence of this delay is already visible in the market. Because grid power is unavailable or too slow to access, developers are turning to off-grid solutions. The article cites xAI's Memphis data center, which "operated partially off-grid for months" by installing 422 megawatts of on-site gas turbines because it could only draw eight megawatts from the grid initially. This is a temporary fix that increases costs and reduces reliability, yet it is becoming the norm. The editors warn that "62 percent of data centers are considering off-grid solutions," signaling a potential fragmentation of our energy infrastructure.

Critics might argue that focusing on interconnection delays ignores the broader need for massive new transmission lines, which face their own permitting nightmares. However, Works in Progress correctly identifies that even if we build the lines tomorrow, the current queue process will still prevent them from being utilized efficiently. The administrative bottleneck is a prerequisite to solving the physical one.

Market Signals vs. Regulatory Reality

The piece offers a nuanced look at how electricity markets are supposed to work versus how they actually function. In theory, prices should signal where new capacity is needed. "Market prices signal to power plant developers about levels of supply and demand," the article explains. When solar output increases, prices drop during sunny hours, signaling a need for storage. This mechanism has successfully driven battery deployment in places like ERCOT and California.

However, the editors point out that these signals are increasingly distorted by regulation. "Grid infrastructure... is generally planned by the grid operator, and the cost is passed on to consumers at a price approved by state and federal regulators." This disconnect means that while market forces encourage new generation, regulatory caps on wholesale prices can make those generators unprofitable. The result is a reliance on "must-run agreements" where utilities pay plants to stay online simply to maintain reliability, bypassing the competitive market entirely.

Furthermore, policy interventions like tax credits for renewables have created paradoxical pricing. The article notes that some wind farms offer power at negative prices because they receive subsidies regardless of demand. While this encourages green energy adoption, it complicates the market signal for other types of generation needed to ensure stability during peak loads or when the sun isn't shining.

The core argument here is that "arguing about the best power generation method is overrated." The editors assert that well-designed markets would automatically determine the optimal mix of gas, nuclear, and renewables based on cost and reliability. The real failure lies in the inability to connect these diverse sources to the grid efficiently. "Far more fundamental is ensuring power can be efficiently delivered where needed," they write, dismissing the technology wars as a distraction from the infrastructure crisis.

"We need capacity – a lot of capacity."

Bottom Line

The strongest part of this argument is its refusal to get bogged down in the culture war over energy sources; instead, it exposes the bureaucratic inertia that threatens to stall the entire AI revolution and broader electrification. The piece's biggest vulnerability is that while it clearly identifies the interconnection queue as the primary blocker, it offers fewer concrete solutions for how to reform a system deeply entrenched in state-level regulations and legacy utility models. Readers should watch for whether grid operators can successfully implement the proposed reforms to prioritize high-value projects over speculative ones before the backlog becomes irreversible.

Deep Dives

Explore these related deep dives:

  • PJM Interconnection

    This article details the specific bureaucratic mechanism causing the 55-month delays mentioned in the text, explaining how a 'first-come, first-served' system creates artificial bottlenecks for AI infrastructure.

  • Exowatt

    The author argues that current rules fail to reward projects willing to cover their own power needs; this technical concept explains the specific market failure preventing data centers from bypassing grid constraints through on-site energy solutions.

Sources

AI is bottlenecked by the grid

Issue 24 of Works in Progress has now arrived with subscribers. Sign up here to receive this issue, plus another every two months – straight to your door.

One of the most expensive projects in history is under construction in Abilene, Texas. This joint venture, Stargate, is the flagship of a bigger project by the same name led by OpenAI and Softbank, and is expected to cost well over $40 billion for a high-performance computing campus that will train new generations of AI models.

Stargate is just one major project in one of the biggest investment booms in history, driven by the belief that increasingly powerful AI models can deliver explosive economic growth. But it will require enormous amounts of electricity to work: Stargate is expected to draw 1.2 gigawatts, as much as 313,000 median American family homes, at peak load. A report by EpochAI and an energy research institute projected that total AI computing power would reach 100 gigawatts worldwide in 2030 if the 2025 growth rate stays steady. And data centers aren’t the only energy-hungry element of the AI revolution. The biggest battery manufacturing plants in the US draw energy at a rate of 115 megawatts, and the first phase of TSMC’s Arizona semiconductor plant will draw 200 megawatts.

The primary bottleneck to this growth is the availability of electricity. But this doesn’t mean there is an energy shortage. Instead, the constraint is connecting the flood of new data centers and the plants to power them to the electric grid. Before any new piece of infrastructure can be connected, grid operators must study how it will change power flows around the grid and determine whether upgrades to the system are required. That process is significantly backlogged. Though the median power plant in 2005 waited less than 20 months for interconnection, this had jumped to 55 months by 2023.

The interconnection process wasn’t created for today’s world. Grids use an inflexible first-come, first-served queue that leaves some of the most valuable projects stuck behind less important ones. They also evaluate according to rigid conditions that don’t reward plants for being willing to cover their own power needs for short periods. To prepare for the AI age, grid processes need to change.

A power-hungry future.

Estimates vary for how much power will be needed by the data centers and chip manufacturers of the future, but the heads of every major ...