America's Biggest Power Grid Operator Has an AI Problem - Too Many Data Centers (msn.com) 61
America's largest power-grid operator, PJM, which delivers electricity to 67 million people across a 13-state region from New Jersey to Kentucky, is approaching a supply crisis as AI data centers in Northern Virginia's "Data Center Alley" consume electricity at an unprecedented rate.
The nonprofit expects demand to grow by 4.8% annually over the next decade. Mark Christie, former chairman of the Federal Energy Regulatory Commission, said the reliability risk that was once "on the horizon" is now "across the street." Dominion Energy, the utility serving parts of Virginia, has received requests from data-center developers requiring more than 40 gigawatts of electricity -- roughly twice its Virginia network capacity at the end of 2024. Older power plants are going out of service faster than new ones can be built, and the grid could max out during periods of high demand, forcing rolling blackouts during heat waves or deep freezes.
In November, efforts to establish new rules for data centers stalled when PJM, tech companies, power suppliers and utilities couldn't agree on a plan. Monitoring Analytics, the firm that oversees the market, warned that unless data centers bring their own power supply, "PJM will be in the position of allocating blackouts rather than ensuring reliability."
The nonprofit expects demand to grow by 4.8% annually over the next decade. Mark Christie, former chairman of the Federal Energy Regulatory Commission, said the reliability risk that was once "on the horizon" is now "across the street." Dominion Energy, the utility serving parts of Virginia, has received requests from data-center developers requiring more than 40 gigawatts of electricity -- roughly twice its Virginia network capacity at the end of 2024. Older power plants are going out of service faster than new ones can be built, and the grid could max out during periods of high demand, forcing rolling blackouts during heat waves or deep freezes.
In November, efforts to establish new rules for data centers stalled when PJM, tech companies, power suppliers and utilities couldn't agree on a plan. Monitoring Analytics, the firm that oversees the market, warned that unless data centers bring their own power supply, "PJM will be in the position of allocating blackouts rather than ensuring reliability."
Economics 101 (Score:4, Insightful)
Re: (Score:3, Insightful)
Re:Economics 101 (Score:5, Interesting)
We do, indeed, pay massive connection fees, and usually pay for the required build-out on top of that.
We do, however, pay a significantly cheaper rate than residential customers.
MS, at least, is offering to pay residential price for their electricity, which should probably become the norm for these datacenters that aren't hosting other people's infrastructure.
Re: (Score:3, Insightful)
I don't see why people who live there should have to pay more so people on the other side of the world can generate Emma Watson pr0n.
Re: (Score:2)
However, utilities are also in it to make money, and we have money to give them.
I think "the fairness of capitalism" is perhaps a larger scoped problem.
I wonder if you feel the same way about whatever local industry exists where you live.
"I don't see why my air needs to stink so people on the other side of the country can eat chicken."
I don't mean to dismiss your concern... only to say that "it's complicated."
Re: (Score:3)
Local industry actually produces something useful and provides jobs for the people who live there.
AI data centres provide very few jobs and are designed to eliminate jobs all over the world while also making Emma Watson pr0n.
It's the most absurd misallocation of resources I've ever seen in my life.
Re: (Score:2)
Re: (Score:2)
back in my day it was Natalie Portman, naked and petrified, covered in hot grits.
It was a simpler time.
Re: (Score:2)
Re: (Score:2)
Won't somebody PLEASE think of the Emma Watson pr0n!!!
Unfortunately, too many people are already thinking of this.
Re: (Score:2)
Usefulness is in teh eye of the beholder (or the payer).
Your entire argument can be summed up as: "I don't find datacenters useful, therefor bad."
That's not an argument. It's a value judgement.
Jobs? (Score:3)
After a datacenter is built and operational, the number of new jobs are trivial and mostly low-paid.
As one example, our "primary" (not really any such thing anymore, it was just the first) in Santa Clara operates about 150K sq ft. Unless they are building a new cage or doing other significant work, there are two employees on site - the security person and a guy that ha
Re: (Score:3)
I don't operate any commercial data centers, but I occupy cages in 14 of them, and have been working with data centers for over 30 years.
Excellent. 20 years here. We also have cages in 6 or so non-self-operated DCs for national PoPs.
After a datacenter is built and operational, the number of new jobs are trivial and mostly low-paid.
This is completely untrue.
As one example, our "primary" (not really any such thing anymore, it was just the first) in Santa Clara operates about 150K sq ft. Unless they are building a new cage or doing other significant work, there are two employees on site - the security person and a guy that handles hands and eyes, shipping and random maintenance.
Then they have outsourced all of their facilities work, which is a shit-ton.
That's still providing jobs.
There's a manager somewhere, but not on site.
It is true that there is not normally a manager on-site.
However, there will be a facilities manager for the facilities crew for a group of local datacenters.
That's still providing jobs.
The intercom button goes to someone at a call center who is always terrible at connecting you back to the on-site security guy, which is the only reason to hit the button. The labor strategy was clearly designed by the same folks who staff groceries or fast food - minimize labor at all costs, and if it takes a customer paying 7 figures a month an hour to connect with someone there, well, what are they going to do about it?
Funny enough- you have very closely described my experience with CoreSite in LA, but the exact opp
Re: (Score:2)
After a datacenter is built and operational, the number of new jobs are trivial and mostly low-paid.
This is completely untrue.
I assume you are calling it untrue based on datacenters that are regularly undergoing changes and upgrades. I feel that these AI datacenters are more like traditional Telecom CO, you build it, connect everything and only return for maintenance. Maybe I'm wrong but even AI says these data centers only need monthly, quarterly, and yearly maintenance.
Re: (Score:2)
Funny enough- you have very closely described my experience with CoreSite in LA, but the exact opposite of my experience with Hurricane Electric up in Fremont.
There are a lot fewer people working in that building (HE Fremont 2) than when it was an Apple factory.
Re: (Score:2)
I won't say that a single data center fully occupies an entire facilities team, but it adds to its occupation, and you definitely don't just have one (if you want to maintain your uptime)
I'm not trying to say that the datacenter is, in itself, full time employment for a massive team of people, but it contributes to the reason they have jobs.
We keep between 6 and 12 guys in each area we have a cluster of datacenters for facilities, another 6 guys in each are
Re: (Score:2)
If Apple were to build a factory there today? Maybe not.
Re: (Score:2)
> Data centers provide many jobs. Like I said, I operate 6 of them.
So what you're saying is there could be at least 5 more job openings...
=Smidge=
Re: (Score:2)
I mean I have a senior managerial and engineering role in an organization that does.
Re: (Score:2)
I think "the fairness of capitalism" is perhaps a larger scoped problem.
There's also the more functionally important question of the efficiency of market dynamics. In a perfectly functioning market, raising electricity prices would entice new producers and vendors. However, that doesn't happen in our electricity market because of obstacles to new producers or existing producers who wish to increase production. These obstacles are a combination of government regulations, technology, supply chain, financial, and location (where to plug into the grid, which locations are feasib
Re: (Score:2)
Re: Economics 101 (Score:2)
We did this with industry. Do we do this again with datacenters? Tough choice...
Re: (Score:2)
Re: (Score:2)
Re: (Score:2)
Re: (Score:2)
Build-out for us is installation of multi-megawatt transformers (that are owned by the utility and stay after we're gone- they're not ours) near or on the property, and upgrades to the transmission lines feeding them. In one property, we had to pay for the building of an entire substation.
That is separate from the connection fee for a multi-megawatt connection.
I also think it is probably a little bit disinge
Re: (Score:1)
We do, however, pay a significantly cheaper rate than residential customers.
That is often for a good reason. A foundry I did some work for got their rates much cheaper because they owned the transformers and switch gear. The utility company fed them directly from the same HV line that powered the substations and that's all that they were responsible for. Anything after the end of those wires was the foundry's problem to deal with. So they kept a few million bucks worth of spares for those on site because some of it was non-US voltage and took a minimum of 18 months to get a repla
Re: (Score:2)
One of our DCs required we pay for the construction of a substation- 30MW. I bet still small peas next to a foundry's induction furnace.
What it takes to feed those induction furnaces made the hair on the back of my neck stand up lol
What freaks me out more about our "big one" is the room with the batteries. I don't know why... but megawatts of DC supply gives me the heebie jeebies.
Re: Economics 101 (Score:2)
Anything that uses over a certain percentage of power for said plant should be directly charged for infrastructure upgrades required to deliver it.
Telecoms do that already - you want a special fiber line, shoot you want a connection to an area that isnâ(TM)t yet served - you pay up front for that connection. Iâ(TM)ve seen Comcast charge $10k to extend their service to a new neighborhood.
Re: (Score:2)
It's more than that: "Older power plants are going out of service faster than new ones can be built,". It's timing. This is a SUDDEN increase in requirements. ("Sudden" relative to the time required to build new facilities.)
Re: Economics 101 (Score:2)
Just tell the data centers that they need to have their own power plants
So that's not exactly how it works (Score:3)
So a reliable consumer like a business is more desirable than an unreliable consumer like a individual person.
In Practice this means that they're going to prioritize business customers over you and they are much more likely to raise your rates than business rates.
Because electricity tends towards Monopoly we do have regulations in place to limit that but well, we've been fighting those dastardly bureaucrats for the las
Re: (Score:2)
There will come a time that you, the consumer, will not get any power from the grid, no matter how much you want to pay. Energy-security, that will be the result of AI in datacenters in their current form.
AI, in its current form, deserves to die in the biggest bubble implosion man ever knew or should want to know. AI, as a technology can be a boon for consumers. Its current form sure isn't it.
But it won't be an electricity problem alone. Datacenters tend to consume a lot of water too for cooling. And once t
Re: (Score:1)
Re: (Score:2)
Just charge like water, use more pay more (Score:4, Interesting)
I don't understand why heavy users aren't charged more, like water. In my town water usage is tiered, and those upper tiers charge you a lot more per gallon than if you conserve. C'mon, electric company, do the same, and make those upper tiers juicy and you can finance yourself into great infrastructure upgrades (think power lines in forests that for some reason catch fire frequently). Those AI companies are flush with inventory money, they can afford it, fleece the fuck of them for taking our electricity to do their stupid AI shit.
Re: (Score:3)
Our bulk connection rate is so much cheaper than individual rate that we don't even individually charge units. It goes into the COA dues, and is basically a rounding error.
You are right, that within a class, the more you use, the more you pay- however, people who have bulk connections pay cheaper in water, and in electricity.
Re: (Score:2)
It depends on where you are, from a resource cost (fuel cost) point of view. Out here in the Pacific Northwest, our "fuel cost" is nearly zero. Because it's primarily hydroelectric. What is expensive is the capital cost of the grid infrastructure but needed to serve each customer's peak demand. But politicaly, it was advanageous to "convert" those charges to an equvalent energy consumption fee. Dollars per kilowatt-hour. In order to prevent a tragedy of the commons. "I"'ve paid my fee for peak use this mont
Re: (Score:2)
Re: (Score:2)
Re: (Score:2)
Corporations are more important than people.
Simplest Solution (Score:2)
If takes half of power plant's output to drive a datacenter, then they can damn well pay for the plant.
Don't let them connect to the grid until they do. Or, require that they be able to generate most of their power locally, either onsite or at a nearby site.
These are billion-dollar investments. Make them buy or build their facilities in way that doesn't affect the state/county/local population.
Im on PJM supply, prices were crazy during summer (Score:2)
Re: (Score:2)
Re: (Score:2)
Get solar panels (Score:2)
If you possibly can. It's THE way to address peak demand problems and, with battery storage, a solution to continuity.
Re: (Score:2)
Peak demand is very local. Here it's winter nights. We also have temperature inversions that bring heavy overcast and dead calm and those conditions can easily last a week.
Other places have peak demand on those long sunny summer days. That set of conditions is an easy kill for solar.
Do this first (Score:2)
The any energy they need above and beyond that they pay the same as residential customers with tiering. You use more - you pay more. That's how both my electric and water utilities work. I don't get a break. They shouldn't either.
Siting and Permitting are the biggest hurdle (Score:2)
Re: (Score:3)
It's Texas.
The republicans rage on renewable energy, because it plays well on Fox, Rogan and Alex Jones. But that's just a distraction. It's a magician thing. You gotta pay close attention to what BOTH HANDS are doing if you want to know what's actually going on. Republicans hate renewable energy, but red-state businessmen are quietly installing renewable power as fast as they can manage it. It makes the most profit
Re: (Score:3)
Paying for this is the least of the problems (Score:4, Insightful)
The far more difficult problem set involves energy production, energy transmission, energy storage, energy use, water use, and pollution. And a sober evaluation of those in this context would lead any reasonable person to conclude that massive data center expansion is not a good idea, no matter who agrees to pay how much for it. The problem is: these people aren't reasonable. They want to keep chanting "AI! AI! AI!" like a mantra, keep claiming it'll fix everything from diabetes to highway congestion, and keep plowing ahead with these reckless plans no matter what the consequences are.
And that will work out just fine for them because they won't be the ones bearing the consequences. We will.
I suspect a lot of those (Score:2)
I'm gonna bet that the form fo
Easy solution: (Score:2)
PJM commits to keeping existing residential and business grids stable, and not increase their prices.
"Excess" users like AI data centers, crypto miners, etc. must bid once per day with a max price/kWh they're willing to pay. As long as there's no shortage, everyone pays normal rates, and it's fine. If they run out of capacity, then the excess users are shut off from lowest to highest.
For example, five AI data centers bid 10, 20, 30, 40, and 50c/kWh today. If capacity is low, the 10c DC gets shut off, and th
Can the power company refuse to connect? (Score:2)
Unless they're legally obliged to produce infinite power, declining business should not be a problem.
A simple fix (Score:2)
... unless data centers bring their own power supply, "PJM will be in the position of allocating blackouts rather than ensuring reliability."
If they could instead bring themselves to say "PJM will be in the position of disconnecting their power lines from data centers and applauding as they sit dark, cold, and silent", then everybody who actually matters would be safe and happy.
(For the purposes of my argument, those who "actually matter" are people and organizations which aren't building pyramid / Ponzi schemes, or inflating tech bubbles, or gaming the system by externalizing their costs to average citizens. Large predatory corporations which
Put them on rolling blackouts. (Score:2)
Re: (Score:2)
>"First google's AI is down, then microsoft's, then openAI or whatever they are called. Then repeat. Why should even one residential customer in the country ever be inconvenienced for this monumental waste of public resources?"
I was thinking the same thing. They mention the risk of blackouts. Well, fine. But the priority for power should go to medical and emergency sites, then schools and such, regular business/homes, and way down the line, data centers. If they are the cause of grids being overloade
Rolling blackout my ass (Score:2)
Roll it to the data centers and nowhere else. They have dedicated lines, if they're built properly they have dedicated backup power generators, etc.
Don't make some normal working stiff deal with warm beer because some rich twits have decided to use AI algorithm abc rather than a more modest algorithm built in a world with physical system constraints. These models do not have to be built with infinity resources. More efficient models will be made, and the sooner economic forces bring these advancements to