'Stratospheric' AI Spending By Four Wealthy Companies Reaches $360B Just For Data Centers (msn.com) 63
"Maybe you've heard that artificial intelligence is a bubble poised to burst," writes a Washington Post technology columnist. "Maybe you have heard that it isn't. (No one really knows either way, but that won't stop the bros from jabbering about it constantly.)"
"But I can confidently tell you that the money being thrown around for AI is so huge that numbers have lost all meaning." The companies pouring money in are so rich and so power-hungry (in multiple meanings of that term) that our puny human brains cannot really comprehend. So let's try to give some meaning and context to the stratospheric numbers in AI. Is it a bubble? Eh, who knows. But it is completely bonkers. In just the past year, the four richest companies developing AI — Microsoft, Google, Amazon and Meta — have spent roughly $360 billion combined for big-ticket projects, which included building AI data centers and stuffing them with computer chips and equipment, according to my analysis of financial disclosures.... How do companies pay for the enormous sums they are lavishing on AI? Mostly, these companies make so much money that they can afford to go bananas...
Eight of the world's top 10 most valuable companies are AI-centric or AI-ish American corporate giants — Nvidia, Apple, Microsoft, Google, Amazon, Broadcom, Meta and Tesla. That's according to tallies from S&P Global Market Intelligence based on the total price of the companies' stock held by investors. My analysis of the S&P data shows that the collective worth of those eight giants, $23 trillion, is more than the value of the next 96 most valuable U.S. companies put together, which includes many still very rich names such as JPMorgan, Walmart, Visa and ExxonMobil. No. 1 on that list, the AI computer chip seller Nvidia, last week become the first company in history to reach a stock market value of $5 trillion. That alone was more than the value of entire stock markets in most countries, Bloomberg News reported, other than the five biggest (in the U.S., China, Japan, Hong Kong and India)...
All the announced or under-construction data centers for powering AI would consume roughly as much electricity as 44 million households in the United States if they run full tilt, according to a recent analysis by the Barclays investment bank as reported by the Financial Times. For context, that's nearly one-third of the total number of residential housing units in the entire country, according to U.S. Census Bureau housing estimates for 2024.
"But I can confidently tell you that the money being thrown around for AI is so huge that numbers have lost all meaning." The companies pouring money in are so rich and so power-hungry (in multiple meanings of that term) that our puny human brains cannot really comprehend. So let's try to give some meaning and context to the stratospheric numbers in AI. Is it a bubble? Eh, who knows. But it is completely bonkers. In just the past year, the four richest companies developing AI — Microsoft, Google, Amazon and Meta — have spent roughly $360 billion combined for big-ticket projects, which included building AI data centers and stuffing them with computer chips and equipment, according to my analysis of financial disclosures.... How do companies pay for the enormous sums they are lavishing on AI? Mostly, these companies make so much money that they can afford to go bananas...
Eight of the world's top 10 most valuable companies are AI-centric or AI-ish American corporate giants — Nvidia, Apple, Microsoft, Google, Amazon, Broadcom, Meta and Tesla. That's according to tallies from S&P Global Market Intelligence based on the total price of the companies' stock held by investors. My analysis of the S&P data shows that the collective worth of those eight giants, $23 trillion, is more than the value of the next 96 most valuable U.S. companies put together, which includes many still very rich names such as JPMorgan, Walmart, Visa and ExxonMobil. No. 1 on that list, the AI computer chip seller Nvidia, last week become the first company in history to reach a stock market value of $5 trillion. That alone was more than the value of entire stock markets in most countries, Bloomberg News reported, other than the five biggest (in the U.S., China, Japan, Hong Kong and India)...
All the announced or under-construction data centers for powering AI would consume roughly as much electricity as 44 million households in the United States if they run full tilt, according to a recent analysis by the Barclays investment bank as reported by the Financial Times. For context, that's nearly one-third of the total number of residential housing units in the entire country, according to U.S. Census Bureau housing estimates for 2024.
Re: No biggie (Score:2)
When the Fed prints money to buy sinking assets, does any taxpayer get debited? In 2020 when the Fed increased base, high-powered money by 40%, and inflation only briefly touched 9%, does that show printing money is a net gain?
Imaginary assets like hallucinations? (Score:1)
Can't figure out your focus, but it may have something to do with virtual money (such as recursive futures). The vacuous Subject you inherited and propagated didn't help at all. Care to clarify your points? Or at least your main point? Maybe something about fiat currencies, old or new?
Re: Imaginary assets like hallucinations? (Score:2)
Can I recommend Perry Mehrling's "Economics of Money and Banking" to explain how banks create money out of thin air ("the alchemy of banking") and the Fed easily has the power to backstop all that private money creation in a panic?
https://www.coursera.org/learn... [coursera.org]
Re: (Score:2)
I couldn't find any of his books in any of the local libraries and I haven't used Coursera in some years... I did look over the course summary and couldn't figure out the basis of your recommendation. I'd guess something about leverage? But I don't believe in alchemy and I think the stock market has become completely detached from reality. Right now "legal tender" seems to be on the verge of "legal fiction" status.
Re: (Score:2)
I'm guessing this is a summary:
Banks are legally allowed to loan more money than they have in deposits...to a degree. They've occasionally been found to go well beyond that limit. And they aren't carefully audited often enough.
Whether that's an accurate summary or not, it's true, if a bit shy on details. (I don't know the details this decade. But there probably haven't been any basic changes in the last few decades.)
Re: Imaginary assets like hallucinations? (Score:2)
For "occasionally", do you mean "most of the time"? Who's regulating derivative markets, and do they create well-intentioned unintended consequences because regulators don't really understand what's happening?
If Zoltan Poszar is right that "shadow banking begins where M2 ends", by how much does privately-created money dwarf public money?
Re: (Score:2)
Mostly the ACK, but I'm wondering if the new name should ring a bell. Has he written any books on this? Nothing came up in the meta-search of local libraries.
Re: Imaginary assets like hallucinations? (Score:2)
The latest Firing Line, with author Sorkin who says many of the same things, might be a place to start?
https://m.youtube.com/watch?v=... [youtube.com]
Re: (Score:2)
I do recognize his name and would like to find a book he's written, but pretty sure I've searched a number of times.
Re: Imaginary assets like hallucinations? (Score:2)
Can we completely detach asset markets from the real economy so the greedy rich have a sandbox to play in while the rest of us live in the real world unaffected by their panics?
Re: Imaginary assets like hallucinations? (Score:1)
What mechanism do you propose to allow them to feed on ordinary people if the market is detached?
Re: (Score:2)
I think you were going for funny and I'm not sure if the comment you are replying to was a sincere solution suggestion or also going for funny.
Re: (Score:2)
That’s the plan. The AI industry and its dependents will never make enough money to cover their current CapEx and then replace everything in five years when the chips are obsolete and components are breaking down. But if they tank every company that's using AI software will be fucked and the NASDAQ will tank. So the Fed will print a trillion dollars to bail them all out and everyone else will end up with higher grocery prices.
Re: No biggie (Score:2)
What if we the people demanded Cost Of Living Adjustments because we reject Paul Volcker's irrational hate for them?
Re: (Score:2)
Not possible. The imaginary value of those companies is about the same as the US GDP. There isn't an entity big enough to bail them out.
But don't worry, it's not a bubble.
Re: (Score:2)
Re: (Score:3)
Democratizing AI would be the best thing, because right now it's a rich persons game with the rewards in their hands. If open source can free the world then something similar for AI would be good.
Re: (Score:2)
Democratizing AI would be the best thing, because right now it's a rich persons game with the rewards in their hands. If open source can free the world then something similar for AI would be good.
This will eventually happen when AI stabilizes in both models and use cases. In that case, ASICs and open or at least well-known models will rule, and costs will tumble. This is the way that all emerging technologies and markets evolve, i.e., massive and often irrational initial investment, technology stabilization coupled with fierce competition, winnowing of competitors, market maturity with saner prices for supply chain and products.
Re: (Score:2)
What makes you think they want to solve problems? My impression is that just want to tell everybody how great they are and they are trying to get that status by sabotaging everybody else.
Re: (Score:2)
Why do you say "Russia's attempts at sieging cities is only going to get better"?
That may well be true but at the same time our attempts to defend ourselves will get better too. We have access to AI as well you know.
Re: Because AI solves everything? /s (Score:3)
For example, the traveling salesman problem. Add another city, the cost of an answer goes up exponentially. In the 2000s, you could solve it with genetic algorithms, and get a good answer. It isn't the Answer (tm) that is perfect... but it is good enough. Now, LLMs can take into accounts more variables, and get closer.
I have been conducting research on combinatorial optimisation for more than two decades. What you say is not true.
First, genetic algorithms are not a good approach for solving the TSP. If you want an exact solution then the best methods are based on branch and cut, for example Concorde [uwaterloo.ca]. It can solve surprisingly large instances. If you want something close enough, this particular implementation of the Lin-Kernighan heuristic works surprisingly well and way faster than any genetic algorithm.
Second, and way m
Re: (Score:2)
The ironic thing is that I used generic algorithms to "solve" the TSP when getting my CS degree. I would agree other ways can do better because there are metastable points one can get to, and only a lucky mutation would knock it out of that state to something closer to the ideal.
This makes me curious what the big-O factor is with TSP and AI models. O(x)?
Meanwhile... (Score:5, Insightful)
It's almost as if giving all of our money to the rich because we were busy being distracted by moral panics was a bad idea.
The funny thing is when I say moral panic everybody agrees with me but if I mention the specific moral panics that caused you to give all your money to the rich then everybody gets upset.
Re: Meanwhile... (Score:2)
Do the bottom 90% even have enough money that the rich want it, or can they make ten times tbat amount just by investing in the fictitious goods of stock markets, while we get a basic income to satisfy our basic physical needs?
Re: Meanwhile... (Score:5, Insightful)
Do the bottom 90% even have enough money that the rich want it
If that's true or not doesn't really matter because all their actions show that whatever that amount is they want it.
Re: (Score:1)
whatever that amount is they want it.
I don't see much evidence of that. I think they are fighting over the other 90%. Henry Ford made cars and needed consumers to buy them. NVIDIA makes chips and needs AI to buy them.
Re: (Score:2)
Well that's sortof a different and possibly worse problem unto itself
Re: (Score:2)
possibly worse problem unto itself
Well yes. Because its showing that if you don't need people to produce goods you don't need people to consume them either. And sociopaths who don't care rule the world. Or at least their inventions do.
Re: (Score:2)
And sociopaths who don't care rule the world.
And that's my premise, even if it's the 10% that's left they still want it. Is there line where they say enough is enough?
Re: Meanwhile... (Score:2)
Are you expressing a mood? What if we tested your mood and it turned out to be just your own projection?
Re: (Score:2)
Do the bottom 90% even have enough money that the rich want it, or can they make ten times tbat amount just by investing in the fictitious goods of stock markets, while we get a basic income to satisfy our basic physical needs?
The rich don't get their money from the poor. They get their money from the ether, from price appreciation of their existing assets. How the poor support the rich is in their acceptance of the price appreciation. If only the rich engaged in the stock markets, then they would essentially just exchange money with each other. However, the poor also participate in the stock market, and that participation provides a connection for the rich to parlay inflated stock prices into tangible items and services.
Re: (Score:2, Insightful)
The rich do not want more money. They want the poor to have _less_ money and especially less freedom, ideally no freedom at all. All of them have enough money that a bit more really does not matter. This is about oppression and, eventually, eradication or enslavement of large parts of the population so that they can feel superior. At least I do not see any other explanation that is left.
These are people with really bad personality defects and we unwisely gave them power. I mean, just look at how incapable a
The rich don't want money anymore (Score:1)
They are sick and tired of being dependent on consumers and employees. So they want to automate basically everything so they can eliminate virtually all employees and then keep a handful of people around to keep the machines going and then a handful of thugs to keep the engineers in line. Maybe mix in a little bit of religious zealotry and extremism. Set themselves up as gods like the emperor of Japan did maybe or the Pharaohs.
It won't matter once the power goes out (Score:1)
This will pop simply because the resources just aren't there, without even taking into account all of LLM's bullshit hallucinations and shit data output.
Re: (Score:2)
That Ion QC story earlier shows promise in helping with that problem.
Re: (Score:2)
That Ion QC story earlier shows promise in helping with that problem.
Data Centers being built right now are not going to benefit from a tech that could still be 20+ years away from mass production. Even if those new computers were available right now, they won't be just a snap-in for these data centers, which are being built specifically around GPU architectures and GPU cooling. Data centers being constructed and used right would probably need to be all but razed to accommodate an entirely new paradigm for computing.
Re: It won't matter once the power goes out (Score:3)
If you look at a Sankey diagram of US energy production and consumption, will you too see that residential electricity usage is less than 15% of total electricity demand? So does data center usage only represent a 5% increase in demand, which given the 10% electricity generation surplus shown on eia.gov's energy facts explained page, is totally doable given current production?
https://flowcharts.llnl.gov/si... [llnl.gov]
https://www.eia.gov/energyexpl... [eia.gov]
So is this panic over electricity supply wildly overblown, a pure h
Re: (Score:2)
America has an aging infrastructure problem made worse by increasing demands (not just AI) and climate change effects. Eventually something has to be done about it or it'll fail at the worst times. All that costs money.
Re: (Score:2)
If you look at a Sankey diagram of US energy production and consumption, will you too see that residential electricity usage is less than 15% of total electricity demand?
So is this panic over electricity supply wildly overblown, a pure hallucination meant to push emotional scarcity buttons in you so utility commissions can administer higher rates and the public will go along meekly?
Current US data center electricity usage is around 4% of total usage. That sounds like a low percentage, but the concern is over the anticipated growth of that percentage. But you are right that even with the wildest projections, data center usage will still remain relatively low.
Re: (Score:2)
Re: It won't matter once the power goes out (Score:2)
When will they use AI to figure out how to recirculate the water and even get energy from the heat generated?
Re: (Score:2)
It's all based on the assumption that... (Score:3)
...progress can only be made by using massive and ever increasing computing power
One efficient algorithm could change everything
Re: (Score:2)
It's going to take more than one more efficient algorithm. OTOH, there've already been improvements in more than one algorithm. Nobody knows how far that could go, but the best evidence is that it could get a LOT more efficient. (Consider the power usage of a human brain...it uses a lot of power for an organ, but not really all that much.)
Re: (Score:2)
That "efficient algorithm" may never materialize or may not materialize soon. Remember that AI has been an intense research topic for at least half a century. There are no easy to do things left, they have all been tried and most failed.
That said, we _know_ more computing power will not help. Lack of computing power is not what makes LLMs so bad. Those data-centers have no chance to ever be profitable. More likely, they will be a total write-off and maybe some not-so-pretty ruins.
When AI bubble explodes... (Score:4, Insightful)
Who's using data centers? (Score:2)
"In just the past year, the four richest companies developing AI — Microsoft, Google, Amazon and Meta — have spent roughly $360 billion combined for big-ticket projects, which included building AI data centers and stuffing them with computer chips and equipment, according to my analysis of financial disclosures.... How do companies pay for the enormous sums they are lavishing on AI?"
Amazon, Microsoft, and Google are cloud providers. It's not clear how much of their data center expansion is for
Eventually (Score:5, Informative)
Total stupidity on authors part (Score:2)
He said the four top companies were "AI centric".
Microsoft, Google, Amazon, and Meta
These are NOT AI companies. Their business is not currently funded by AI, nor is it their main focus. They ARE very rich computing companies that think AI is going to become their business, so they heavily invest in it $360 billion.
That is NOT a big investment for those four companies - they are worth more than 9 trillion total. Spending about 10% of their value is significant, but not amazing.
The issue is that humans are
Re: (Score:2)
In addition, the part of that money spent on computer centers will be useful even if AI doesn't pan out. It's not like investing in tulip bulbs. If AI doesn't pan out, it will just take a few years longer to pay for itself.
That said, AI will pan out. Even if there's no further development (HAH!) the current AIs will find an immense number of uses. It may well be "growing too fast", but that's not the same as worthless. (But expect well over half of the AI projects that are adopted in the next few years
They are going for peak stupid... (Score:2)
I think they may even reach that at least for this decade. I mean, a known-defective and unfixable technology that costs far too much to run and maintain and has not made good on any of its promises and that has essentially (besides some cosmetics) stagnated? And then you pour in enough money to bring the economy down if anything goes wrong?
Sheer madness. Well, I hope this crash will defer the next AI hype (and there will be one as stupid people do not go away) by a few decades. Then this craze would at lea
It's perhaps a bubble but it's funded by ... (Score:2)
... big techs obscene cash reserves and not so much third-party or VC investment money, so I'm not too concerned for the market, to be honest. The environment and the looming AI threat is a different issue, but's that's not so much about the market. If the bubble pops I hope for little impact for ordinary folks.
It's Not Just AI (Score:1)
Monopolies (Score:2)
\o/ (Score:1)
The pop from this bubble is going to destroy the world or perhaps the efforts to stop the bubble from popping (and thus avoid the destruction of the world) will destroy the world.
It's too-big-to-fail as a core business strategy.