Sam Altman Thinks Your PC Is Wasting Precious RAM (tomshardware.com) 175
"Looks like OpenAI CEO Sam Altman wants to own all the computing resources and rent out terminals to the world as a way of propping up his business plan, now that debt-ridden AI companies are teetering on the edge," writes ancient Slashdot reader Gilmoure. Tom's Hardware reports: In an interview over beers with the YouTube channel Cheeky Pint, Altman said that local inference, and, by extension, people having DRAM in computers at home, is "quite terrible." When discussing local inference on home computers with open-source models, Altman discussed the assumption that people will be able to run local AI on their own computers, the ones they may already own or want to build.
Then he explained why that's a bad idea (at the 29-minute mark): "From a global allocation perspective, actually, it's quite terrible to have everybody have a bunch of the world's limited supply of DRAM sitting in their own computer and being used 5% of the time," Altman said. "You want maximum utilization in the cloud if you're trying to deal with this very supply-constrained environment. And somehow many people's intuition is the opposite of that."
While OpenAI does have some open-source models, its primary business is in closed-source models that run in data centers, so he's really defending the company's business model. OpenAI isn't exactly threatened by some laptops and gaming rigs just yet, but local AI could mean people one day paying less for subscriptions to models like GPT-6 Luna if they have the power to run them at home. Altman's talk suggests that the company would prefer that more RAM go to OpenAI's data centers rather than home computers, which also sparks enthusiast fears of not being able to own your own hardware or software, but rather rent an agent and a computer in the cloud.
Then he explained why that's a bad idea (at the 29-minute mark): "From a global allocation perspective, actually, it's quite terrible to have everybody have a bunch of the world's limited supply of DRAM sitting in their own computer and being used 5% of the time," Altman said. "You want maximum utilization in the cloud if you're trying to deal with this very supply-constrained environment. And somehow many people's intuition is the opposite of that."
While OpenAI does have some open-source models, its primary business is in closed-source models that run in data centers, so he's really defending the company's business model. OpenAI isn't exactly threatened by some laptops and gaming rigs just yet, but local AI could mean people one day paying less for subscriptions to models like GPT-6 Luna if they have the power to run them at home. Altman's talk suggests that the company would prefer that more RAM go to OpenAI's data centers rather than home computers, which also sparks enthusiast fears of not being able to own your own hardware or software, but rather rent an agent and a computer in the cloud.
I don't care (Score:5, Insightful)
You don't have a choice (Score:5, Insightful)
You can't keep letting people have limitless power and then just throw up your hands and say I don't care. You can't live in an alternate universe where they don't exist and where they don't have power over you. And you can't just go somewhere they aren't because virtually all the land capable of sustaining human civilization is full of people already and those people have to listen to Sam Altman and guys like him who have the billions and billions of dollars and limitless power people refuse to take away from them.
Politics affects your hobbies and your life whether you like it or not. I don't care doesn't make that go away. It's just cope.
Re: (Score:2)
Re:You don't have a choice (Score:5, Insightful)
When someone says "I don't care" in this context, it isn't an expression of indifference, as if the issue doesn't have any material impact on them. It's an expression of DISDAIN. For example, when someone says "I don't care what Trump thinks," it is reasonable to infer that they mean that his thinking is fundamentally wrong and unworthy of discourse. That he is not someone whose thoughts are to be respected or regarded with any value.
We DO need to stop these arrogant sociopaths. And we do that by refusing to buy into the explotative ecosystems and false narratives they push on us. But let's not read too literally into what is a common expression of frustration and twist its intended meaning.
It's also a way to cope with the situation (Score:3)
And left wing spaces we call this complying in advance.
The implication isn't just that you're looking down on the person making the comments, the implication is that you don't have to care about the comments they are making. That you're above all that.
It's painfully obvious that we are not above the decisions Sam Altman makes. He gets to decide how our lives go. He's making serious decisions about the future of society, a
Re: (Score:2)
he gets to decide whether you get to have a PC or not.
Horse. Shit.
None of the companies that make the parts in my PC are going to ask for his permission to sell them to me.
He's got a lot of spreadsheet wealth, it doesn't mean he can buy AMD and Micron tomorrow.
When the bubble pops he'll still be a rich jerk, but there's a lot of rich jerks out there, and I don't need permission from any of them to buy computer parts.
Re: (Score:2)
What upsets Altman is he doesn't get to decide who has a PC.
Re: (Score:2)
https://www.pcmag.com/news/sk-... [pcmag.com]
Re: (Score:2)
Re:You don't have a choice (Score:5, Insightful)
I'm guessing you paid significantly more for those computers than if Sam Altman had not been involved. For many people, his buying power is enough to simply disallow buying a computer at all.
Re:You don't have a choice (Score:4, Insightful)
That's only true until supply catches up with demand.
Plenty of new fabs are being built.
I predict that 3 years from now, the current DRAM shortage will turn into a glut.
Disclaimer: My predictions are usually wrong.
Re: (Score:2)
The DRAM market was depressed before the AI boom started, so if it ever returns to previous conditions, you may be right.
Re: (Score:2)
I predict that 3 years from now, the current DRAM shortage will turn into a glut.
Depends on how long it takes for the new fabs to come online. As of right now, there's about the right amount of capacity to supply the pre AI bubble world with DRAM.
Unfortunately unsold stock will be less useful because it's the wrong type for many consumer things. Though NVidia could rerelease some of the Quadro cards as consumer ones to make use spare HBM.
Re: (Score:2)
RAM is a small part of the cost of a good PC.
And WTF makes you think the top public face guy in AI is personally responsible for the boom? Give me a fucking break. Quit worshiping him.
Looking at your username... he's ain't got shit on Bob.
Re: (Score:2)
Not anymore it isnt.
Re: (Score:3)
Dingleberry, you may not have understood that news article.
"That big ecommerce site" has lots of RAM for sale, and the prices are within the normal ballpark of the 10-year avg. A lot of the price hysteria is because of a post-covid price drop with very low prices, right before the prices went up. But consumer RAM hasn't stopped being available, and won't stop being available.
Another thing you didn't realize, since you didn't read or didn't understand your link, is that it says one of the major suppliers has
Re:I don't care (Score:5, Insightful)
I don't care what he thinks either, but him and his AI buddies are making RAM and storage so expensive that many people can't afford to build or buy themselves a high end workstation anymore.
By jacking up the prices for hardware, the AI cabal is forcing people to rent their compute from the cloud instead.
Re:I don't care (Score:4, Interesting)
Re: (Score:2)
Wow, good thing you aren't a major campaign manager with the DNC. They'd be screwed with you spouting that rhetoric.
Re: (Score:2)
LOL it was the last crash that created the "you're the product" tech industry. Everyone woke in 2000 and realized nobody had a real business plan, and started sell; tech's answer was monitize the users.
Holly crap dude you think with regulating big tech is going to give you more freedom. I have 20% share in the Brooklyn Bride if you are interested, I am willing to sell for pennies on the dollar!
Seriously all regulating AI will do is make it harder or impossible for open source and open models. Regulation is
Re: (Score:3)
Re: I don't care (Score:2)
If he tries someone will shoot him in the head. Mark my words.
Re: (Score:2)
Banks are... substantially more powerful that all of the tech companies combined, regardless of how much money the spreadsheet claims they have.
They literally do not care what the opinion of an individual CEO is. There are lots of different powerful CEOs in different industries who all want different things to happen regarding interest rates. They can yap all they want, nobody cares.
The CEO of a mid-sized investment firm would have more sway. Which is still close to zero individually.
Re: (Score:3)
Re: (Score:2)
I find Altman's comment reassuring (Score:2)
I don't care what Sam Altman thinks of my PC.
I find it reassuring he will not approve of the 64GB I put into my PC last year.
Re: (Score:2)
What Sam Altman thinks of my PC.
You should, he's the reason you can't afford to replace it if it breaks.
I've said it before (Score:5, Insightful)
And I'll say it again. Altman is the ultimate douche-bag sociopath grifting asshole. This fucker needs to go now.
Re: (Score:3, Informative)
Re: (Score:2)
You know he's gay, right? Is the theory that he's been faking being gay? Because that's a tough thing to fake.
Re: (Score:2)
Many porn actors fake it.
Re: (Score:2)
Not every night for 20+ years they don't.
Re: (Score:2)
I guess it would explain why he's trying to destroy the world, though.
Re: (Score:2)
Re: (Score:2)
Re: (Score:3)
Interesting thought.
So how much money are you allowed to make over a lifetime? I assume that once you reach the cap that you are forcibly retired.
Are you allowed to keep stock in the company that made you rich or do you have to divest and keep it all in government bonds? I assume any bonds still outstanding at your death would simply be cancelled and would not be passed on to your heirs.
I can think of some other problems with a lifetime income limit but it's an interesting notion.
Re: (Score:2)
IMHO: It's the hoarding that's the problem, not how much they "make" over their lifetime.
Re: I've said it before (Score:2)
Just so! The wealthy hoarding money prevents it from employing people as they claim. When we have the money we spend it and it can do work.
Re: (Score:2, Insightful)
Re: (Score:2)
Generally this isn't true, instead it is stored in large quantities of stock or other assets
And why is that? Because it's a tax dodge. If taking loans collateralized against that paper wealth wasn't possible, they would have to liquidate that paper wealth to afford their rich asshole lifestyle, and it would be taxed. Keeping it paper means paying fuck-all to government while consuming the same or more amount of government services than people that pay far more taxes.
I give no fucks if they keep their wealth in stocks or whatever. There's a completely different set of rules for them, and for us
Re: (Score:2)
When we have the money we spend it and it can do work.
Giving people money to spend is a Demand Side Stimulus [wikipedia.org].
A demand-side stimulus makes sense when:
1. Unemployment is high
2. Inflation is low
3. The trade balance is in surplus
None of these conditions are currently true.
A demand-side stimulus in today's economy would fuel inflation and would mostly be spent on imports.
Re: (Score:2)
IMHO: It's the hoarding that's the problem
Can you define what you mean by "hoarding"?
Rich people have most of their money in equity. That's investing, not "hoarding".
Re: (Score:2)
Very, very few of the rich hoard money. That's not how you get rich, and it's also not what the ones who inherit tend to do.
Re: (Score:3)
The way it was done back in the 50's and 60's was by tax. The more you made, the more taxes you paid. People still got rich, just as not as rich as today. And they often chose to do things with their money like give it to their employees rather then the taxman.
Re: (Score:3)
I don't care if they keep amassing wealth. I care if they aren't taxed accordingly.
I should not be paying a higher effective tax rate than someone who has 100x my income, be it on paper or liquid. And yet.
Stupid bullshit schemes were they take out loans against that paper wealth in order to still fly around on private jets and own multiple mansions without paying taxes is absolute insanity. If they want to be rich, then fucking be rich and liquidate a small percentage of that paper wealth, and PAY YOUR F
Re: (Score:2)
So how much money are you allowed to make over a lifetime? I assume that once you reach the cap that you are forcibly retired.
Nah, that would be gauche. Instead, we implement the cap relativity-style, where your tax rate increases proportional to the amount of money you've made already. As you keep making money, you asymptotically approach the financial "speed of light" but can never quite get there because in order to actually reach it you'd need to earn an infinite amount of money.
Re: (Score:2)
I'd put him as one of the top 3 or 4, or at least one of the top 10, because of the power of his position, not because he's intrinsically the worst.
Re: (Score:3)
Re:I've said it before (Score:4, Interesting)
Also, he's the same shit stain that not long ago thinks it would be a good idea to have an "intelligence meter" on the side of your house like other utility meters. That's his rent-seeking dream, and if you can buy enough RAM to run useful models at home, that directly interferes with his rent-seeking.
Fuck him. I couldn't give a solitary shit if he approves of me owning my own compute or not.
Sam Altman is wasting precious oxygen (Score:5, Insightful)
Why should I care what this dumb asshole thinks? If he takes up entire world's supply of RAM, then with what devices will we be able to presumably pay for the privilege to access his AI models? Is he really suggesting that we all go back to the days of running dumb terminals?
What is this CEO disease, where they all think that just because they run a company, that they are suddenly subject matter experts for every domain of knowledge that built said company? Like, somehow just by being in a leadership position, they suddenly have the knowledge of all the engineers, developers, and technicians who built the product, as if they built everything with their bare hands? And what is with this mass delusion that so many people--shareholders included--buy this absurd narrative?
Fuck this guy and fuck his arrogant "I'm the leader so I'm a visionary who can say and do no wrong" attitude. Put them all on a spaceship and blast them out of the solar system.
Re: (Score:2, Insightful)
Re: (Score:2)
Yes, The whole AI industry is suggesting it as part of the whole "you don't own anything anymore".
Nvidia because they don't want you to own GPUs - they've been restricting how many 5000 series gaming GPUs they make so they can make more of their AI processors. In the meantime, why not subscribe to GeForce Now and their gaming subscription services. And with RAM prices causing everything to jump up in price, streaming gaming s
Re: (Score:2)
"Is he really suggesting that we all go back to the days of running dumb terminals?"
That's how I read it.
Re: (Score:3)
If he takes up entire world's supply of RAM, then with what devices will we be able to presumably pay for the privilege to access his AI models? Is he really suggesting that we all go back to the days of running dumb terminals?
In principle, what he wants you/us to do is to get some lightweight graphical terminals (machines with slow processors, basic memory and GPU) and use them to do VDI in the cloud. According to his/their vision, our memory is DDR3, maybe DDR4 (only if the DDR$ production lines can not be converted to DDR5 or 6), our processors are not made in a cutting edge litho, we have barely enough RAM for the light terminal to function. Something akin to a low end Chromebook.
In a separate but related and Interesting note
Re: (Score:2)
> Put them all on a spaceship and blast them out of the solar system.
That's too expensive. Aim for the Sun.
Local data is a threat (Score:5, Informative)
Most billionaires & CEOs are a waste.... (Score:2)
of precious bodily fluids, iykyk.
Re: Most billionaires & CEOs are a waste.... (Score:2)
false premise (Score:4, Insightful)
"the world's limited supply of DRAM"
The world's constrained supply of DRAM should ease in 2-5 years, at which point his argument, such as it is, will be much weaker.
That said, from an economy-of-scale and efficient-use-of-resources perspective, centralization makes sense. But form a privacy, autonomy, actual-ownership, and personal freedom perspective, it's a disaster waiting to happen.
RAM communism, or the second false premise (Score:2)
This assumes that my interests are perfectly aligned with Sammyboy's.
But they aren't, and his proposal is no different than that any other greedbag who wants to own your future.
Allow me to counteroffer: Sam, fuck off to an island somewhere and scan crab eyeballs or something. We'll give LLMs their due attention, pat yourself on the head. Somewhere far away from humanity.
Sounds perfectly reasonable (Score:3)
Both reasonable suggestions, and I bet there are more out there.
Sounds like Nestlé (Score:4, Insightful)
Fuck You Sam (Score:4, Insightful)
I'll never rent your hardware or software. Die in a fire.
You can pull the ram from the computers in my cold dead hands.
No "unused" memory in modern OSs (Score:5, Informative)
Re: (Score:3)
Low utilization (Score:5, Funny)
Re: (Score:3, Funny)
Hey, you may have hit on an idea we can all get behind! It's a waste for us to all own toilets - we should just bag up the poop and send it to Altman!
Brilliant! (Score:2)
And we can pay him $1.73 for every million poop tokens.
Re: (Score:2)
Re: (Score:2)
You should be taking shits in the cloud, you selfish bastard!
Wait hold on a second here (Score:2)
For the rest of us I think we're okay but in your a case you might actually be over toileted...
I think Sam Altman is... (Score:2)
I think Sam Altman is a waste of precious resources like O2 and H20.
Re: (Score:2)
I have it on good authority that he's only using 10% of his brain power at any time.
He should probably hand it over to somebody else.
This man is a robot! (Score:2)
No (Score:2)
He said it specifically about the local inference. Get your facts straight.
Re: No (Score:2)
Arguing with Altman (Score:2)
Look, I could spend hours arguing on why ownership of the means of production is important and how out of touch the AI CEOs are, but I won't, so I'll just leave this here: fuck you Altman.
The vision of Capitalists (Score:2)
Centralize everything! (Score:5, Interesting)
You should come to my restaurant, and pay me for food, because our refrigerators are always efficiently at max capacity.
Billionaires running everyones lives not popular (Score:2)
> somehow many people's intuition is the opposite of that
Billionaires owning and running every aspect of our lives, and then charging nickels and dimes for every move we want to make and every thought we want ot think, is somehow not a very popular idea.
For some reason.
It really is very difficult to figure out why . . .
As I've been saying (Score:2)
You will own nothing, they don't care if you're happy. You're now their slave. Worship your masters.
they could have built the hardware capacity themse (Score:2)
with all the money thrown around... they could solve the shortage just fine by building out production capacity themselves... and feed into their own machine. A fab is the price of a rounding error on their data center buildout budgets.
Yes, would take a minute to build, but then the "shortage" won't be a shortage and their biggest expense nose dives - the hardware. They could have built the production capacity several times over and used the savings towards their buildouts.
I am guessing they don't have th
Re: (Score:2)
To even BEGIN to entertain this idea (Score:2)
Sammy boy will have to make sure that his pal Jensen builds a datacenter near me (say, Caracas or Maracay, Venezuela) so that I can game after work with no lag, AND Sammy boy will have to build an OpenAI DC near me in Venezuela as Well.
Considering OpenAI does not even let you connect to their AI from Venezuela without a VPN (with all the friction that implies), I'd say:
Go Fuck Yourself.
I'd rather build a DDR3 rig with a 9th Gen Intel Processor with a Gigabyte H310M DS2V DDR3 (Rev. 1.0) mobo to weather the s
What an idiot (Score:2)
This guy will now say anything, regardless how stupid.
Don't underestimate Altman + Politicians (Score:2)
So better prepare for the time when "personal compute and storage" will be strictly capped at low levels in order to make everyone depend on centraliz
I get it, you want to own everything (Score:2)
Most people want to own at least SOMETHING, like their own home computer.
P. S. Fuck off, Sam.
Nobody needs more... (Score:2)
Than 64 Gigabytes.
A deal to be made? (Score:3)
It's Halloween Eve (Score:2)
He can have my RAM⦠(Score:2)
Sam Altman (Score:2)
Hah! I'm a wastrel. (Score:2)
Look at me sitting here with 128GB of DDR5 that I bought for $550 on Black Friday two years ago. It's mine, I tell you! ...What? I could get how much for it? Hmmm...
Re: (Score:3, Insightful)
I am through pretending people with nearly limitless money don't get to decide how I live my life. I'm tired of coping with how bad things are I want them to either get better or I want them to just end in a global firestorm. But I'm tired of everything just getting worse because people refuse to deal with the shit that's happening and pretend instead that they can just ignore it.
I get it though. Voting is a
Re: (Score:2)
I didn't say they should be ignored. Just not listen to their bullshit. I still know they're spewing their bullshit without having to listen to it. And knowing they're spewing bullshit means I can act accordingly.
Re: (Score:3)
What does it matter whether or not they're white? I've seen examples from Asia and Africa that were worse.
Re: (Score:2)
I've seen examples from Asia and Africa that were worse.
There's white people from those regions too.
Re: (Score:2)
While true, Idi Amin, e.g., was not white.
Re:My intuition (Score:4, Insightful)
Re: (Score:2)
They keep posting these articles because we keep engaging with them. Both of us have just made this problem worse by posting on this story. That's why we keep seeing these articles. That and they are very likely being paid to run them.