AI Execs Game Out 'Political Revolt' after a Catastrophic AI Event (yahoo.com) 47
Top executives at Anthropic, OpenAI and other AI companies "are privately gaming out scenarios for a public and political revolt after a catastrophic AI event," reports Axios, one that turns "an already wary public further against the technology and its leaders..."
These AI company executives "anticipate a large-scale event, most likely a cyberattack, that shuts down access to financial services, internet connectivity, or even power and water..." the article points out. "Many top AI researchers and executives believe a major incident is inevitable. "OpenAI conducts preparedness exercises where teams discuss and work through a range of potential scenarios," a company spokesperson said. "These scenarios are not treated as inevitable, but are meant to help us prepare for a variety of circumstances." Anthropic declined to comment...
Top AI planners assume Democrats, ascendant after the midterms, will move fast to shut down AI but will face significant challenges... The planning involves red-teaming for worst-case scenarios. It focuses mainly on racing to educate members of Congress. Company executives know regulation has no chance of passing right now, but still want to shape the legislation and policies U.S. leaders will turn to after a first catastrophic event....
Many AI industry insiders told Axios they believe a major event will occur in the next six to 12 months.
"Even with Democrats in control of the House and Senate, the companies see fractured politics as the norm, including within the Democratic Party."
These AI company executives "anticipate a large-scale event, most likely a cyberattack, that shuts down access to financial services, internet connectivity, or even power and water..." the article points out. "Many top AI researchers and executives believe a major incident is inevitable. "OpenAI conducts preparedness exercises where teams discuss and work through a range of potential scenarios," a company spokesperson said. "These scenarios are not treated as inevitable, but are meant to help us prepare for a variety of circumstances." Anthropic declined to comment...
Top AI planners assume Democrats, ascendant after the midterms, will move fast to shut down AI but will face significant challenges... The planning involves red-teaming for worst-case scenarios. It focuses mainly on racing to educate members of Congress. Company executives know regulation has no chance of passing right now, but still want to shape the legislation and policies U.S. leaders will turn to after a first catastrophic event....
Many AI industry insiders told Axios they believe a major event will occur in the next six to 12 months.
"Even with Democrats in control of the House and Senate, the companies see fractured politics as the norm, including within the Democratic Party."
inevitable is what they want (Score:4, Interesting)
"These scenarios are not treated as inevitable..."
But creating agents that enable those possibilities IS treated as inevitable, because AI companies want the catastrophes to be enabled for their profit. The ability to do disastrous things is the plan, so the disaster is inevitable.
The solution to the problem we made (Score:2)
Re:The solution to the problem we made (Score:4, Insightful)
The only thing that scares them more than the fallout from the torment nexus is not being the ones in charge of the torment nexus.
That part is kind of rational, except they're only fooling themselves if they think they will be in charge of anything.
To Err is Human... (Score:2)
But to really fuck shit up, you need a machine.
Is Altman in jail yet? (Score:1)
Hacking Australia's government websites...
Incarcerate OpenAI.
Not the brightest bulbs (Score:3)
These are the same people who think their software is sentient right?
Re: Not the brightest bulbs (Score:2)
Re: (Score:3)
Anthropic's entire executive team thinks this and has been lobbying religions leaders on the subject. They've also started banning people from being abusive to Claude.
Re: (Score:2)
They've also started banning people from being abusive to Claude.
Now, I can't get the image of Claude wearing a top hat and tails singing "putting on the ritz". For the love of God don't humiliate him.
Re: (Score:2)
ISTR there's a classic sci-fi short story or maybe even book about this, but maybe I just imagined it. Where the artifacts of our fallen civilization are lost because they were fragile glass things, and there was something about ancestor cannibalism being to transfer nanites...
Re: (Score:1)
These are the same people who think their software is sentient right?
Roughly, yes. This is significantly coming out of the “Effective Altruism” movement that is especially concentrated in Anthropic and that is trying to lead the creation of top down government regulatory bodies. Of course the whole EA philosophy isn’t Anthropic’s “official” position but the strong influence is undeniable.
Concerned folks, such as the entire All-In crew despite their internal political differences, have said that this is a self fulfilling prophecy. They poin
Wow! (Score:2)
"Even with Democrats in control of the House and Senate, the companies see fractured politics as the norm, including within the Democratic Party."
I don't need a frontier LLM to tell me that the Democrats are ineffectual.
The problem with actively trying to be centrist to please everyone is that a) that's impossible and b) it means actively trying to find candidates who are less progressive than the one you're looking at when you're also supposed to be the more progressive party.
Re: Wow! (Score:3)
Re: Wow! (Score:1)
Obama was not a centrist. He gave us a huge socialist edifice in the ACA and was remarkably cavalier about bombing other nations, even more so than Trump or Bush by total nations. He was excellent at removing illegals though, so maybe kinda a centrist? Not sure those balance out.
Re: Wow! (Score:3)
If you still doubt it, watch any of Obama's SoU speeches. Appealing to both sides was important to hi
Re: (Score:2)
Real reform would have meant reforming the way insurance had become a bureaucratic nightmare at all levels. Obama was too cowardly to fight the insurance lobby (and to be fair, so were his predecessors on both sides), so instead he made the problem worse. ACA has raised everyone's premiums by more than triple over 15 years, with worse patient outcomes.
Re: Wow! (Score:2)
Increase coverage for the sickest was inevitably going to increase costs. The intent was for wider buy-in to counter that. But when the individual mandate was struck down, that went away. It should be no surprise prices have climbed since.
Re: (Score:2)
There is a provision in there restricting how much of insurance premiums can go to overhead; something like 80% must go to patient care. Assuming that's being enforced, the problem isn't entirely there.
No, this is the exact reason why the ACA is a disaster. Insurance company profits are capped at a percentage of the cost of care, so they are motivated to drive up costs. But what about the uncovered treatments that the hospitals have to eat?
Re: Wow! (Score:2)
Re: (Score:2)
No, this is the exact reason why the ACA is a disaster. Insurance company profits are capped at a percentage of the cost of care, so they are motivated to drive up costs. But what about the uncovered treatments that the hospitals have to eat?
I heard exactly this during a consulting project in the health insurance space. We set up the ACA so that driving up costs made sense to hospitals and insurance companies who manage the major entitlements (medicare, medicaid). Zero incentives to drive costs down.
Re: (Score:2)
As a dual American/Canadian citizen I can say that Obama's ACA was not a huge socialist edifice. Rather it was an insurance-industry-friendly alternative to single payer (European-style "socialized") medical systems where citizens can expect much more efficient care, funded by everyone's taxes at far lower cost
Having grown up with socialized healthcare as a US military brat, I can say that I am more comfortable having my children covered for care with no threat of bankruptcy here in Canada, than I would be
Negligence (Score:1)
Re: (Score:2)
Seems like everyone missed the big joke, though... they used their AI to run these scenarios, so now they just trained their AI to carry out those scenarios. Even if the machine they ran the scenarios on was airgapped and they took the WiFi card out and completely isolated it at the time, if that machine ever is connected, then it's possible that the scenarios could be absorbed by the main AI.
With the crappy IT security everywhere... (Score:2)
... such an event is actually possible. Far too much critical infrastructure is not even remotely secured as well as it should be. Hackers usually do not go after it, because there is no profit in it and scary people may come looking for them. But AI, while not very competent as attacker, may not understand that and may attack anyways.
Re: (Score:2)
It's a matter of life and death for any anthropomorphized plague.
Re: (Score:3)
Re: (Score:3)
You ran an LLM with a set of tools that it used to break the law, or cause damages to another party.
The key word is "You". There is no "rogue AI", there's you running metasploit against a target and trying to say a rogue metasploit did it.
Jail is a bit harsh- but definitely standard legal treatment of them.
I was busted after breaking into AT&T when I was 17. I didn't go to jail. Definitely had the fear of god put into m
Re: (Score:2)
I saw another story about booz allen runnin
Re: (Score:2)
mate- British? Aussie? Perhaps laws were more severe over there at the time.
In general, in US jurisdictions, this would fall under negligence or recklessness, as the researcher likely didn't have intent to break into the remote system (and proving it beyond a reasonable doubt would be pretty difficult anyway)
Recklessness has a decent probability of leading to jail time depending on the severity of the fallout. Second time you do it is usually a year behind bars if your first sentence is suspe
Re: (Score:2)
Certainly at this moment, reckless, not negligence. They are researchers in ai doing this. I'm not a researcher in ai and even I know the stories. Frankly I'm amazed that no bar organization has dis-bar'ed any lawyers for submitting ai hallucinated cases.Some judges have done summary ju
Re: (Score:2)
Again, you got lucky, you should be very thankful.
Na, I think there is probably just a stark difference in enforcement goals between WA and IN.
Throwing a first-time offender in jail for a crime that caused no damages is abnormal- or at least is back in the late 90s, here. But then again, didn't they toss people into jail for decades there for having a dime on them in IN? Or is ultra-strict drug enforcement in the midwest a myth?
I explained why you can't apply them directly- they require intent.
An escaped program is not intent. It's negligence or reckle
Re: (Score:2)
Re: (Score:3)
1) Foreign adversaries are hitting infrastructural targets daily. In 2021, attackers attempted to increase lye content in a Florida water supply to lethal amounts.
2) They're highly competent as attackers. This is demonstrated ad nauseum. I wouldn't say they're more intelligent than a human at it, but they're dozens of times faster, and persistent, and smart enough to find the holes.
The cognitive dissonance you're suffering must be physically fucking painful.
Re: (Score:2)
Wow, you really have no clue.
1. Hitting and hitting large scale are two different things.
2. No, they are not "highly competent". Stop pushing that idiotic claim.
Re: (Score:2)
I have real pity for you. Don't look up.
Panicans (Score:2)
"This massive and unpredictable event, which will happen in the last week of April (just in time for May Day), will be unpredictable and massive, and will affect everyone except for certain sympathetic members of the press and the political party we support. And it will be massive and unpredictable. On April 29 next year."
Colossus: the Forbin Project (Score:3)
Old movie from the â60s.
Bland compared to 'leet haxor looks at Python code on a green-screen and breaks into the Pentagon while the timer on the bomb ticks down to 1'.
But required viewing, due to its prescience, and current applicability.
Re: Colossus: the Forbin Project (Score:2)
Greed ensures AI access to means of destruction (Score:2)
AI is and will continute to be increasingly empowered with indifferent safety precautions because the power money confers is all that matters to techbros.
First world systems are far more fragile than they appear to humans. AI doesn't have that problem.
Read the original Axios report (Score:2)
“Top executives at Anthropic, OpenAI and other AI companies are privately gaming out scenarios for a public and political revolt after a catastrophic AI event.”
Sounds like a good reason to vote Democrat (Score:3)
The current situation with the Republicans in power and willing to support literally anything that Trump does, is not healthy.
We've got the AI companies themselves screaming out to be regulated due to the danger, and Trump instead refusing to do so and being accelerationist.
Trump is becoming increasingly unhinged, and not just in a har har look at the idiot kind of a way. Yesterday he decided to stab Ukraine (& Europe) in the back to buy diesel from Russia, when he could instead have bought it from a friendly country like Canada, or just have stopped US exports. When your commander in chief is providing financial aid to your enemy, then things have crossed a line ...
Re: (Score:2)
The current situation with the Republicans in power and willing to support literally anything that Trump does, is not healthy.
For the ultra-wealthy, chaos is great. They will ride it out with their stockpiled supplies and remote resorts and child rape islands, and if necessary, their bunkers. As we lose our shit they will buy it up and we will own even closer to nothing. They don't actually believe that the USA can fall, which is stupid but predictable, and it probably won't any time soon.
Trump is becoming increasingly unhinged, and not just in a har har look at the idiot kind of a way. Yesterday he decided to stab Ukraine (& Europe) in the back to buy diesel from Russia, when he could instead have bought it from a friendly country like Canada
In fact we do buy it from Canada, we buy way more than we just got from Russia all the time. This is just a way acceptable to his base for him t
Closing the barn door after the horse bolted. (Score:1)
Status:
Technological Singularity- IN PROGRESS
Societal Singularity - NEARING COMPLETION