Cloudflare Outage Knocks Many Popular Websites Offline 56
An outage at Cloudflare that began moments ago has knocked many popular websites, including ChatGPT and X, according to user reports. Cloudflare says on its website: "Cloudflare is aware of, and investigating an issue which potentially impacts multiple customers. Further detail will be provided as more information becomes available."
Update: In a statement after the outage was resolved, Cloudflare CTO said: Earlier today we failed our customers and the broader Internet when a problem in Cloudflare network impacted large amounts of traffic that rely on us. The sites, businesses, and organizations that rely on Cloudflare depend on us being available and I apologize for the impact that we caused.
Transparency about what happened matters, and we plan to share a breakdown with more details in a few hours. In short, a latent bug in a service underpinning our bot mitigation capability started to crash after a routine configuration change we made. That cascaded into a broad degradation to our network and other services. This was not an attack.
That issue, impact it caused, and time to resolution is unacceptable. Work is already underway to make sure it does not happen again, but I know it caused real pain today. The trust our customers place in us is what we value the most and we are going to do what it takes to earn that back.
Update: In a statement after the outage was resolved, Cloudflare CTO said: Earlier today we failed our customers and the broader Internet when a problem in Cloudflare network impacted large amounts of traffic that rely on us. The sites, businesses, and organizations that rely on Cloudflare depend on us being available and I apologize for the impact that we caused.
Transparency about what happened matters, and we plan to share a breakdown with more details in a few hours. In short, a latent bug in a service underpinning our bot mitigation capability started to crash after a routine configuration change we made. That cascaded into a broad degradation to our network and other services. This was not an attack.
That issue, impact it caused, and time to resolution is unacceptable. Work is already underway to make sure it does not happen again, but I know it caused real pain today. The trust our customers place in us is what we value the most and we are going to do what it takes to earn that back.
Having trouble with Slashdot too (Score:3)
I just had trouble looking at a comment on one of my posts yesterday because I can't get through the Cloudflare bot detector. I'm not sure why that is only used when looking at my comment history. It's funny that I first have that problem this morning on Slashdot just to see this story at the top of my news feed on the same site.
Re: (Score:2)
> -- All that is necessary for the triumph of evil is that good men do nothing. -- Edmund Burke
A train has free will but still has to go where the tracks are laid down - Terence McKenna
The way is void - Musashi.
Re:Having trouble with Slashdot too (Score:5, Funny)
... including ChatGPT and X
Is there somewhere I can donate to keep this going?
Burning Expectations. (Score:2)
... including ChatGPT and X
Is there somewhere I can donate to keep this going?
I hear they burn mostly coal for fuel. Work to keep them and the Black Friday marketing offline! Coal for Christmas I say! A lump in every stocking should put a dent in their supply, and a damper on childhood arrogance.
Say it with me now! Ho Hell Nooo! Cooal for Christmas!
Re: (Score:2)
No need to donate, just install Windows XP.
Re: Having trouble with Slashdot too (Score:2)
He was trying to -solve- his problems
Re:Having trouble with Slashdot too (Score:4, Insightful)
Re: (Score:1)
Re: (Score:2)
>"I just had trouble looking at a comment on one of my posts yesterday because I can't get through the Cloudflare bot detector."
I had the same problem yesterday and this morning. I could not open any direct links to postings. Period.
Ironic because I recently posted on Slashdot about how dangerous it is that all these sites are handing over their accessibility to a single huge company like Cloudflare, and complaining that Slashdot was throwing bot checks against me all the time in the last few weeks (wh
Critical Infrastructure (Score:2)
Step aside, US-1-East, there's another single point of failure to the internet!
(seriously though, have a fallback CDN. Much less effort than multi-cloud)
Re: (Score:2)
US-East-1
Brain not awake yet....
Re: (Score:3)
Re: (Score:2)
Re: (Score:3)
The majority of people don't care if X is down or not, we care about all the other sites that are down that are used for work.
Scheduled maintenence... (Score:2)
They have scheduled maintenance notices at several data centres that seem to coincide with the outage... coincidence or yet another self inflicted configuration screw up?
Re: (Score:3)
My money is on BGP cascade due to misconfiguration of reroutes for the maintenance
Re: (Score:3)
So, not DNS?
Too many eggs... (Score:5, Insightful)
... not enough baskets. Not the only place in tech where this is going massively wrong.
Re: (Score:1)
Time to run the cleaning ferret through the tubes again...
Re: (Score:2)
https://bsky.app/profile/desig... [bsky.app]
n/t
Re: (Score:2)
Even worse: Most of the end-user computers run just one OS and most of the Mobile devices do so too. Ideal conditions for an internet worm to take over everything within a few hours. Houses of cards standing on sand in a location with frequent strong winds ...
Well, the human race will eventually learn a lesson here. Maybe it will be a tiny bit mire careful afterwards. Or not.
I can confirm for simons.ca (Score:1)
Down in Boston ATM... (Score:2)
...and the error page helpfully provides a link to Cloudflare's site for more information...which is also unavailable
That explains it (Score:3)
I was wondering why a site I was on this morning decided to stop loading. Since other sites were still working I thought it might be the site itself. The hamsters got too tired and took a nap.
Touch dirt (Score:2, Insightful)
Seriously, that we have become so reliant on 100% 24x7x365 connectivity is chilling.
Re: Touch dirt (Score:3)
No, what's chilling is that with all the routing protocols we still have 2-3 single point of failure situations every year.
Re: (Score:2)
Electricity, water, transport... what's one more network?
What is chilling is that it's a single private subject that can bring this network down.
Re: Touch dirt (Score:2)
Well 2-3 private subjects but ok
Let's get the whole internet to us Cloudflare (Score:5, Insightful)
If all of the most popular websites use Cloudflare now the world's best hackers only have to take out one service instead of many.
X?! (Score:1)
Didn't musk brag about cancelling cloudflare?
Re: X?! (Score:3)
It shouldnâ(TM)t really be surprising that the compulsive liar was lying.
Carrington Event (Score:2)
You can tell that the next giant solar flare is going to flatten this whole house of cards.
Re: Carrington Event (Score:2)
That will be quite a day.
downdetector is also down (Score:1)
we need a downdetectordown site
Another internal DNS update failure (Score:2)
GTA got it right (Score:2)
This radio ad from GTA 5 [youtube.com] sums it up perfectly:
It's like the old unix fortune says: (Score:2)
# fortune
You attempt things you do not plan because of your extreme stupidity.
# _
Post-mortems (Score:2)
Re: (Score:2)
Re: (Score:2)
If you pay cloudflare you don't have to use their NS. You could have removed their proxy service. Use akamai whilst they're down. Problem was eggs in free basket for most people.
bugs me out (Score:2)
Useful as a chair with fragile legs (Score:2)