Major Internet Outage: Dozens of Sites are Down (cnn.com) 57
"Cloudflare, an internet service that is supposed to keep websites up and running, was down itself Sunday, taking dozens of websites and online services along with it," reports CNN:
Hulu, the PlayStation Network, Xbox Live, Feedly, Discord, and dozens of other services reported connectivity problems Sunday morning. Cloudflare said the problem was with a third-party "transit provider," and its service was becoming increasingly stable over the course of the day... CenturyLink, formerly known as Level 3, confirmed there was an IP outage impacting Content Delivery Networks (CDN), and that all services had been restored as of 11:15 AM ET...
DownDetector, which displays reports of internet and service outages, showed that reports of internet connectivity came in across the United States and Europe Sunday morning.
Anyone experiencing any connectivity issues this morning?
Anyone experiencing any connectivity issues this morning?
I've had connectivity issues all day (Israel) (Score:1)
Re: (Score:1)
EVERYONE PANIC! Internet is DOWN! (Score:1)
Re: (Score:1)
Both are true, depending in how you look at it (Score:4, Informative)
At the time of the merger, CenturyLink was worth about $12B and Level3 about $38B. So 75% of the combined company is Level 3. The Level 3 CEO took over the combined company.
On paper, the combined company is legally the same company that was called CenturyLink before.
So yeah, on paper, the small company (CenturyLink) bought the big company (Level 3), partly by handing over CenturyLink stock. The combined company is, however, mostly Level 3 people, Level 3 equipment, etc.
Re: I've had connectivity issues all day (Israel) (Score:1)
Re: (Score:2)
Re: (Score:1)
Centurylink is down nationwide (Score:5, Insightful)
https://www.reddit.com/r/networking/comments/ijb8tn/global_as3356_level3_outages/
Re:Centurylink is down nationwide (Score:4, Informative)
Centurylink down nationwide: Now fixed. (Score:2)
Now, 13:12 Pacific Standard Time, says everything working.
Re: Centurylink is down nationwide (Score:2)
They broke BGP4 is what they broke. It was creating route flaps for us all morning. We had to stop broadcasting out ASNs on our centurylink connections. Additionally Level3/Centurylink is one of the largest VoIP carriers for origination, and that many carriers will use them for access to a variety of rate centers without the endusers knowledge. Even when you think you have some other service, there is a decent chance its still with level3. The easiest way to tell is to do an LRN lookup of your phone number.
What does it mean problem with transit provider? (Score:1)
Re:What does it mean problem with transit provider (Score:4, Interesting)
But I guess if someone screws up the routing bad enough then redundancy won't help too much. Hi level3.
Don't trust companies to do what's needed... (Score:2)
...to keep operations going or even to not lose your data.
"For a company that claims to be so important to the internet, there appears to be a lack of redundancy"
https://en.m.wikipedia.org/wik... [wikipedia.org]
And it was a very big deal because Sidekicks were still popular and widely used.
Re:What does it mean problem with transit provider (Score:5, Insightful)
BGP is the real weakest link. The idea that the Internet routes around damage only works if you stop trusting when systems lie to you about what those routes are.
Re: (Score:2)
What does it take to fix BGP? Is there anything in development? It does seem to be a mess, especially with bad actors.
Re: (Score:3)
Re: (Score:1)
Re: (Score:2)
Did Level 3 publish the routes in error though? That is the type of failure I was hoping there is a solution on the table to prevent, in order to maintain the whole “route around a problem.”
Re: (Score:1)
What does it take to fix BGP? Is there anything in development? It does seem to be a mess, especially with bad actors.
It takes you defining "fix" and "broken"
Here it did exactly what it is supposed to. It is how the backbones update and share routing information such as how and where to reach a network.
Level3 told their routers to tell the Internet everything was reachable through Level3.
BGP did exactly what it was told to do.
Re: (Score:2)
Probably a trust and vote mechanism that lets the other carrier / peers weigh in on routes, changes, etc.
Re: (Score:2)
Yes, actually (Score:5, Funny)
Anyone experiencing any connectivity issues this morning?
Well, since you asked, yes, actually, I did experience some connectivity issues. There was this tech website I read sometimes, Slashdot.org, that wasn't working for most of the morning.
I think it's back up now, I'm not sure.
Re: (Score:3)
Thank god. Unable to start a pointless argument on the internet this morning I ended up arguing with the wife about who's turn it is to cook dinner. Glad we're back to normal.
Now argument ... Ooh I know one: You're wrong, Slashdot isn't a tech website. It's news for nerds.... mostly political nerds it seems.
Re: (Score:1)
Slashdot is still taking about 15 seconds to load any page.
located in zip code 78380 and using PIA [private internet access] but still bad with normal ISP connection from Sputum [sorry, spectrum]
Only one problem (Score:2)
This morning I was not able to connect to this very site on several attempts. This would have been around 6 AM to roughly 7 AM ET.
Other than that, no issues anywhere.
Level3's fault (Score:5, Informative)
I received this alert from our hosting provider (followed by 100s of customer emails who apparently didn't get the memo):
Level3, one of our network providers, has been having a major
intermittent outage affecting at least the East Coast of the
United States since approximately 6:00 AM this morning. They
are accepting traffic for our network and dropping 50% or more
of it. Even when we shut down the line, they continue to
announce and drop traffic (a situation reported by other
network operators in a variety of locations as well). Until
they correct their configuration issue and honor our requests
to stop announcing our traffic, this problem will persist. We
are keeping as much pressure on them as we can to resolve the
issue. Anyone who reaches our network via any of our other
network providers -- Telia, GTT, or Cogent -- will be
unaffected.
Oh well (Score:2)
Acquired, not renamed (Score:5, Informative)
Re: (Score:2)
True, but the same crappy service remains. They kept something!
Cloudflare (Score:1)
Aren't those the people that offer that fancy schmancy "secure" DNS thingy?
Re: (Score:1)
Cloudflare is something I grudgingly allow Noscript to temporarily allow when a page I really want to see is blocked. It's just a nasty speedbump.
CenturyLink has been very poorly managed. (Score:1)
Hope that explaims my issue (Score:2)
Re: (Score:3)
No internet via my Pihole today - solved thanks to a poster on Reddit who mentioned this was going on.
Swapping upstream DNS server to Google sorted it for now, I think it was Quad9 I was using before (forgotten already)...
Um, Yes (Score:2)
I was awoken more than once last night by system alerts followed by reports from my colocation provider that they were disconnecting traffic from CenturyLink but that CenturyLink was still advertising routes. Some traffic to vendors/clients got through and other didn't. Major screwup by CenturyLink.
Re: Um, Yes (Score:1)
We had the same issue, disconnected it connection from CenturyLink but they continued to advertise our routes, my traffic was reaching remote locations but the return traffic was just disappearing.
hacked? (Score:1)
Over the last week, I've been getting scam calls on my home phone allegedly from CenturyLink wanting me to let them in through Teamviewer or through a tinyurl so they could "update the firmware" on my modem, Well, they're not my ISP....So maybe someone found a way into their root system? I'm in Northern Nevada and CenturyLink only has a small footprint in the Vegas area
Who is going to make sure this won't happen again? (Score:1)
Re: (Score:1)
Why does this always seem to happen to Cloudflare? (Score:3)
Connectivity issues today? Try the past week! (Score:1)
I've have CenturyLink DSL and on the most part have been happy with it as it is reliable and inexpensive compared to cable and I can get static IPs which cable require you to spend more and have a business account. This past week has been nothing but issues. Disconnects every 40 minutes or so or very slow speed. Had CenturyLink check my line and twice they said they will send someone out. They claim they did on at least one occasion but could not prove it by me. Now I am hearing it may have all been due to
The young and beautiful (Score:1)
Level3 is owned by Century Link. (Score:1)