CenturyLink's Nationwide Outage Affects Millions 105
halfEvilTech writes "CenturyLink, the nation's third largest telco network, is experiencing an outage of its broadband service nationwide, leaving its support systems overwhelmed and even causing its website to hit a few snags this morning. The company, which at last count has 5.8 million broadband subscribers, has no estimates yet on how long it will take to restore service."
CenturyLink is the company that will be providing the Defense Department with the equivalent of Internet2.
Re: (Score:3)
Apparently a wide one.
Re: (Score:1)
FierceTelecom - "CenturyLink suffers Internet outage in 21 states"
This issue started at 4AM 5/7/2013 and lasted until just a few moments ago, at least in the Tallahassee/North Florida region. The outage took out a good bit of their national network, not just the local region.
Article - http://www.fiercetelecom.com/story/centurylink-wades-through-nationwide-internet-outage-customers-21-states-af/2013-05-07
Video - http://cdn.l2net.com/content/video/CTLFL-Outage-BGP-05072013.mp4
Re: (Score:2)
"...the people that it's affecting are unable to read or comment easily"
Actually, the outage ended about 15 minutes before this story hit slashdot; at least in Las Vegas.
Whne is the internet going to move to the cloud? Then these problems will go away.
Re: (Score:1)
zomg if I had mod points...
Re: (Score:3)
Are the majority of /. readers using Centurylink?
I used to (had no choice at a previous place I was renting out on the Oregon Coast) - service was crap but usable. However, it was their billing department who turned a 'first two months free!' promotion into a 'I'm sorry sir, but you owe us $126 before we can re-instate your service', in spite of never missing a payment. The nanosecond Charter showed up in the neighborhood a month later, I switched so fast that I could have almost not dropped a packet.
All I can say is - never again. Compare Centurylink's $
Re: (Score:1)
Are the majority of /. readers using Centurylink?
I used to (had no choice at a previous place I was renting out on the Oregon Coast) - service was crap but usable. However, it was their billing department who turned a 'first two months free!' promotion into a 'I'm sorry sir, but you owe us $126 before we can re-instate your service', in spite of never missing a payment. The nanosecond Charter showed up in the neighborhood a month later, I switched so fast that I could have almost not dropped a packet.
All I can say is - never again. Compare Centurylink's $70/mo for 3.5 Mb/sec and maybe 70-75% uptime, with Charter's $30/mo 30 Mb/sec and 99.999% uptime.
Fuck Centurylink.
We went Cox Business and never looked back!
Re: (Score:1)
$30/month for charter is the promo price. expect it to at least double.
Re: (Score:1)
Re: (Score:2)
Don't care - $60/mo for 30mb versus $70/mo for 3.(something)mb that breaks down all the time (and being billed as if it were a 6mb package)? No effing way.
Once upon a qwest (Score:5, Insightful)
Re: (Score:1)
NO management was lost at our location, and frankly there needs to be some that are cut. I don't see ANY noticeable improvement in ANYTHING under the new company.
Re:Once upon a qwest (Score:5, Insightful)
It's Qwest's famouse Spirit of Service
For CenturyLink, it was probably a good deal: They get to be a Tier-1 peer, instead of having to pay extortion fees like TIER-2 and 3.
It was a very good deal for Qwest's customers. They went from being limited to 1.5 Mbit to being able to buy "up to" 40 Mbit...
I dumped CenturyLink/Qwest long before then, but my brother supposedly got close to 30 Mbit measured.
Like most telecom idiots, CenturyLink has a 12-month "introductory rate", and they won't negotiate. Since all of their competitors do the same, the practice has become switching networks every year, after the introductory rate expires. The same applies if you have Cable or Satellite TV; customers just switch every year for a lower rate.
I really don't see how being so boneheaded helps either company, but that's telecom in the USA.
Re: (Score:2)
It's Qwest's famouse Spirit of Service
For CenturyLink, it was probably a good deal: They get to be a Tier-1 peer, instead of having to pay extortion fees like TIER-2 and 3.
It was a very good deal for Qwest's customers. They went from being limited to 1.5 Mbit to being able to buy "up to" 40 Mbit...
I dumped CenturyLink/Qwest long before then, but my brother supposedly got close to 30 Mbit measured.
Like most telecom idiots, CenturyLink has a 12-month "introductory rate", and they won't negotiate. Since all of their competitors do the same, the practice has become switching networks every year, after the introductory rate expires. The same applies if you have Cable or Satellite TV; customers just switch every year for a lower rate.
I really don't see how being so boneheaded helps either company, but that's telecom in the USA.
I had Qwest, then Centurylink took over and they kicked me off the service because I "download" too much.
I was pissed, but in hindsight, i got the better of the deal.
Re: (Score:2)
CenturyLink jacked my rates up, but I called them, they gave me a new deal. What's surprising about it is, in my BFE town, they are the only game in town, unless I pay over $100 a month for cable plus internet from Suddenlink.
Re: (Score:1)
I saved a bundle switching from Comcast to Century Link. I get 8 Mbps/down which is fine for my Netflix and other streaming needs. If the price goes up, I'll just switch back to Comcast on one of their introductory plans. Then again, in a year from now, it is likely that HSPA+ and LTE wireless broadband will be competitive with Comcast and Century link in terms of price for my personal bandwidth needs.
It's a good time to be a customer.
PS: I'm lucky. My Century Link connection is still up.
Re: (Score:1)
Same experience here. Comcast -> CL. 12Mbs. $30/m. No complaints so far.
Re: (Score:1)
Re: (Score:2)
I suppose it depends on the area; the contract lengths for home Internet service are actually zero in my area - from both Comcast, and CenturyLink. The introductory rates are still good for 6 months to a year.
State & local regulations, maybe?
Re:Once upon a qwest (Score:5, Insightful)
Qwest was the only telco to refuse warrantless wiretaps during the Bush era. I was happily a Qwest customer until they got bought out by CenturyLink. I would switch immediately to any telco that guaranteed refusal of any unwarranted requests. Unfortunately, none exist.
Re: (Score:3)
Actually, 1997 [nationaljournal.com], during the Clinton administration.
Re: (Score:2)
What about sonic.net? They may not be what you want, but they seem to come close:
http://boingboing.net/2012/06/25/sonic-net-stopped-saving-logs.html [boingboing.net]
Re: (Score:2)
Re: (Score:2)
Re: (Score:2)
Re: (Score:2)
Re: (Score:2)
Can't tell the diference here....
Outage didn't affect us...as far as i know...
We were down due to local problems at the same time but the line next door worked.....until they fixed this line then the other went down...sigh. Somehow fixing and rebooting my line down the street killed the modem for next door...whatever.
Generally been fine up until this year when they alternate breaking the dialtone and internet (never both,wtf) each month. 5 service calls this year between 2 accounts...not impressed.
Re: (Score:1)
My 1.5 Mb Century-link DSL connection is also still working normally. I have not noticed any problems now or from earlier this morning.
Re: (Score:2)
Re: (Score:2)
Seems to be fucking up a lot of news sites. They apparently host Ad servers.
Not me (Score:2)
My DSL is up. It's either fixed or didn't involve my part of the system.
CenturyLink (formerly Qwest in my case) has been very reliable during the past year. You get the rate you pay for as well.
Re: (Score:2)
"CenturyLink, the nation's third largest telco" (Score:2)
My DSL is up. It's either fixed or didn't involve my part of the system.
My DSL is up. It's either fixed or didn't involve my nation of the system.
Re: (Score:2)
Same here. I was streaming video last night as I went to bed and have been logged on to my VPN from work all morning. If it went down, it was between 11:30pm and 8am MST.
Re: (Score:2)
No estimates (Score:5, Insightful)
Having dealt with having to provide estimates on service restoration at work, my experience is that by the time you can figure out what it would take to restore service, it won't be long before service is actually restored.
I'm not saying that providing status updates isn't good practice. However, it is usually rare that you'll get an ETA on something being fixed. Maybe if they discover it is a broken line and they actually have to dig it up and fix it and that will take hours you might get an ETA. Usually root cause analysis is 95% of the work in problem solving.
Reminds me of a story at work when some developers decided to actually try to embrace the outsourcing model that was being pushed by management. They sent a list of bugs to the outsourced development team and asked for estimates to fix them. They replied, "no problem, just tell us which lines of code to modify and how and we'll take care of it." Now, THAT is a value-add!
Re: (Score:2)
Odd. When I called the support line (which I always do in the case of an outage, to see if the recording tells me it's a known issue) at around 9AM Eastern, the Estimate restoration was 7PM. Obviously, they beat that by several hours.
Maybe it's a regional thing, but I usually get estimates, even if they do go a little heavy on the Scotty coefficient.
Re: (Score:2)
Well, they can always make something up to keep you from calling back.
A manager in our operations support group once explained the situation to some internal customers - if the system is down, do you want everybody available to be fixing the problem, or do you want them to spend their time telling people that it is under control? (Mind you, this was only for internal customers.) The ultimate decision was that for very short outages they'd just deal with it, and once it was taking more than 15min they'd st
They promised the same rate f or 5 years ... (Score:3)
Its not the whole united states . (Score:3, Informative)
Western states in the former Qwest footprint seem to be up and running ok. East Coast Legacy Centurylink seems to be not having a good time of it though.
Suffice it to say, the sky is not falling and Centurylink is not pulling a "u-verse" on it.
Re: (Score:2)
DNS? (Score:1)
Re: (Score:2)
Glad I switched to Comcast last year (Score:2)
I had CL DSL for over 10 years.
I'm only 2600' from the CO, but the best they would sell me was 7mbs.
So I switched to Comcast and get 22mbs, *and* native IPv6, for less than I was paying CL.
Re:Glad I switched to Comcast last year (Score:5, Funny)
"Glad I switched to Comcast last year"
Those aren't words heard very often...
My service near STL is up. (Score:2, Informative)
I didn't notice any downtime.
Centurylink keeps raising their prices and lowering their bandwidth. I started out at 25 mbit fiber to the house. Then it went to 20, then 15, finally 10.
Prices went up in the meantime so I downgraded to 3 mbit. However they implement the cap seems to work worse than I'd expect. They also require a 1 year contract to get the "discount" rates and it has a $200 cancellation fee even though I don't lease a router and I've been a customer for 5 years.
Overall the local office has top
"The equivalent of Internet2"? (Score:1)
Sounds like it might be more like Internet0.
Glitch (Score:1)
Perfect (Score:2)
Sleep Tight!
Re: (Score:2)
Security by accident - now there's new sales pitch for their sales team to use.
Ah, Centurylink (Score:2)
I've used them for years and years (only broadband in my area). In general it's been a good service, but when they screw the pooch they go above and beyond. I'll never forgive them for leaving me with huge latency for 3 months. If I ever have a choice in broadband they will be gone.
http://ask.slashdot.org/story/12/03/06/175223/ask-slashdot-what-is-an-acceptable-broadband-latency [slashdot.org]
What outage? (Score:1)
I have been working since 8 AM Eastern Time as a telecommuter and my CenturyLink DSL has been up without so much as an SSH session disconnecting all day. I live in SW Florida and my colleagues tell me they're having problems but perhaps the outage is not as widespread as publicized or it's affecting DNS and I use OpenDNS instead of my ISP's DNS for filtering sites I don't want my kids to browse such as adult content.
In my experience, Cable modems were far less stable than DSL. I had Comcast for a while and
Nationwide? (Score:2)
clueless (Score:2)
So ... Re-using AOL Disks Again? (Score:2)
That caused the Three-Mile Island disaster. They should have learned their lesson.
DSL isn't even available in my suburban area (Score:1)
I can't even get Qworst ... I mean Century Link DSL at my home office in a major suburb of Denver not 5 miles from downtown! WTF???
Centurylink 12hr outage occurred May 3, NOT May 7 (Score:1)
The media reporting of this outage as occurring on May 7 is flat wrong. They're off by 4 days. Centurylink's network outage began at ~12:25 CST May 3 and ended at ~01:00 CST May 4. Following are the entries from my mail server log that show the start, end, and duration of the outage. Note the flurry of queued deliveries occurring after IP routing was restored at 01:02 May 4. You can clearly see there are no client connections between 12:20 CST May 3 and 01:02 CST May 4, about 12.5 hours. I called the