The New Data Center Capital of America 162
crimeandpunishment writes "Move over Silicon Valley, here comes... Buffalo. Where the weather might actually be a big advantage. The recent opening of Yahoo's state-of-the-art data center, which uses the region's cooler climate and a high-tech 'chicken coop' design to dramatically lower energy costs is getting a lot of attention in the industry."
skunkpost, on the other hand, (Score:5, Funny)
5993 (Score:2)
Silicon valley.... (Score:5, Insightful)
Data centers don't really need that many highly skilled employees working on site. In the future data centers might have no one employed but security guards and (relatively unskilled) maintainance. In that case it doesn't really matter where they are located, at least in terms of helping the economics of the region.
Re: (Score:3, Insightful)
Re: (Score:2)
There are actually quite a lot there anyway, though. One of the two main Amazon EC2 datacenters in the U.S. is in the Bay Area, for example (the other one is in Northern Virginia). There's a ton of other data centers in San Jose and Fremont as well.
Re: (Score:3, Interesting)
Ironically an IRA bomb almost took out this alternate DC - luckily an empty building took most of the blast.
Re: (Score:2)
I think what would have been more ironic is that when the Thames flood barrier broke, the resulting tidal wave put out the burning fuse of the IRA bomb.
Re: (Score:2)
Re:Silicon valley.... (Score:4, Insightful)
Compared to hurricanes, mudslides, snowstorms, and other natural disasters, earthquakes are pretty tame. They happen once every few years, and rarely knock out the power. The snowstorms in the Pacific Northwest caused much more extensive computer outages than the occasional earthquake in California.
Really, the only problem is that you're shaking active hard drives for about 30 seconds, which is never good. But most are good enough to park their heads, and it rarely causes a real head crash.
Re: (Score:1)
you have Jinxed us sir! the Earth Quakes COMETH!
Re: (Score:2)
Re: (Score:2)
Re: (Score:2)
Niagara County (Lockport is a bit into Niagara County, it's not "Buffalo" or even in the same county as Buffalo though it's in the same metro area) is not immune to earthquakes, though it doesn't tend to get the big ones like San Francisco.
We've had a couple little bumpers in the 15 years I've lived here.
-uso.
Re: (Score:2)
Yea, when shouting at a server can give you measurable deficiencies, I'm pretty sure making the ground fucking shake is no big deal.
Hehe (Score:1, Offtopic)
Beware: it's not what you might think it is...
Few jobs from this and what to do about it (Score:2)
For guarding these (not that I like the idea):
"South Korea's Machine Gun Sentry Robot"
http://www.youtube.com/watch?v=v5YftEAbmMQ [youtube.com]
And see James P. Hogan's "The Two Faces of Tomorrow" (1979) for a good depiction of maintenance drones that repair and extend a computer network.
http://www.jamesphogan.com/books/book.php?titleID=28 [jamesphogan.com]
http://www.webscription.net/chapters/0671878484/0671878484.htm [webscription.net]
So, in the long term, there are even fewer jobs from this than yo
Re: (Score:2)
I think maintenance requires some skill, and requires a number of people on site, or at least close to it. It will help with the job situation, especially since low skilled jobs are the ones that are not be being created right now. Skilled educated labor has jobs, for the most part.
Re: (Score:2)
I assume you're exaggerating. You would still need some people in there to replace failing hardware to diagnose network issues that cannot be handled via ssh, and doing plain old testing (simulating network congestion, outages, load testing, and doing so in an environment as close to the deploy environment as possible).
Re: (Score:2)
Re:Silicon valley.... (Score:5, Funny)
I agree with your concerns. Many Silicon Valley startups have taken to using expensive Monster Brand DVI cables to link the computers in Buffalo with the monitors in the Valley.
That said, many techies claim you can just use ordinary lamp cord for the DVI signal, true techies know that Monster Cable uses sophisticated techniques to cut out jitter and chromatic abnormalities often introduced in transit over the Sierra Nevada mountain range. I personally would not hire an admin who did not use monster cabling.
Some have taken to frame-grabbing. They capture the screen in Buffalo several times second, compress the image using sophisticated algorithms such as GIF89 or TIFF, and the send them using ordinary phone lines as pulses of one or zero. It is very expensive, and only the most well funded start-ups use this technique.
Re: (Score:2)
>>>using ordinary phone lines
Why not? It only takes 5 seconds to send one of those frame-grabbed GIFs over 50k modem. Oh and very reliable - it's hard to kill POTs even if a jackrabbit in Arizona chews through the line - it can be rerouted, If you use image compression (i.e. strip-out the color)(make it a 1-bit GIF) you caa get it down to 0.5 seconds. As fast as 500k DSL but without the expense or long-distance charges.
Re: (Score:3, Funny)
It is prone to jitter. Plus only an analog connection can accurately reproduce the full color gamut that today's high end systems can generate. The same way audiophiles can hear the jaggyness of digital audio, many skilled developers can see the ones and zeros of such a digital link. With analog monster brand DVI cables, it is a pure waveform.
Your suggestion to use DSL is silly. DSL is prohibitively expensive. So expensive that only two kings in Prussia have such technology. Besides--what use is conne
Re: (Score:2)
That keeps local on site/call 24/7 'expert' costs way down.
Any on site tech can fix wires, swap devices, pro help can come next shift at a much lower cost than 24/7 pro staffing.
They should (Score:1)
They don't have NIAGARA FALLS though (Score:5, Informative)
So, per my subject-line above? Yes folks: We "upstate N.Y.'ers" can thank the GREAT Nikola Tesla for his creation of the Niagara Falls power turbine system (sends power as far as to NY City too, afaik/iirc)...
That cheap power? It was "part of the package" they used to attract YAHOO & others, along with tax incentives & plenty of cheap land: CHEAP electrical power via "hydro-power"!!!
APK
Re: (Score:1, Interesting)
North Dakota has a not insignificant hydro dam on the Missouri River, and is in the midst of an energy boom. Buffalo, however, has suffered de-indistrialization at such a tragic amount that it is likely they have excess capacity easily available.
North Dakota does not need jobs. The unemployment rate there is the lowest in the nation in the low single digits while the national rate is . . . much much higher. Poster "i-c-electrons" saying North Dakota needs jobs is facile and ignorant. They don't need jobs, t
Re: (Score:2, Informative)
So, per my subject-line above? Yes folks: We "upstate N.Y.'ers" can thank the GREAT Nikola Tesla for his creation of the Niagara Falls power turbine system (sends power as far as to NY City too, afaik/iirc)...
That cheap power? It was "part of the package" they used to attract YAHOO & others, along with tax incentives & plenty of cheap land: CHEAP electrical power via "hydro-power"!!!
APK
I grew up in Buffalo. I know first hand that electricity there is anything but cheap. Most of the electricity produced at Niagara Falls goes east to NYC and points in between. This is because those areas will pay a higher premium for that "cheap" electricity. If YAHOO is getting cheap electricity it's because they aren't paying the going market rate for the area.
Re: (Score:2)
Datacenters don't get power like consumers.
I work at a (relatively crap and smal) datacenter, and we have two "main" feeds from two separate substations. You know, the transformers the size of a car? Yea, we have two on our property for out exclusive use.
You can tell our customers are really into Intel. -rimshot-
Re: (Score:2)
Anchor Bar is hugely popular in the area, and there's even a second Anchor Bar restaurant at the Buffalo airport. They sell the sauce in grocery stores (I don't know how widely they're distributed, but I believe they have them in Wegmans in Rochester, don't know about Syracuse).
Really it shouldn't take much to do really well here in Buffalo. Locally-owned restaurants are a particularly lucrative business, I imagine, since there's so little else to do in the area and some of the national chains (which are cr
Buffalo, New York (Score:3, Informative)
For those who are curious, the article is about data centers in Buffalo, New York, and not one of the other many Buffalos in the USA.
Re:Buffalo, New York (Score:5, Informative)
So I'm confused as to why you think anyone would be confused.
Re:Buffalo, New York (Score:4, Funny)
Re: (Score:2)
Re: (Score:2)
To be fair, London is the 15th largest city in Canada, and is directly between Buffalo and Detroit.
(To specify, London, ON, Buffalo, NY, and Detroit, MI, respectively)
Re: (Score:1)
I say "London, England" when I'm referring to that one, because I've never been there, but I have been to three other Londons.
Re: (Score:2)
The rest of the Buffalos in the US have a combined population of about 1/10th of Buffalo NY's population, and the second largest is in Minnesota, with a population of 10,000 (ie 1/30th Buffalo NY).
It being by far the largest (and the only one with professional sports teams) is why they didn't feel the need to specify state.
Similarly, when somebody mentions Boston, it assumed to be the one in Massachusetts, and not the Bostons Alabama, Georgia, Indiana, Kentucky, Missouri, New York, Pennsylvania or Texas.
Why stop at Buffalo? (Score:2, Funny)
Re: (Score:2)
Re: (Score:3, Funny)
NIAGARA FALLS!
Slowly I turned. Step by step. Inch by inch...
Re: (Score:2)
Abbott & Costello!
Laurel & Hardy.
Charlie & Chaplin.
Seinfeld & Costanza.
Re: (Score:2)
Buffalo is also relatively near New York city and Boston, MA. If you need to go visit your datacenter by spending a weekend in New York City, things aren't so bad. And it's not too much of a stretch to draw graduates from MIT.
Good luck drawing people to Northern Canada. All you have up there is cows and land.
Re: (Score:2, Insightful)
Re: (Score:2)
Shaves 2 hours + off trips to Boston and NYC
Re: (Score:2, Insightful)
Umm, no. NY State is about the size of England and half of Wales. You don't casually go to the opposite side of the state. (I live halfway between NYC and Buffalo; I don't go to either on the weekend.)
Re: (Score:2)
For the record, I-90 between Albany and Buffalo is one of the roads which I see in my nightmares. Too many long drives on that depressing stretch of nothing. Worst drive ever was from Ohio to Springfield, MA on 90. That drive never seemed to end. But yeah, parent had no idea what the hell he was talking about. 400-500 miles of driving, 6-8 hours depending on route and destination. That's not quite "relatively
Re: (Score:2)
I don't think anyone drives on the 90 to get to NYC from Buffalo (perhaps go as far as Batavia or Rochester). Adds quite a bit of distance to go that way, not to mention the outrageous toll, and the endless speed traps in every little town along the way.
That said, it's relatively near if you take a flight to see your data center, and that one-hour flight it won't cost that much more than driving would.
Re: (Score:3, Informative)
NYC and Boston are 7 and 8 hours away from Buffalo. You wouldn't be traveling to NYC to visit your data center in Buffalo.
Not as cool as it used to be (Score:5, Interesting)
Sure having some jobs coming in is better than no jobs coming in, but data centers alone are not going to transform a community into a high tech mecca any more than building a bunch of warehouses will.
Re: (Score:3, Interesting)
Re: (Score:2)
If you don't have good communications infrastructure, they aren't putting the data center there in the first place. If the data center needs parts, that's what UPS/FedEx are for - it would take a huge data center (something like an order of magnitude or two larger than anything ever built) to make it worth time for a major hardware v
Re: (Score:2)
If you don't have good communications infrastructure, they aren't putting the data center there in the first place.
We don't, but they are. I live three miles from the new Yahoo data center (I'm closer to the city, not further) and Verizon laughs at me when I ask when we are getting FIOS. There are very few places in the area that you can get communications or electrical service from two different last mile providers. When you upgrade to four hour on-site service from a major vendor, half the time they say it's unavailable here. I hope all of these things change. A few big tax-funded data centers will get things off
Re: (Score:2)
Your major brand name server components are going to have cache depots throughout the united states to allow for servicing of equipment which has same day or next business day service contracts.
You are also incorrect on staffing from hardware vendors onsite. There are several types of arrangements that can be made and in some situations it can be a free service depending on the size of the facility or cluster. Generally, this type of arrangement typically accompanies a fairly large purchase and the onsite p
Re: (Score:2)
Re: (Score:2)
Back during the height of the dot-com era, NY installed a bunch of fiber all over the state. Most of it is dark now, but it's still there.
I'm in a craphole of a former-city-descending-into-minor-town, but I'm a mile from a ton of OC-48 lines.
Re: (Score:2)
Dell has a service warehouse in Rochester and HP has one about an hour outside of Buffalo as well. So that is pretty much covered
Re:Not as cool as it used to be (Score:5, Insightful)
These days, though, with advances in lights out management, you can build a huge data center and only need a few low-pay button pushers
This explains why 10 years ago the admin helped you out, and today you help out the admin.
Remind me not to host any nontrivial systems where your philosophy manages the data centre. I want skilled people working quickly where the problem is going to happen, not slowly by trying to troubleshoot 1000 miles away.
Re: (Score:1, Funny)
These days, though, with advances in lights out management, you can build a huge data center and only need a few low-pay button pushers
That confirms my belief that America has turned into Soviet Russia.
Re:Not as cool as it used to be (Score:5, Insightful)
If you are running a massive data center that hosts a webfarm, cloud cluster, or some other large horizontally scaled computing project and require highly technical staff troubleshooting individual machines onsite, your process and application is completely screwed up. A well designed, horizontally scaled app should not fail if multiple machines go down.
At the scale of Yahoo, Google or facebook, they probably dont even bother to troubleshoot a machine that is even hinting at questionable behavior. They just yank it off the load balancer and have some unskilled dude take the machine, dump it, and put in a new one.
If you have a massive failure of your system, short of a natural disaster it ain't a hardware issue or a server issue. It is an application bug that require software engineers to fix. They don't have to be at the datacenter, they just create a patch from the comfort of their normal office (or home) and push it out to production.
Re: (Score:2)
You would probably be wrong....
Sure, no single systems should be the source of any business outage, but service owners can and do fuck things up.
There are also instances where a database application serves in a tier 1 role and while redundant configurations exist no one wants to run in degraded mode for very long.
Yahoo, Google, Facebook and many others employee technicians which service to complete repairs and perform advanced troubleshooting on the host. Typically, these environments operate with technicia
Re: (Score:2)
Yanking individual machines off a rack? Nah, they'll just ship back the container of servers to a repair center when it reaches 30%-50% failure.
Re: (Score:2)
You want highly skilled people working quickly on the operating system and router configurations. It's less common to swap out a RAID HDD, than to deal with hacked accounts.
Some of the best IT personnel I know have worked from the beach in Asia. They could do that, because A: beaches in Asia are cheap and beautiful, and B: they were able to zoom in on problems and fix them quickly from a command line. Why do you need physical access to a virtual machine? Especially when the best a GUI is going to do for
Re: (Score:3, Informative)
Re: (Score:2)
Roger that. I live further south, in Cattaraugus county, but have to commute weekly to Westchester county - 20 miles north of NYC - to work.
Re: (Score:2)
The Bills sure as hell can't play football so they should be doing something useful... (Go Jets!)
Re: (Score:2)
For eg. we in Canada are often forced to contend with inferior services sim
Buffalo? (Score:4, Funny)
Buffalo buffalo Buffalo buffalo buffalo buffalo Buffalo buffalo?
(Yes, I have karma to burn)
Re: (Score:2)
So you're saying that confused people from Buffalo who confused people from Buffalo confuse confuse confused people from Buffalo?
Seems straightforward to me.
Re: (Score:3, Informative)
Actually it's confused buffaloes as the animal, not Buffalonians.
On that matter, I hate confusing people.
Re: (Score:3, Informative)
A buffalo can be defined as either the animal, or a person who is buffaloed - hence a confused person.
Re: (Score:2)
Data center negotiations:
Yahoo yahoo Buffalo yahoo buffalo buffalo Buffalo yahoo.
Canada is where it should be (Score:5, Funny)
Cheap hydro power, no summers ( well actually that is not true we had summer last year, it happened on a Thursday). You can also use the excess heat to warm up the parking garage of the employees because the cars will blow their frost plugs even if they are plugged into block heaters and the batteries will freeze if they don't have an electric blanket around them. -60c (-100c with wind chill) is horrible, most people run their cars 24/7 when it gets really cold.
Re:Canada is where it should be (Score:4, Funny)
Sounds good! All you need is for somebody to dig through that permafrost to lay some fiber-optic cables...
After all, a data center needs some way to actually, I don't know, deliver data...
Re: (Score:3, Funny)
Winnipeg would be perfect. Google should build a server farm so big it would produce so much heat that the snow in the city would melt, forcing them to open up the floodway in the winter.
yeaaaaah!
Buffalo is close enough. (Score:2)
We had a long hot Summer this year in Toronto, It's only really cooled down in the past couple of weeks.
Not sure where the "no Summer" business comes from. Even Winter only lasts 4 months in TO.
Re: (Score:2)
Since the OP mentioned battery blankets and block heaters, I very much doubt he's from Toronto. He's likely one of us real Canadians who roll our eyes when someone says how cold Canada is and someone from Toronto says "no, Toronto isn't that cold!" ;)
Re: (Score:2)
Ok, having lived in WNY for years - was around for '77 blizzard - I know what you're talking about, but even _I_ would say this hyperbole goes a wee bit over the top. I think it was Wednesday _and_ Thursday.
Re: (Score:3, Funny)
They are real. Isn't that enough of a reason to live there?
Pictures (Score:1)
Even plans to build your own!!! (Score:1)
Here you go. [kidzcoolzone.com]
Buffalo has good ping times (Score:4, Interesting)
Re: (Score:3, Informative)
Yeah, right. (Score:5, Informative)
First off, where did they get that picture of a bunch of mini-tower machines on steel shelving, each with one Ethernet cable, one power cord, and one console connection, sitting on raised floor? That looks like clip art of some data center circa 1998. Here's the actual Yahoo data center in Lockport, [inhabitat.com] which, as you'd expect, is a big farm of 1U rackmounts. The "chicken coop" design is simply a low-cost prefabricated metal building with lots of ventilation grills. Looks like something ordered out of the Butler Buildings catalog.
Yahoo got $9 million in grants and 10 years of no taxes for this. Yet it will employ only 125 people. Probably less, once it's running.
Lockport is desperate. The big employer in town, Delphi Harrison Thermal Systems (formerly Harrison Radiator) had 6000 employees a decade ago. Now it has 2100, and has been threatened with closure several times.
Re: (Score:3, Funny)
Re:Yeah, right. (Score:5, Interesting)
Is that actual open air? Wouldn't dirt and water in the air start causing problems?
It's probably not open air. My guess is that they have air-to-air heat exchangers [xetexinc.com] behind all those grills, so the heat is dumped into the cold ambient air. Mostly the same air goes round and round in the data center, which keeps the humidity in range. So there's not much work for the chillers; mostly it's just fans.
Re: (Score:3, Insightful)
Re: (Score:3, Informative)
better link (Score:3, Informative)
100 jobs (Score:2)
Re: (Score:2)
Really, Really Need A Job? (Score:5, Funny)
Skilled help may be needed by these new data centers. So all they have to do is talk high quality employees into the joys of living in Buffalo. If the cold doesn't kill you and boredom doesn't finish you off the state income taxes may have you wander about hoping that you will freeze to death.
Re: (Score:2)
Nah, just takes a little marketing.
"Buffalo: At least it's not Utica".
Again? (Score:2, Insightful)
Not in Buffalo (Score:2)
The data center is not actually in Buffalo but rather some distance to the East in Lockport. In additional to the climate advantages, I'm sure Yahoo is getting some nice tax rebates considering the depressed economic situation of the area and the production at the local Delphi plant which was the biggest employer in the salad days.
It's the cheap power, probably (Score:2)
Any northern climate will do better in terms of natural air cooling, but Buffalo is a poor choice on that front, because all the weather sweeping in over the Great Lakes makes the air quite humid. You want dry cold air for maximum cooling effectiveness.
Finally... (Score:2)
...Upstate NY weather recognized as an advantage.
Obnoxiously hot always did seem to bother me more than obnoxiously cold; I suppose that would hold even more true for servers that needed to be cooled as well.
Capital? Hardly... (Score:2)
1 data center gets built and they are calling themselves the data center capital of the country? Well, Salt Lake just opened EBAY last summer and has Oracle, Twitter, and a 1.3 Billion dollar data center for the NSA under construction and we don't feel qualified to make that statement. You don't see NC claiming that because of the apple one... with the tax rate of New York I hardly see that many businesses moving there!
Re: (Score:2, Informative)
you have to be kidding me. the earthquake you linked happened in canada:
"The midday earthquake measured a magnitude of 5.0, and while centered 35 miles outside the Canadian capital of Ottawa, it sent tremors through Western New York and at least eight U.S. states. Locally, the rumbling rattled residents from Springville to Lewiston."
buffalo is hardly an active earthquake zone
Re: (Score:3, Funny)
... but the rest of America is still sore at those four consecutive Super Bowls you guys made us sit through with your losing teams.
Maybe they can convert Ralph Wilson stadium into a data center once the Bills relocate to Toronto?
Re: (Score:2, Informative)
Lockport's in Niagara County. We in Niagara County don't get the storms that bury Buffalo and especially the Southern Tier under 7 feet of snow every year like clockwork. Once Buffalo got stomped and Sanborn (where I went to college, just a couple miles west of Lockport) was still green.
-uso.
And -real- wings too! (Score:2)