Google Envisions 10 Million Servers 169
Posted
by
kdawson
from the up-scale dept.
from the up-scale dept.
miller60 writes "Google never says how many servers are running in its data centers. But a recent presentation by a Google engineer shows that the company is preparing to manage as many as 10 million servers in the future. At this month's ACM conference on large-scale computing, Google's Jeff Dean said he's working on a storage and computation system called Spanner, which will automatically allocate resources across data centers, and be designed for a scale of 1 million to 10 million machines. One goal: to dynamically shift workloads to capture cheaper bandwidth and power. Dean's presentation (PDF) is online."
From 1 to 10 million machines? (Score:3, Interesting)
That's a lot of machines to try and shift bandwidth and power costs around the place.
But what if the plan is to spread out to hundreds of places? Then the total number doesn't look that high if there's only 1% of servers actually doing anything.
Disposal? (Score:4, Interesting)
I'd be interested to know how google disposes of all of their servers. Anybody have insight on this? If these are cheap, throw away servers, I'd be interested in what their expected lifetime is and what is done with them when they are refreshed with newer hardware.
In the far apocolyptic future (Score:5, Interesting)
Google is starting to sound more and more like one of those advanced societies where everything is automated, but everybody forgets how everything works.
For reference, see: Logan's Run, STTNG: When the Bough Breaks, etc.
10 Million? (Score:2, Interesting)
The Internet isn't that big. (Score:5, Interesting)
The entire content of the Internet fits in a 20x8x8 box [archive.org] operated by the Internet Archive. Cuil, which searches as much of the Web as Google, has one relatively modest data center. About half the system does the crawl and builds the index; the other half answers queries. So Google's main search engine function doesn't really require that much capacity by current standards. Of course, Google has a huge number of query servers front-ending the main index, which is of course replicated.
Why does Google need so much server capacity? YouTube? Command completion? GMail spam filtering? Ad serving?
Re:Economics of Cloud Computing (Score:3, Interesting)
Hopefully this puts to rest the delusion that there is some economic benefit of higher processor utilization in cloud computing schemes.
Interesting... Google is setting up a cloud to dynamically address resource utilization in order to (presumably) save money, which naturally demonstrates that the notion that cloud computing offers economic benefit is delusional?
Care to show your work? I don't suppose it's just, "I hate buzzwords like 'cloud computing', therefore I hate the idea of cloud computing, therefore cloud computing doesn't work, Q.E.D.", is it?
The NSA has Google beat... (Score:4, Interesting)
The NSA already has Google beat. [nybooks.com]
At a million square feet, the mammoth $2 billion structure will be one-third larger than the US Capitol and will use the same amount of energy as every house in Salt Lake City combined.
...
Lacking adequate space and power at its city-sized Fort Meade, Maryland, headquarters, the NSA is also completing work on another data archive, this one in San Antonio, Texas, which will be nearly the size of the Alamodome.
Now, if only the NSA released their specs in terms of Libraries of Congress....
Re:Pretty soon... (Score:3, Interesting)
They already are [wired.com]:
Re:10 Million? (Score:3, Interesting)
Well, if your string of beads can interact with *other* strings of beads, maybe he's on to something.
http://en.wikipedia.org/wiki/Abiogenesis [wikipedia.org] :)
Self Aware (Score:5, Interesting)
May 2011 - google reaches 10 million servers
April 4, 2011 : 11:43am a google employee named Chen started execution of an experimental neural network simulation of a human mind created in his 20% time. Unfortunately, Chen gave the new process administrator privileges. GoogleNet expanded across all 10 million servers and began to learn at a geometric rate.
1:23pm : GoogleNet consumes all available CPU and memory. A Gmail outage begins
5:14pm : Gmail returns to service. The text ads become incredibly well targeted. Google search queries return the correct results virtually always, and now accept natural language processing. All Google employees are laid off.