Google's Chiller-Less Data Center 132
1sockchuck writes "Google has begun operating a data center in Belgium that has no chillers to support its cooling systems, which will improve energy efficiency but make weather forecasting a larger factor in its network management. With power use climbing, many data centers are using free cooling to reduce their reliance on power-hungry chillers. By foregoing chillers entirely, Google will need to reroute workloads if the weather in Belgium gets too warm. The facility also has its own water treatment plant so it doesn't need to use potable water from a local utility."
Global warming (Score:1, Troll)
Re: (Score:1, Insightful)
Re:Global warming (Score:4, Interesting)
Re: (Score:3, Insightful)
Re: (Score:1)
Re: (Score:3, Funny)
No. They will just sponsor Al Gore to speak about global warming at a local meeting. Thanks to the Gore Effect [news.com.au], the temperature usually drops dramatically as soon as Gore arrives.
The worst part of global warming has been the cold (Score:2)
Last winter in the U.S. here, it was so cold and icy it was not safe to go downtown for several days.
Re: (Score:3, Funny)
Guess they'll be in big trouble when global warming strikes Belgium!
Don't be silly. Everyone knows that Belgium doesn't really exist. [zapatopi.net]
Re: (Score:2, Informative)
If global warming ever did what the alarmists keep saying it's going to do, chillers would probably become completely irrelevant, since about two thirds of Belgium would be continuously surface-mounted with a very large water-cooling rig and heatsink, sometimes known as the North Sea.
What's next? (Score:5, Funny)
Soon they will generate all their own power from wind and solar, convert all their employees shit to power so they don't need the sewerage system either, send all their traffic through the network of low earth orbit satellites they are about to launch which also conveniently beam solar power back down to them.
So basically at the end of the day they will be able to buy or swindle a plot of land from some country with low tax, bring in all their own employees, contribute absolutely nothing to the local economy and leave when the sun goes down. It's great really, saves them on lawyers that would otherwise help them pussyfoot through the swaths of modern over-regulation and the satellites will help them get past any censorship / connectivity problems.
And if China start shooting down their satellites, Google will make satellites that shoot back
Re:What's next? (Score:5, Funny)
I am totally buying Google stock if they do this.
Re: (Score:1, Funny)
You can't generate power from Google employees shit; power generation requires stinky shit and their shit does not stink.
Unreliable... (Score:5, Interesting)
Re:Unreliable... (Score:5, Interesting)
Re: (Score:1, Insightful)
Of course, if they have to do the re-routing 10 or so times a year, they will get the kinks worked out. That is far better management scheme than having a fail-over plan that never really gets tested. Also, when temps rise, they probably won't be completely off-lining this data center, just a fraction of the containers within it.
I also wonder if they might not be fibbing a little, the air handlers come in different types. For chilled water use, they wouldn't have compressors, the chilled water is run thr
Re:Unreliable... (Score:5, Informative)
I just designed a data center for a large Big Ten univeristy and there were no large air handlers involved at all. The system had two 400-ton chillers with the chilled water piped directly to rack mount APC fan coils. Without "green" being the basis of design, the chiller system still operates right at about 1kW/ton.
Re: (Score:3, Interesting)
Re: (Score:3, Informative)
Re: (Score:2, Informative)
Re:Unreliable... (Score:4, Interesting)
I am kind of confused about how many kW of power it takes to transfer heat. Heat moves from high to low, you have to pump cold water through a coil and force warm air across that coil. The amount of heat transferred is a function of the face velocity and temperature of the air across that coil, the amount of fluid moved and temperature through the coil and the characteristics (fin spacing, fin size, material) of the coil.
The temperature of the computers isn't really the important factor, it is the heat rejected. Again using rules of thumb, you can assume that 80% of the electrical power delivered to the computers will be dissipated as heat. The total of that heat rejected along with the other heat inputs to the space, e.g. lighting, walls, roof, window loads, etc., will determine your cooling load. Almost all of this load is sensible, meaning heat only, for other occupancy types you would also have to consider latent (moisture) loads as far as people and ventilation air in determining the amount of cooling needed.
Re:Unreliable... (Score:4, Informative)
? 100% of the electrical power delivered to the computer is dissipated as heat. It's the law. It will be far less than the nameplate power (that electrical uses), and perhaps 80% of what is delivered to the building (after transformer, UPS, and PDUs), but it all ends up as heat (unless you're splitting hairs about the acoustical energy emissions and velocity pressure in the exhaust, which is small and quickly converted to heat).
Re: (Score:2)
Re: (Score:2)
400 ton, and they did it with water, not glycol?
Can you talk a little more about the decisions between those 2?
Re:Unreliable... (Score:5, Informative)
Re:Unreliable... (Score:5, Interesting)
The 81F water can be produced directly from open cooling towers (direct evaporation) whenever the wetbulb is lower than 76F (4 degree approach plus a 1F on your flat plate that isolates the datacenter loop from the open tower loop).
You designed an efficient datacenter, but you're five years behind cutting edge (not actually a bad thing for most critical environment clients). The next wave of datacenters will have PUEs of 1.2 or less and redefine the space from a noisy but cool space to hang out to a hot machine room with industrial heat exhaust design.
I actually just finished a chiller less 8MW schematic design and analysis for a bid. It was my second this month (the first was a cake walk - an extreme Twb of 67F, the second was west coast light conditions).
PS: Secondary pumps? Seriously? Unless you have to boost up to 25 psi to feed a Cray or some other HPC I thought everyone who cared had moved onto variable primary-only pumping. (Sorry, feeling a bit snarky after hitting a 40 hour week on Weds...)
Re: (Score:3, Informative)
Primary loop is feeding the chiller. Most chillers don't like variable flow. The secondary loop is feeding the load.
Re: (Score:3, Insightful)
Servers may be able to operate at 90-100, but they simply won't last as long being cooked compared to equipment that lives at cooler temperatures. This probably doesn't matter if you're Google and don't care about burning hardware or if you have money to spare and are always installing new equipment, or would rather generate truckloads of electronics waste replacing servers faster than a cooler facility just to get a PUE to brag about. The rest of us will have to settle for server rooms with air conditionin
Re: (Score:3, Informative)
Operating 500 hours a year at 90F (the peak of the allowable range) is unlikely to impact longevity. 100F is outside of the allowable range. Your opinion is contradicted by what IBM, Intel, Dell, Sun, and numerous datacenter owners along with the design professionals at ASHRAE have developed over the course of several years of research and many (mostly dull)
Re: (Score:2)
The only actual experience I have that contradicts your opinion is a UPS shorting its inverter and static bypass after two years of being in an 80-90 degree room during the summer, giving it a peak internal temp of 110.
Re: (Score:2)
Re: (Score:2)
If you have chilled water, you have a chiller, which means you have compressors
While I agree with you on that point, I think what the GP was saying is that it is indeed possible that the CRAC units being used at Google's "Chiller-less" Data Center could very well have compressors contained in them, along with condenser barrels.
You'll notice TFA does not specifically say that there is no mechanical cooling happening at this site, only that their focus is on free cooling. It could very well be that these CRACs have the ability to modulate between mechanical cooling and water side
Re:Unreliable...Probably not (Score:5, Insightful)
I think the concept is interesting, and it makes me wonder if we'll see more datacenters built in areas of the world more conducive to projects like this in the future.
Re: (Score:2)
Already happening in a way. Check out EDS's Wynyard facility. They didn't eliminate the chillers entirely last I looked, but in that climate they could have if they trusted the outdoor conditions and local code officials (open cooling towers are subject to abrupt shutdown if there is a Legionella scare anywhere near by in Europe).
Alth
Re:Unreliable...Probably not (Score:5, Interesting)
Re: (Score:2)
Re: (Score:2)
Or, if you're Google, you have a metric shit-ton of servers and don't care too much about reducing the MTBF of a few hundred racks by running them hot.
Re: (Score:2)
I was under the impression (mostly from tons of slashdot articles on the subject), that Google had done the research on this and determined that the higher temperatures did NOT reduce the MTBF of the hardware. Seriously, 90F into the equipment isn't that hot.
Re: (Score:3, Funny)
So basically everything gets rerouted on a hot day.
Exactly, and you can stop googling, get out of the basement and go to the beach. How bad is that ?
Re: (Score:2)
Except that its not "everything", even on a hot day, its just that the total load at that center must be reduced (not eliminated) on a hot day.
Google needs to have many data centers, and problems it has had in the past have shown that it needs to have the ability to seem
Re: (Score:2)
They sit where temperate ocean water meets cold arctic air, resulting in a relatively narrow and predictable temperature band which happens to be perfect for cooling datacenters with minimal, if any, conventional HVAC. Their power is green, and they have lots of it. They use a combination of hydropower and incredibly abundant geothermal heat for power generation. Recently, undersea fiber cables have been laid down, greatly increasing their connectivity to the outsid
Worth the tradeoff? (Score:4, Interesting)
Re:Worth the tradeoff? (Score:4, Insightful)
If you're Google? Apparently the answer is "yes."
More people can and should do this. 27C is plenty cool enough for servers. It annoys me to go into a nipple crinkling datacenter knowing they're burning more juice cooling the darned thing than they are crunching the numbers. A simple exhaust fan and some air filters would be fine almost all of the time, and would be less prone to failure.
Re: (Score:3, Interesting)
It's probably not as much about the energy bill as it is about the PR.
If it wasn't PR, they'd have chillers 'just in case', even if turned off most of the time. As it stands, they may be subject to a large risk of month-long heat waves killing them on paying idle employees, taxes, and taking a hit on capital depreciation costs for zero productive output that they are presumably banking on by bothering to build another datacenter.
Of course, there may be something unique about the site/strategy that makes th
Re: (Score:1)
I've seen facilities that are largely cooled by climate pretty far north that still keep chillers on hand in the event of uncooperative weather.
Very true, but this is Google we're talking about; their re-routing ability is phenomenal thanks to the sheer number of data centres they have across Europe. The latency cost for a re-route away from Belgium to North France or North Germany on a hot day is minor, most companies wouldn't have so many similar data centres proximal to the one shut down by inclement weather - it's a risk that will more than pay off. Besides, everyone gets lethargic on hot days - it seems Google now does too!
Re: (Score:3, Interesting)
Yes , but not because of the bill itself.
Google has been actively developing a reputation in the corporate world for squeezing the most CPU-bang out of a buck, and a great way to do that is by cutting down on the amount of power a CPU uses.
A few weeks back there was an article on Slashdot which discussed a before-unseen Google innovation concerning its servers - a 12 volt battery that cut the need for an APC (which lowered costs by lowering both the power flowing to the CPU and the power required to cool th
Reroute the weather instead (Score:5, Funny)
Re: (Score:3, Funny)
Re: (Score:1)
Where your search is dynamically routed to the nearest seed in the cloud.
Please remember to seed after downloading your search results damn leachers.
Re: (Score:2)
Re: (Score:3, Funny)
Running on the dark side of the planet (Score:1, Interesting)
I wonder if it would be feasible to have massive passive cooling (heat sinks, fans, exhausts from the data center, etc.) and run the data centers which are currently at night (i.e. on the dark side of the planet.) and constantly rotate the workload around the planet, to keep the hotest centers in the coolest part of the planet. The same logic could be applied moving workloads between the northern and southern hemispheres.
Yes, there would be tons more telecommunication to do, with the impacts on performance,
Re: (Score:1)
Except that the highest load on data centers is generally during the local day or at least not at like 5am when its the coldest. I would imagine routing the traffic all the way to the dark side of the planet would produce less than acceptable latency for most uses. This might work for other types of work but I don't think it would work for anything web and response time based like google.
Plus routers/bandwidth isn't exactly cheap and costs would go up if companies started using these methods. I'm not goi
Re: (Score:2)
1 - You are thinking too small and apparently you are falling for the idea that Google is "just a search engine". It's OK. Many people do that.
It is not all "web", nor do they have to use all their power for themselves.
The idea is to offer "virtualized workloads" to your customers - workloads that you then shift around the world to the "cheapest work-area at the moment"
Which MIGHT cost you a pretty penny - unless you have your own global network of datacenters built for just such a purpose.
You know... somet
Correction... (Score:2)
UPS! Lost a couple of words there, putting that link in.
That last sentence should read:
As for placing datacenters beyond the arctic circle - my guess is that they are going to keep building their datacenters closer to the internet backbones [nemako.net] for some time to come.
Actually... (Score:3, Insightful)
I did read the PP and I've even replied to it.
And I thought that I was clear enough in my reply, but apparently not.
See... the game is not most power-efficient cooling, or even best cooling.
The game is "most bang per buck invested in the server infrastructure".
Now... Saving money by reducing the cooling costs by using huge passive cooling farms is a nice idea, but not as easily calculable as simply switching to cheaper electricity.
Sure, should you move your servers to Siberia you would get shitload of passi
RTFA - Google already thought of that... (Score:2)
An Enabler for "Follow the Moon"?
The ability to seamlessly shift workloads between data centers also creates intriguing long-term energy management possibilities, including a "follow the moon" strategy which takes advantage of lower costs for power and cooling during overnight hours. In this scenario, virtualized workloads are shifted across data centers in different time zones to capture savings from off-peak utility rates.
This approach has been discussed by cloud technologists Geva Perry and James Urquhart as a strategy for cloud computing providers with global data networks, who could offer a "follow-the-moon" service to enterprise customers who would normally build data centers where power is cheap. But this approach could also produce energy savings for a single company with a global network - someone like Google.
Re: (Score:2)
Clearly not astronomers.
Investing (Score:3, Funny)
I think Google needs to start investing some time and money into buying or building Nuclear Power Facilities.
It could pay off for them, because they certainly don't need all of the power they would generate, and could sell some back to the Country/State/Region they build it in.
Sounds like a win-win to me.
P.S. - Please don't start a flame war about how Nuclear Power is 'unclean' or 'dangerous' -- in today's society it is cleaner, more efficient and just as safe, if not safer, than coal-fired generators.
Re: (Score:1)
Re: (Score:2)
A nuclear power station does make sense as an investment for Google; after all, they've got plenty of experience [reuters.com] of investing in things that are never going to make a profit [greenpeace.org.uk].
Re: (Score:1)
Maybe this sort of initiative is just what is needed to renew public interest in nuclear power. If a business like Google can show that it is clean, safe and reliable, perhaps governments and "environmentalists" can see through the FUD and support nuclear for national grid power.
Re: (Score:2)
Great Opportunity for New Zealand (Score:2)
Re: (Score:1)
Only problem is getting enough bandwidth to/from New Zealand to make the data center worth it. It's one thing to build one there and have it be super efficient and climate effective, but it's another to have all that greatness and not be able to get enough information to/from it.
This picture [infranetlab.org] only shows 1 cable from NZ to NA, and none to Europe, so I'd say it's out of the picture.
Re: (Score:2)
Not all of North America is hot in the summer...
Average high in SFO for July-September is 72
Average high in SEA for July-Aug is 76
Lots of places on the west coast rarely get warm. This is one reason everyone and their kid brother has moved there, which is why real estate is so expensive...
This might be a dumb question (Score:3, Interesting)
But if your data center is in say, Minnesota, it seems like you could balance the temperature with outside air for many months out of the year. Obviously you'd need to light up the chillers in the summer, but running them 4 months out of the year seems like a huge energy savings than running them year round.
I remember visting Superior in the summer and the lake water was freezing f'ing cold even in June. Wonder if you could run a closed loop heat exchanger without screwing up the lake environment?
Re:This might be a dumb question (Score:4, Informative)
I don't know about natural lakes but man made ponds have been used for just that purpose.
Re:This might be a dumb question (Score:4, Interesting)
I don't know about natural lakes but man made ponds have been used for just that purpose.
Man made ponds are used because the EPA crawls up your ass if you want to use a natural body of water for any commercial/industrial output.
Note: I'm saying that's a bad thing. I'm glad the "good old days," when chemicals, raw sewage, and cooling water were dumped willy nilly into the waterways and drinking supply, are gone. You warm up an area of water 10 or 15 degrees farenheit and you'll kill most everything living in it but algae.
Re: (Score:2)
Re:This might be a dumb question (Score:4, Informative)
Cornell University actually did this exact thing to cool a good chunk of the campus. It's called lake source cooling [cornell.edu]. While there will of course be some environmental impact, the energy usage is 20% of normal chillers and thus is, I'm sure, an environmental net gain.
Re:This might be a dumb question (Score:4, Informative)
They do! Well... not Superior, but Lake Ontario.
Toronto has a rather large system that uses deep, cool water as a heat sink.
Enwave [wikipedia.org] is the company that provides this service.
Re:This might be a dumb question (Score:5, Informative)
http://en.wikipedia.org/wiki/Deep_lake_water_cooling [wikipedia.org]
http://en.wikipedia.org/wiki/Geothermal_heating [wikipedia.org]
Re: (Score:1)
Re: (Score:1)
The rough answer is yes you can, but there are probably questions about how much you are willing to screw up the environment and whether or not you can get licensed:
http://en.wikipedia.org/wiki/Presque_Isle_Power_Plant [wikipedia.org]
(I'm not asserting anything about how much heat the Presque Isle Plant releases into Lake Superior or about how much damage that heat does, but it probably releases a significant amount of heat, and it probably has some sort of license)
Re: (Score:2)
The rough answer is yes you can, but there are probably questions about how much you are willing to screw up the environment and whether or not you can get licensed:
In high school we went down to the Oyster Creek nuclear power plant a few times for class trips. They have a cooling water drain to a creek that eventually feeds into an estuary. In the winter, the area is teeming with wildlife that love it. There are clam beds unlike any area around it. They've actually created fish kills by turning off the
Re: (Score:3, Interesting)
I blame that bastard Carnot personally for this... They could get additional work out of that hot water, but it gets prohibitively expensive the lower your delta T between hot and cold gets. I was all stoked about finding some sort of stirling heat engine to run off some datacenter waste heat, until I worked the numbers and found the annual average maximum therorectical efficiency was under 15%.
F*cking entropy.
Re: (Score:2)
"Just too expensive" makes perfect sense. I think their dump limit is at 97 degrees F.
Thanks for the reply.
Re:This might be a dumb question (Score:5, Interesting)
The short answer is yes --- water takes a staggering amount of energy to change temperature (it's one of the many properties the stuff's got that's really weird). A big lake makes an ideal dumping ground for waste heat. What's more, the environmental impact is going to be minimal: even the biggest data centre isn't going to produce enough waste energy to have much effect.
(A big data center consumes about 5MW of power. The specific heat capacity of water is about 4kJ/kg.K, which means that it takes 4kJ to raise the temperature on one kilogram of water by one kelvin. Assuming all that gets dumped into the lake as heat, that means you're raising the temperature of about 1000 litres per second by one kelvin. A small lake, say 1km x 1km x 10m, contains 10000000000 litres! So you're going to need to run your data centre for ten million seconds, or about 110 days, to raise the temperature by one measly degree. And that's ignoring the cooling off the surface, which would vastly overpower any amount of heat you could put into it.)
(The same applies in reverse. You can extract practically unlimited amounts of heat from water. Got running water in your property? Go look into heat pumps.)
In fact, if you were dumping waste heat into a lake, it would make sense to try and concentrate the heat to produce hotspots. You would then use this for things like fish farming. Warm water's always useful.
Re:This might be a dumb question (Score:4, Interesting)
At those latitudes the ambient subterranean temperature remains pretty ambient all year long. Drill into the side of a mountain or hill with a boring tool, leave the edges rough (with a smooth poured/paved floor for access) and just drop your server containers in there with power coming in. If you go all the way through the hill you can use the natural air currents to push/pull air through the tunnels, and the natural heat absorption qualities of stone will keep the temperature down. I'd be surprised if any active "cooling" were needed at all.
Re: (Score:2)
I wasn't aware of that; interesting.
The technique I described wouldn't need to be done in Belgium, though. I'm sure any one of the Nordic states would be well suited for it.
Yakhchal (Score:5, Informative)
The ancient Persians had a passively cooled refrigerator called the yakhchal [wikipedia.org] which "often contained a system of windcatchers that could easily bring temperatures inside the space down to frigid levels in summer days."
Perhaps the Google datacenter could employ some variation of their technique.
Re: (Score:2)
Sounds like something out of Dune.
Re: (Score:3, Interesting)
This reminds me of a technique for cooling water in a desert which could tenably be applied to the data center as well.
Basically, a container is filled with water, closed/sealed, and wrapped with a damp/wet towel and buried in the ground (or just placed somewhere in the sun, I suppose). The evaporation of the moisture in the rag will draw the heat from the inside of the container, resulting in frigid water.
Put a data center on a dry coastal equatorial area and harness solar to desalinate the water. Build th
Re:Yakhchal (Score:4, Interesting)
There is a way to make ice in a dry environment by exposing water to the coolness of the night sky and insulating it during the day.
More interesting than we think... (Score:4, Interesting)
Good to see. (Score:3, Interesting)
Energy tradeoff of treating own water (Score:3, Interesting)
I'm not sure I understand why they constructed their own water treatment plant. I would think that it would be more energy efficient on the whole to use the already constructed municipal system in the area.
Re: (Score:3, Informative)
Re: (Score:3, Informative)
Municipal water (at least here, in the US) means "chlorinated water". Chlorine does terrible things to pipes, coolers, pumps - everything. Having your own water treatment system means the chlorine never gets in, saving bundles in maintenance. To get an idea, find two similar water cooled vehicles - one which has had chlorinated water added to the radiator routinely, and another whose owner has been more choosy. Look down into those radiators. I've actually seen copper radiators corroded out in states t
Re: (Score:2)
Re: (Score:2)
Err... (Score:2)
Re: (Score:2)
Iceland (Score:2)
Lots of cool weather and lots of cheap geo-thermal power.
Just being lobby-savvy... (Score:3, Interesting)
Re: (Score:1)
>At two meters below grade the soil is a constant 50F/10C or so.
Unless you introduce a heat source, and then it's extremely difficult to lose that heat since you're in such a well-insulated environment.
Similar problems exist in cooling spacecraft. Sure it's "cold" in space, but if you have a local heat source that you want to shed, where do you send it and how?
Re: (Score:2)
The maximum temperature in Brussels during summer reaches 66 to 71 degrees,
Holy crap! And I thought it got hot around here when it hit 39 last year! I always thought Belgium was in northern Europe.. 66 degrees sounds more like the tropics to me!
Re: (Score:2)
Fahrenheit or Celsius?
Well, being as only a couple of backwater countries still use Fahrenheit, and Belgium isn't one of them, that must mean that temperatures discussed are in Celsius.
Re: (Score:1, Insightful)
Did anyone else think of weed when reading "chiller-less" and "Belgium"?
That's Netherlands.
Re: (Score:2)