Amazon, MS, Google Clouds Flop In Stress Tests 154
Eponymous writes "A seven month study by academics at the University of New South Wales has found that the response times of cloud compute services of Amazon, Google and Microsoft can vary by a factor of twenty depending on the time of day services are accessed. One of the lead researchers behind the stress tests reports that Amazon's EC2, Google's AppLogic and Microsoft's Azure cloud services have limitations in terms of data processing windows, response times and a lack of monitoring and reporting tools."
what the fuck is services engineering? (Score:5, Insightful)
Anna Liu, Associate Professor in services engineering at the UNSW School of Computer Science told iTnews she was excited by Cloud Computing as it could potentially enable organisations to "outsource a certain amount of their risks and costs and tap into new economies of scale."
Sounds more like she has a degree in buzzword engineering.
Cloud Computing? Why? (Score:5, Insightful)
So, what exactly does "cloud computing" bring to the table for me?
Not much as far as I can see, other than a new crop of buzzwords.
Re:Quite interesting, actually (Score:3, Insightful)
IMO the entire cloud thing is nothing more than a hype. Noone ever got asked if he wanted to have all apps running as webservices. Google, MS and others just race each other without really having a look whether the customers will buy. And i don't even want to think of the bad choice of standards they base their services on...
Re:Cloud Computing? Why? (Score:2, Insightful)
Well, for me, it is for low cost hosting for Django Applications, but for business it can be really interesting as there is somebody taking care of the infrastructure while they only need to care about the application itself.
So what exactly is supposed to be new about that? There have been companies providing exactly such services as that for decades.
No Tools? (Score:5, Insightful)
Google AppEngine has data reporting to a ridiculous level. This article doesn't even publish any REAL data.
I really HATE commercicles, small articles which make a claim, and then say, 'stay tuned!'.
Someone fire the author. The last paragraph reads:
"Liu will present the findings and offer developers advice on how to build robust applications to withstand the cloud's limitations at the Australian Architecture Forum in Sydney on Monday, August 24."
Wow, I at least they admit that this article has no REAL data in it, and THAT data will be released on Monday.
Re:I'm Shocked! SHOCKED! (Score:2, Insightful)
Re:Cloud Computing? Why? (Score:5, Insightful)
The provider is managing everything for you automatically, the Cloud service takes care of pretty much everything including security so it is manageable even for non-technical dudes.
Re:Cloud Computing? Why? (Score:3, Insightful)
Re:Cloud Computing? Why? (Score:2, Insightful)
Re:I'm Shocked! SHOCKED! (Score:5, Insightful)
Re:Wave? (Score:1, Insightful)
The challenges for Wave don't rely on nearly the same challenges. Wave involves ONLY data transfer, not processing, storage, etc.. It's a protocol.
Making the comparison you've made is the same thing as saying HTTP is flawed becouse Joes Web Shack servers are slow.
Doesn't wave create thumbnails for images posted in a conversation?
Sounds like processing and storage to me...
Re:Cloud Computing? Why? (Score:3, Insightful)
During peak hours you can spawn a few more servers and at night you can shut down a few without having to worry about the physical hardware and their associated maintenance burden.
Right, but what does it cost, because guess what, just about everybody else wants more servers at peak hours and wants to shut down a few at night. What does the "cloud" service provider do with all of those servers when nobody wants them? How do they cover their maintenance costs for the time when their servers are idle?
That's right, by charging more for them when you want to use them. The big problem with the cloud concept is that it assumes that the need for servers is spread out evenly across the day and the year. The fact of the matter is that it isn't, most businesses need/want more servers at the same time.
Re:Cloud Computing? Why? (Score:2, Insightful)
Hosted Microsoft Exchange [microsoft.com] is a concrete example of a cloud (cloud-like) service that's been gaining ground for a while now.
Wired had a read-worthy piece on Azure's principal architect Ray Ozzie last year, Ray Ozzie Wants to Push Microsoft Back Into Startup Mode [wired.com]. Hyperbole aside, anyone who's directly interfacing with Microsoft sales people and engineers these days will tell you, Azure is a big part of Microsoft's next money grab.
However, it's amusing that the definition of "cloud computing" continues to mean different things to different vendors, as evidenced by Amazon, Google and Microsoft offering fairly distinct and non-overlapping services. Until they come into direct competition with one another, I think this is going to continue to be seen as a novelty by many CTOs and IT decision-makers.
Is cloud computing the future? I don't know, but I think it's safe to say it's *a* future. Even if it isn't yours.
Re:Cloud Computing? Why? (Score:5, Insightful)
Additionally, what makes it a 'cloud' and not just a vanilla virtualisation platform is that your storage itself is then decoupled from your machine instances themselves, as well as the hardware, in an easy way without having to faff about with clustered storage set ups yourself or through a hosting company. This makes your machine instances easily disposable and allows for pretty easy recreation of production environments as a failover or for testing and development.
Essentially, that's what's attractive about it in layman's terms. It makes it far cheaper and far less hassle to get hardware and storage redundancy when you start having to worry about it, but large companies are not going to be outsourcing their critical stuff off site with it. That's just insane. It's just a pity the whole thing has become filled full of shit by people who don't know what they're talking about like that Services Engineering nutcase in the article who is probably being paid way too much money. The article doesn't even tell you what limitations they found in any detail.
Re:Incompetent testing, stupid article (Score:3, Insightful)
Response times on the service also varied by a factor of twenty depending on the time of day the services were accessed, she said.
Ok, so give me a friggin' number! Did it go from 1 min to 20 minutes? Or from 1 sec to 20 sec. Or 1 hr to 20 hrs? When did you experience these response times? Give me a graph showing the response time as function of time of day and day of week.
I am learning to hate articles that give you a little bit of information and leave out the important data. If Ms. Liu hasn't released the data, then the article should not have been written. Or she should provide it on her web page. Or provide a link to some journal where it's being published. This whole thing stinks of spin and MS FUD.
Re:Cloud Computing? Why? (Score:5, Insightful)
I'm developing a JRuby app for Google App Engine. I'm doing it because as a lone developer, I don't have to worry about anything but my code. I will never have to wake up to troubleshoot a network problem, OS issue, Apache oddity. I won't have to hire networking, DBA, or systems administration staff. And if my app hits off big, I won't have to re-engineer anything to make it scale. It will scale automatically.
I've played the role of network engineer, DBA, and sysadmin in the past. Now I can focus on my application.
That said, appengine is certainly not for all sorts of apps. It only supports a subset of SQL (no joins), I'm sure it won't meet the requirements for payment card processing or anything like that, and my APIs are limited. But for a good chunk of web apps, developing for the google cloud has huge advantages.
Re:Quite interesting, actually (Score:3, Insightful)
Re:Cloud Computing? Why? (Score:2, Insightful)
The fact of the matter is that it isn't, most businesses need/want more servers at the same time.
Do you have a citation for that? I would think that there would be a lot of different services which need servers at different times. Most business services would peak during the day, but I would think most consumer based services (entertainment, shopping) would peak in the evening. And then you have to consider that there are other countries in the world and their day is different than yours. So, their peak times would probably be different. I am not saying that cloud computing is the way to go, but there are definitely the potential for a much better server utilization with it. And, the result will probably be that there will be time based pricing, with peak times costing more. But, it will still be more cost effective because they will still be making money on the non-peak times when individual servers would normally be idle. Also, services that would normally run at peak time, but don't need to, would be able to take advantage of the cheaper non-peak times. This is how a market works. Scarcity of resources results in efficiency. And the overall cost of the system decreases.
Re:Cloud Computing? Why? (Score:3, Insightful)
If I want access to the web, I can get it, but that's only a few times a day when I need it.
I don't know about you but I need internet access 24/7.
Secondly, cloud computer is not for nerds.
Its for non-tech types who want to outsource things.
Actually "cloud computing" is a euphemism for "outsourcing".
Well I suppose its for nerds if you are the administrator of a "cloud" but for end users not so much.
Re:what the fuck is services engineering? (Score:3, Insightful)
Well, Microsoft's Azure is in .NET, and Google's AppEngine is Python, but Amazon's EC2 is basically a virtual machine (you load your image in from S3, can be Linux or Windows). I would assume you could just write a common object in Python, have a IronPython hook to Azure, a plain Python hook to AppEngine, and a hook to whatever method you use to host your service in EC2 (like mod_python or whatever, if you're using Apache).
You could do that, but if your intent is to get as much processing power out of each platform as you can (e.g. you want to benchmark them to see how they compare with each other), you'd want to use a compiled language for your EC2 version, and probably C# for your Azure version. But you're stuck with Python for AppEngine, so you're going to be doing at least 2 and probably 3 versions. Otherwise any conclusions you make are going to be unreasonably favourable to AppEngine, as you're intentionally crippling your other systems to bring them down to the same level.
Re:I'm Shocked! SHOCKED! (Score:5, Insightful)
I don't really see how this is similar to the cloud at all.
Confusing terms (Score:4, Insightful)
You're confusing two definitions of "cloud".
One is the idea of putting everything into a webservice. The other is the idea of utility computing. They often overlap, but plenty of web services run their own datacenters, and there are plenty of applications of utility computing beyond web services.
Specifically, your "scalability issues" are relevant to the "utility computing" part, but not so much to the "web services" part -- unless you were bringing up issues completely irrelevant to this article.
This is my main annoyance with the use of the word "cloud" -- even people with some technical knowledge still get fooled into thinking one kind of "cloud" has anything at all to do with another type of cloud.