Twitter Leads Social Networks In Downtime 175
illectro writes "A study on site availability by monitoring service Pingdom shows that in 2008 Twitter greeted users with the 'Fail Whale' for more than 84 hours, almost twice as much as any other site. At the other end of the scale imeem and Xanga managed less than 4 hours of downtime for 99.95% uptime. Myspace, Facebook and Classmates.com were the only other sites studied which managed to stay up more than 99.9% of the time."
84 hours?!?! (Score:5, Interesting)
I find it kind of strange that a site as incredibly simple as Twitter had so much downtime. Granted, they probably don't have the multiple dedicated redundant datacenters to their name like MySpace and Facebook do... but still, they're only serving little tidbits of text.
Twitter Developer Alex Payne on Rails performance (Score:5, Interesting)
Re:Twitter, Facebook, MySpace (Score:4, Interesting)
Well, I don't care so much about the downtime.
However, your post shows extreme shortsightedness to what the people of this world are interested in. Yeah, Facebook, Twitter and the like *can* be extreme wastes of time. But, there is a reason that so many people are drawn to those sites. As engineers and "nerds," it would be interesting to not only know why (psychology playing a huge role in this), but what can be done to leverage technologies like these to actually provide something "worthwhile." (I put worthwhile in quotes as the worth of something is very relative.)
What may or may not be important to you is not what the populace as a whole agrees with. You're definitely entitled to your own opinion (and I will agree with you to some extent), but given the number of users of these sites, it's important to consider the bigger picture and implications.
Re:Twitter, Facebook, MySpace (Score:3, Interesting)
I think there is some truth in that, but the reason why most people use these sites is peer pressure, purely and simply. It's just a fad for most people. It's just like a local bar or club becomes the in place to go to -- without any substance. Being the reason why there's a drift from MySpace to Facebook to Twitter to the next thing.
Personally I can see absolutely no use for Facebook nor Twitter whatsoever. But now that the sparkly teenage girls have left MySpace for the next thing, MySpace is actually a useful site. If you are an artist of some sort, MySpace is a great tool for networking and showcasing your work. Facebook is worthless for that, since you have to become friends with someone to see their profile.
It could be that there are genuine core uses for Facebook and Twitter too -- though I cannot personally think of what they could be.
Re:Twitter Developer Alex Payne on Rails performan (Score:2, Interesting)
I mean wtf? This has been dubunked so many times.
After this announcement someone wrote a plugin for rails that handled multiple databases.
And you know, we had this huge ruby on rails application that never really took off. I would had really loved to have those performance issues they were describing.
Yay fail whale (Score:3, Interesting)
Re:84 hours?!?! (Score:2, Interesting)
The man who ate 100,000,000 jelly beans did do less than the man who ate 10,000,000 burritos. Not all data is created equal. There are whole worlds of complexity that come in when you have to deal with small data (like text) and large data (like images). You have to separate the handling of the files as much as possible.
Twitters position, where their transactions are always the same types of data in the same amount...Those are very easy to abstract and scale. True scaling problems come in when you're hitting multiple different tables for multiple different types of queries. Reading, writing, and updating, all at the same time. The semaphore and data integrity problems get way ugly.
If their system was well designed, they could simply throw more hardware at the problem, and the problem would go away...That's what "scalable" means, it means your process demands increase at the same rate (or lower) as your utilization increases.
Look at how fast some of the other sites mentioned scaled up. Myspace and Facebook both exploded in popularity and grew extremely rapidly, and both of those applications scaled exceedingly well, and both of them have much more difficult problems to solve.
Facebook in particular, Jesus, it's built out of every damn kinda crap imaginable. Php, java, python, C+, fucking perl. They claim they use Erlang too. You know why? Because they saw they had specific problems to solve, and they solved them with the best tool for that problem. They didn't insist one tool was all they needed.
Note, there is no Ruby in that list. Maybe, like me, they never came across a problem for which it was the best solution.
Re:This is nonsense. (Score:2, Interesting)
I am an anti-fanatic. I use the best tools for whatever job I may be doing. I program in Java, Perl, Php, Python, C++, C#, and, when I must, Cobol. I make fun of everyone who claims that their tool is the best tool in every situation.
I'll tell you exactly what Twitter's problem is: Ruby is a shitty database interface. That's it. So is PHP, so is Perl, so is VB.Net. I don't even like Java and C# for that stuff, though they're a whole lot better. Python is, but you can write a C lib to do it for Python, so it isn't (though I still wouldn't use Django). For this volume of data you need something lean and close to the hardware.
They need a better caching system, period. If they're going to try and do the whole thing in Ruby, more power to 'em. But they damn well shouldn't be surprised when obvious crap like this rears up later.
Re:Twitter Developer Alex Payne on Rails performan (Score:3, Interesting)
I've never used CakePHP before, but every benchmark I find on it suggests that it's horribly slower (10-100x slower, if not more) than stock PHP. For example, over here [sellersrank.com] they get 37.46 requests/s for a hello world CakePHP page on a 3 GHz Intel machine with 512M RAM. I gave a plain PHP hello world page a try on a 1.3 GHz Pentium-M laptop with 512M RAM (a substantially slower machine) with the same ab parameters and I get 1254.75 requests/s. In other words, the substantially slower machine gave 33x better performance with stock PHP than the substantially faster machine gave with CakePHP.
So yes, maybe RoR has comparable performance to CakePHP, but who cares? CakePHP is painfully slow and I don't know anyone or anything that actually uses it. Wake me up with RoR (or Ruby) is faster than stock PHP.
Re:Yay fail whale (Score:3, Interesting)
Birds tweet. They all tweet to each other. And they do so using tin cans and string.
So they're flying along, happy tweeting on their retro iPhones when all of a sudden this doped up whale jumps in the middle of them, dragging them all to their doom.
Birds = Twitter
Whale = system/network load/myth of Rails scalability
It's a gorgeous bit of iconography.