Inside MySpace.com

lizzyben writes "Baseline is running a long piece about the inner workings of MySpace.com. The story chronicles how the social networking site has continuously upgraded its technology infrastructure — not entirely systematically — to accommodate more than 26 million accounts. It was a rocky road and there are still hiccups, several of which writer David F. Carr details here." From the story: "MySpace.com's continued growth flies in the face of much of what Web experts have told us for years about how to succeed on the Internet. It's buggy, often responding to basic user requests with the dreaded 'Unexpected Error' screen, and stocked with thousands of pages that violate all sorts of conventional Web design standards with their wild colors and confusing background images. And yet, it succeeds anyway."

I Would Have Signed Up...

[Wandering Wombat (531833)]

... but apparently Tom has enough friends.

Seriously, I had a look at a few pages, and when I eventually managed to CTRL-ALT-DELETE my browser into submission, I made damn well sure never to go back there. Are there people that actually have enough computing power to handle some of those profiles?

Well...

[remmelt (837671)]

His keyboard repeat rate probably couldn't keep up with the exponential browser pop ups.

Re:I Would Have Signed Up...

[Short Circuit (52384)]

Firefox doesn't respond to a normal application close signal when stuck in intensive Javascript loops. I run into similar problems in some articles on Slashdot.

They really need to break the Javascript engine into a separate thread and avoid hinging all browser response on it. Or maybe that's just a flaw with the XUL way of doing things. Dunno.

Re:

[riscthis (597073)]

What's "noscript"?

An extension for Mozilla based browsers that disables JavaScript, Java etc except for sites you specifically whitelist.

See https://addons.mozilla.org/firefox/722/ [mozilla.org]

Re:

[cicho (45472)]

An add-on for Firefox:
https://addons.mozilla.org/firefox/722/ [mozilla.org]

Everyone uses it

[burbankmarc (838977)]

It's not the stability or the design,it's just that people now adays say "what's your myspace" rather than "what's your phone number" There's tons of other sites out there with more functionality and more stable servers, but...no one uses those, do they?

Re:Everyone uses it

[garcia (6573)]

It's not the stability or the design,it's just that people now adays say "what's your myspace" rather than "what's your phone number" There's tons of other sites out there with more functionality and more stable servers, but...no one uses those, do they?

Who are you talking about? Teenagers and college students? You must be, because as an adult, I don't know anyone that says anything of the sort and if they did I would ignore them from that point on. Please note, I'm only slightly outside of the age range where that site is most popular.

Re:Everyone uses it

[abigor (540274)]

Tons of bands use it, small independent movie studios and film productions, etc. etc. Basically, anyone with anything to promote.

As far as personal profiles go, I'd suspect most people are pretty young, like 20s. But I know of many people in their 30s with MySpace sites also.

And we know why they're there.

[Kadin2048 (468275)]

As far as personal profiles go, I'd suspect most people are pretty young, like 20s. But I know of many people in their 30s with MySpace sites also.

So, in other words, MySpace's chief demographics are "20-somethings" and "people trying to sleep with 20-somethings."

Re:Everyone uses it

[kevinbr (689680)]

The demographic is now over Thirty in age I read somewhere. People perhaps do not realize that MySpace band space is killing the recording studios.

I am launching a tiny record label because my A and R man is MySpace. I can find all the talent I need and I can see who might be a success by seeing do they post their gigs ( i.e. they actual play gigs ) and how many people they have as fans and how often people listen to the posted tracks.

The reality is that bands might not actual need a label - they can self publish but that takes energy which a lot only put into music.

The other reality is lots of little band makeing 100K smooths out the business away from the 100 bands pulling 99% of the income to a more equitaable world where more musicians can actually make a living.

My theory is that recorded music is going to be more a teaser for live acts than a main source of income.

I am working with 4 unknowns to try and get something out this year. Thanks to MySpace.

Re:

[veganboyjosh (896761)]

i wonder how many of the 26 million are active only to send spam...

Re:Everyone uses it

[StarvingSE (875139)]

It's called a generation gap. I am in my 20's and admittedly use myspace. I think its a good tool for keeping in touch with old friends or getting back in touch with people you went to high school with. It is buggy, but it does a fairly decent job of sorting out those accounts so that you can find people in your school, company, or whatever. There are a lot of communication tools, like pagers in high school, cell phones in college, and even internet forums (like slashdot) that the younger crowd use and consider essential, but the older crowd takes a while to understand.

Yes, some of the sites on myspace are crap, but thats totally up to the user. The default white myspace page loads pretty quickly. Myspace hosts the content, they can't control what the pages look like. I have friends who have horrible pages, and I tell them that. But its up to them to host whatever content they want, and up to me to decide to view it.

I don't want to sound like a myspace fanboy, but I think it gets a lot of unneeded bad press because of things like child stalkers and bad page design. While these things suck, they happen because people exploit and abuse the system. Let's face it, myspace is still new and immature, but will probably get better and more polished given time and money.

Re:Everyone uses it

[HAKdragon (193605)]

As an ex-myspacer, I know of the ocular and mental angish caused by some of the pages on myspace. However, greasemonkey [mozdev.org] and the myspace custome style remover [userscripts.org] script make using myspace bearable.

Re:

[jZnat (793348)]

They shouldn't have made it so freaking hard to use. (It takes three times as many clicks to do on something on MySpace than what it should take.)

I've read that they do that in order to get more ad impressions. Just take a look at how messy their pages are and try to say I'm not right with a straight face.

Re:Everyone uses it

[um... Lucas (13147)]

The reason myspace became what it's become is:

Because it allows users to heavily modify their pages. Hell, there's a cottage industry built up of hacks and codes to change a users profile around.

Because it lets users put songs on their profiles to hear, so that they can feel like their profile is their own (neverminding the other 20,000 profiles with the same song)

User blogs are published to RSS... i don't know about bulletins or other functions, probably not, because then it'd have to store the user name and password somewhere in order to get it right...

So, go ahead, write a "better" myspace... and no one will come.

However, if you look at what users WANT and give them something better, they will... Myspace is nothing but the next generation after LiveJournal, Friendster, etc... There's going to be something new after myspace, and i'm betting there's at least 20 companies out there trying to figure out what it'll be...

Re:Everyone uses it

[DerekLyons (302214)]

MySpace shouldn't have allowed their users to modify the pages so heavily. They shouldn't have allowed people to have music that plays when you visit the page. They shouldn't have made a system that can't talk to other stuff (like del.icio.us tags or RSS readers). They shouldn't have made it so freaking hard to use. (It takes three times as many clicks to do on something on MySpace than what it should take.)

It's fascinating to see such a comment modded up on Slashdot - which is normally the bastion of freedom and personal rights to do whatever the hell they want, when they want.
 
 

I write web apps for a living.

But here we see the truth - Slashdot who screams the loudest when $MEDIA_MEGACORP tramples on *their* (assumed) rights - bellows equally loudly when their own ox is gored.
 
 

I know what a good app looks like. I could write a better MySpace clone in the space of a weekend. However, nobody would use it. Why? Because it's not "MySpace."

It's no wonder they had so much trouble keeping the system up and running, because they're obviously not professionals.

The term you are looking for is sour grapes [wikipedia.org].

I beg to differ.

[raehl (609729)]

MySpace shouldn't have allowed their users to modify the pages so heavily. They shouldn't have allowed people to have music that plays when you visit the page. They shouldn't have made a system that can't talk to other stuff (like del.icio.us tags or RSS readers). They shouldn't have made it so freaking hard to use. (It takes three times as many clicks to do on something on MySpace than what it should take.)

If myspace were to prevent people from exhibiting their stupidity, how would I know who the stupid pe

Re:

[Alex (342)]

and you have a 4-digit slashdot ID??

Johnny come lately.

Alex

Re:Everyone uses it

[nunojsilva (1019800)]

It's the same that's happening with MSN Instant Messaging: It's broken, the official client is the worst IM client I've ever seen, and it does not support important features as formatted text (multiple formatting in a single message), but people use it.

Also, when somebody wants to discuss something, or just talk, over the Internet, he/she asks "What's your MSN?".

Talking about MySpace, I've only visited it a couple of times (to see a football (soccer) player's myspace (which, probably, was just built by some fans), and Nick Sagan's one), and I told myself "I've never seen a site like this one - how can they call this a web page?".

But I know this sort of sites. At school my colleagues don't use myspace, they use hi5. And I've used it some times when I was still accessing it from public computers, with Portable Firefox. But when I accessed it with my laptop (i686 300Mhz 64Mb), it was *very* slow to load.

Solution? A member of the INDUCKS project invited me to their forum at orkut, so I started exploring that social network. It had the same sort of silly server errors (sometimes you see a "Bad, bad server, no donut for you!"), but they didn't occur as frequently as in hi5, and the site design is clearer than the one used at Orkut.

Fortunately GMAIL and Orkut have Gtalk integration, which means that everyone with an account in one of these services will be able to login at gtalk. This is good for me because some of my colleagues had to change to GMAIL accounts because a (very good!) teacher told us he wanted to send important documents via e-mail and that Hotmail was not the ideal tool, and the consequency is that now I'm able to talk to them using gtalk instead of MSN.

The big problem here is "eye candy". People like myspace because it's eye candy. People like the MSN client because it's eye candy. And the same happens with hi5 and other equally bad sites.

There's tons of other sites out there with more functionality and more stable servers, but...no one uses those, do they?

May you tell us which better sites do you know? I'd like to know :-)

Scalability

[eviloverlordx (99809)]

In November, MySpace, for the first time, surpassed even Yahoo in the number of Web pages visited by U.S. Internet users, according to comScore Media Metrix, which recorded 38.7 billion page views for MySpace as opposed to 38.05 billion for Yahoo.

The bad news is that MySpace reached this point so fast, just three years after its official launch in November 2003, that it has been forced to address problems of extreme scalability that only a few other organizations have had to tackle.

I agree. Keeping up with all of the pedophiles is something that most businesses rarely have to deal with.

printer friendly

[pezzonovante1 (788328)]

article here with no ads [baselinemag.com]

For now.

[onion2k (203094)]

And yet, it succeeds anyway.

All that "power" that they've given to the users, coupled with the nasty CSS it takes to use it, will be their undoing. There's no way that they can change now without breaking millions of profiles and really annoying a huge number of their users. It's a textbook example of poor long term vision. MySpace is a huge success now, and it will continue to be for a while. One day though someone will make a social network that is quick, easy, and customisable in a well-thought out way. Then MySpace will empty very, very quickly.

Mind you, there's no reason why that site wouldn't be MySpace2 or something. I'm only refering to the network, not the company.

Re:

[toadlife (301863)]

There's no way that they can change now without breaking millions of profiles and really annoying a huge number of their users.

They most certainly can change it, and it wouldn't be as impossible as you think. What they would do is create a new page layout schema but support old one at the same time. When the new schema goes live, all new users would automatically be assigned the new schema while existing users would stay on the old one. Existing users would then be coaxed into adopting the new layout via banner advertisements, or in-house "spam". It would take awhile to do the migration, and a cutoff might need to be implemented a

Niche market...

[djones101 (1021277)]

MySpace has the stranglehold on the niche market. Any and every person who just wants their own pegboard, office cubicle side, or office wall to decorate can do so in cyberspace, especially students who otherwise have no way to really express themselves (at least in their own opinion). It takes very little experience to develop your own page that does exactly what you want. It's the Google Gadget system for the common user, or Geektools for High Schoolers, if you want to call it that. Unless someone can find a good way to draw a significant userbase away from MySpace (and I haven't seen anything that will come close), they will continue to succeed.

Everyone signs up because..

[necro2607 (771790)]

... they click on the pictures of the hot girls, only to get a "You must be logged in to do that!" message.

Why is it so hard?

[dedazo (737510)]

Every single time I see a MySpace "analysis" there's that snide, bloghorati uber-alles comment about "web standards" and "lack of design". Holy crap. I am no fan of MySpace, but at least I'm mature enough to realize that people (normal people) don't give a dead rat's ass about CSS, DOM, XHTML, microformats, "mashups" or any of that other stuff that the self-appointed standards nannies of teh interwebs have decided everyone should observe closely or face death. A standardized and structured semantic web space is important, but please rent a fucking clue. They don't care. MySpace is never going to fix something that in their opinion is quite certainly not broken, because their users love it, and they get to dance with it all the way to the bank.

Just fucking deal with it and stop pointing out that ==--~~L0N3rz1124~~--=='s blog does not validate. We know, and they don't give a shit.

Re:

[Jett (135113)]

Where is the line then? The few times I've tried to figure out what the hell is up with myspace my browser gets beaten to death by the horrific web design. I saw one page where multiple flash players loaded several video and audio files AT THE SAME TIME. The inmates can only run the asylum for so long. It's great they've managed to build a "web 2.0" version of Geocities, but when half the pages they host required a multi-ghz beast of a machine to even load I don't see how their model can really be sustainab

Re:Why is it so hard?

[Kris_J (10111)]

Oh, for crying out loud, just install FlashBlock [mozdev.org].

The Semantic MySpace

[WarwickRyan (780794)]

Surely it'd be better to start with information which is understandable by humans before we put energies into making the nonesense machine readable? ;-)

Re:

[LordLucless (582312)]

Most people's beef with myspace isn't that it's pages defy standards; it's that they look like crap.

Re:

[dedazo (737510)]

But that's the problem - pink twinkly pimped pages is what MySpace's user demographics enjoy. That's my point.

Re:

[dedazo (737510)]

Are you telling me that they purposefully go out of their way to make awful, cluttered, unreadable MySpace pages, where the graphics and the links to not match up, where some buttons are just impossible to press, with thumping rap music?

That's my take. Surely MySpace allows anyone to design their web pages in many ways, so the fact that *so many* of them suck twelve ways from Sunday is an indication that such "design" is a choice, and not a directive. I'm sure they have templates, and the templates cater

Google.

[SanityInAnarchy (655584)]

I want everyone to remember that when Google came out, there were quite a few well-known search engines out already. Google was simply better enough than the others that it took over.

If anyone is reading this, and has the resources to do it -- or maybe has some 20% time at Google -- the only real solution to MySpace (other than praying that they fix it themselves) is to offer a competing service that is so ridiculously much better than MySpace that it will do what Google did. Anyone remember Facebook? In college, not a single person used MySpace, yet everyone was in Facebook -- if Facebook was open to the public (not just people in school), it would likely kick MySpace's ass around the block.

Re:Google.

[vasqzr (619165)]

In college, not a single person used MySpace, yet everyone was in Facebook -- if Facebook was open to the public (not just people in school), it would likely kick MySpace's ass around the block.

I believe it is open now.

Do you really want the people on MySpace taking over Facebook?

Re:

[Cairnarvon (901868)]

Facebook has been open to the general public for months, much to its old userbase's dismay. They introduced the no-network and the regional accounts last September somewhere, IIRC.

Google & 20% time

[remmelt (837671)]

You mean like Orkut?

Retrieving comment...

[awing0 (545366)]

Sorry! an unexpected error has occurred.

This error has been forwarded to Slashdot's technical group.

Examples of horrible MySpace design?

[TerranFury (726743)]

I keep hearing references to horribly designed myspace profiles. For the benefit of those Slashdotters who haven't see this dreck, please post your most egregious examples in reply.

Re:Examples of horrible MySpace design?

[hyperizer (123449)]

http://www.myspace.com/farleyjackmasterfunkcom [myspace.com]

MOD PARENT DOWN!!

[adamofgreyskull (640712)]

For the love of god! MOD PARENT DOWN!

Re:

[anagama (611277)]

Wow -- 30 seconds into the page and the fan on my macbook cranked up to maximum and the only thing I had running was Firefox for mac when I went there. In contrast, even when I'm running ubuntu in parallels, with quanta, gimp, firefox, wine/ie, and termial open on the linux side, plus some random things on the mac side, the fan doesn't spin up. Aside from burning the eyes, that page will burn up your hardware.

Re:Examples of horrible MySpace design?

[Sloppy (14984)]

Horrible profiles are (almost *) totally irrelevant. In Firefox, just go to View/PageStyle/NoStyle, or use the "Toolbar MS" extension and dig the "de uglify" button. Instantly, the user added bullshit goes away.

MySpace's real problem is that the website just plain sucks, regardless of cosmetic issues and user-modified stylesheets. Some examples...

• Javascript!!!! They use Javascript for lots of things instead of links. Go to "view all my friends" and try to right-click the next and previous links so that you can open them in new tabs without losing the current page. Oops. Can't. They're not really hyperlinks. They methods. This error is pervasive through many many parts of MySpace. There are tons of places, tons of lists, that can't be navigated like "normal" websites, because they use javascript as alternatives to hyperlinks. There is no excuse for this. They went to extra trouble to make the website harder to use.
• Book III: Sorting and Searching
  • This amazes me: MySpace can't sort. If you have a couple hundred friends, go ahead and try to find a specific one. I pity the people with thousands. Sorting a list is one of the most basic fundamental things that programmers learn to do, in order to make it easier for a user to find something in a long list. MySpace still doesn't have it, after 3 years. Sorting! How old were you when you learned to sort?
  • Likewise, you can't search your friends list. Know someone's name on your list? Then page through your list sequentially, until you find them. And hope your eyes don't miss. This blows my mind, it's such a basic fuckup that should be so trivial to fix. It's staggering. Maybe I'm paranoid, but I just can't imagine how this isn't intentional. Nobody fucks up this bad. Like the sorting problem, this is also pervasive. Post something in an active forum or group, and try to find your post later so that you can read replies. Good luck, you're going to need it!
• Complaint du jour... Calendars have been semi-broken for the last couple of weeks. I click on "manage calender," it defaults to bringing up a totally random date in 1935 or 1998, and well, well over half the time I try to enter something and save it, I get the "unexpected error" page (like it's really unexpected by now!). How hard is it for a machine to know the current date? How hard is it to save a calendar entry? (Ok, the article is sort of actually about this.. MySpace has serious database problems. I finally realized, when they say "SQL Server" they're not so much describing a piece of software, as they are naming it: they're using Microsoft products! Holy shit! Microsoft products on busy servers!)

* That said, there is one semi-serious cosmetic problem with MySpace. Apparently users can customize their profiles to such an extreme degree, that their profile looks like a MySpace login page, submitting the form to a different server. In other words, you can connect to MySpace, thinking you're on a login page, but send your authentication credentials somewhere else. So that's why so many people post bulletins about Free Ringtones and Anime porn! ;-)

This post brought to you by the punctuation character "!"

Well,

[somethinghollow (530478)]

It certainly wouldn't be any less popular if it wasn't buggy. What's happened is that MySpace somehow managed to carve a space in the collective conscious. So, it's the place people go in the US to do social networking. People just deal with the fact that it's buggy because that is the place where you go. It's kind of like people use Windows because that is the only OS they know (or like AIM, etc.). They don't know of anything better, and even if they did, their friends probably wouldn't know of it / use it. MySpace could improve the user experience, but they likely won't until someone starts sucking people out of MySpace and into something better.

tips for browsing myspace

[vindimy (941049)]

1) Use Firefox (more secure) with pop-up blocker
2) Use Adblock plugin for Firefox (blocks most ads) with auto filter updating
3) Use Flashblock for Firefox (blocks most movies and survivor ads)
4) Block CSS/JavaScript if your eyes hurt or you're getting dizzy
5) Use Web Developer toolbar for Firefox if you need more control
6) Get a 13-year-old to translate the pages for you (old people hack)

Enjoy

The Bright Side of MySpace.

[Paulrothrock (685079)]

Look at it this way: The more people use MySpace, the fewer "OMG FWD THIS TO EVERY 1 U NO!!!" emails you'll get. It's like a ghetto for annoying people on the Internet.

Windows 2003 denial-of-service "feature"

[sych (526355)]

From TFA:

Last summer, MySpace's Windows 2003 servers shut down unexpectedly on multiple occasions. The culprit turned out to be a built-in feature of the operating system designed to prevent distributed denial of service attacks--a hacker tactic in which a Web site is subjected to so many connection requests from so many client computers that it crashes. MySpace is subject to those attacks just like many other top Web sites, but it defends against them at the network level rather than relying on this feature of Windows--which in this case was being triggered by hordes of legitimate connections from MySpace users.

"We were scratching our heads for about a month trying to figure out why our Windows 2003 servers kept shutting themselves off," Benedetto says. Finally, with help from Microsoft, his team figured out how to tell the server to "ignore distributed denial of service; this is friendly fire."

WHAT?!

So, Windows 2003 has a "feature" that deals with denial-of-service attacks - it shuts down! Brilliant!

What were they thinking?

[Percy_Blakeney (542178)]

I'm a bit surprised that at the sequence of stages that their architecture went through. They bought expensive servers, mega-expensive SAN's, completely changed their platform from ColdFusion to ASP.NET, tried data segmentation...

And then finally implemented a caching layer in front of the databases!

That should have been the very first thing that they tried, as any experienced developer would have known. Instead of buying that SAN for a billion dollars, maybe they should have just invested in some competent employees.

Re:Blah...

[owlnation (858981)]

I was personally surprised to see no mention of where they keep the ponies and glitter. I was sure that was how they ran of their technology. Must be a industrial secret...

Re:Membership Milestones?

[Viper Daimao (911947)]

No, they went from 150 million down to 26 million. You obviously forgot this story [slashdot.org].

Re:Membership Milestones?

[arthurpaliden (939626)]

Only about 30% of all accounts are really active, accessed once every 2 weeks. (Yes I have the data)