Slashdot Log In
Examining Bittorrent
Posted by
michael
on Sat Dec 18, 2004 06:17 PM
from the systemic-problem dept.
from the systemic-problem dept.
ToyKeeper and other wrote in with this: "The Register published a detailed analysis of BitTorrent traffic and user habits today, focusing on four aspects: availability, integrity, download speeds, and ability to withstand flash crowds. BitTorrent carries 53% of all P2P traffic (or ~35% of all 'net traffic), and this paper helps explain why. Also included are data about torrent lifetime, network poisoning, response during downtime or attacks, and lots of pretty charts. A few performance problems are revealed, which will hopefully be addressed in future p2p systems." The original paper (pdf) is available.
This discussion has been archived.
No new comments can be posted.
The Fine Print: The following comments are owned by whoever posted them. We are not responsible for them in any way.
35% (Score:5, Interesting)
Re:35% (Score:5, Funny)
35% = BitTorrent
40% = Spam
15% = Slashdottings
10% = Porn Browsing
Parent
Re:35% (Score:3, Funny)
Re: 35% (Score:3, Insightful)
35% = BitTorrent
35% = other P2P (the article tells you this)
5% = plain old FTP (just a random guess of mine)
2% = email / instant messaging
23% (the remainder) = other (newsgroups?) / plain browsing, of which a significant portion might be pr0n.
(All numbers about as accurate as the results of a Slashdot poll ;-)
Slashdottings may be fun to note, but significant amount of all internet traffic? Don't think so. The low number for mail is because there may be lots of spam, but it's not that big
The other 65%... (Score:3, Funny)
The availability problem can be solved. (Score:5, Informative)
35% of all net traffic belongs to BitTorrent traffic. The corresponding web and traffic tracker required to power that is inconsequential.
I used to run NovaSearch.net, which was for a time the official search function of Suprnova.Org. I made up roughly half of all their traffic, something on the order of 300k pageviews per day by the end. Availability was indeed a large problem, and always my primary concern. However, my possible availability was much higher than actual availability. By this I mean that Novasearch had the POTENTIAL to be available much more than it was, due to reliance on Suprnova.
When SuprNova went down, NovaSearch (usually, often it could be used as an out-of-date cache when Suprnova was down) went down too, because it didn't get updates. That accounted for most of my downtime, very little of it was actually from issues relating to NovaSearch itself.
Despite all this, NovaSearch, during it's primary operational period, relied on only one dedicated server (A second was added for static content later on, but for transfer cap reasons, not actual bandwidth or load). This highlights the primary problem with Suprnova in regards to their reliability, they rely on donated mirrors, and that reliance has caused them to use an insufficient architechture (Last I heard the core of Suprnova was one single dual xeon server). Had they instead chosen to use a clustered solution that they managed themselves, combined with hardware firewalls and DDoS mitigation technology, the availability then and now would be significantly higher.
Tracker reliability is a much lesser problem. Torrents can easily survive short to medium tracker downtime just by the shear momentum of the users. Once they have a peer list, they can continue communicating with those peers even with the tracker down. And the widespread adoption of various unofficial additions to the BitTorrent protocol have further improved that. One such improvement that enjoys almost universal support among third-party BitTorrent clients is the multi-tracker protocol, which effectively allows trackers to be clustered so that even if all but one of the trackers for a torrent is down, it can continue normally.
Anyhow, this is a long post that sort of went off on a tangent and started rambling, but I thought that I should put a few words in because of the role I played.
Parent
Re:It's you who are to blame (Score:5, Insightful)
... again ...
How are we supposed to "mark your words" when you post as an AC? Also, you seem to think that downloading music is illegal everywhere, when it's not. Not everyone lives in the US of BushCo. Also, the servers holding the torrent files are not breaking any laws.From the article:
Well, since, according to El Reg http://www.theregister.co.uk/2004/12/08/brit_net_The stats:
All the above are LEGAL.Parent
Re:It's you who are to blame (Score:3, Informative)
So?
The issue is, for contributory infringement, whether it materially contributes to the infringement of another, with the knowledge of the infringement. As for vicarious infringement, whether the party had the right and ability to control the infringement, and directly profited from it.
Both could include pointers. In fact, Napster merely maintained a database of pointe
Re:It's you who are to blame (Score:3, Informative)
The infringements are distribution by the people who upload, and reproduction by the people who download. With BT, pretty much everyone is both kinds at once.
And tangible media includes RAM (see the MAI v. Peak case, which is widely followed) so as a general rule, following e.g. Napster, you have the right and ability to cont
Re:So violating GPL or BSD-licence is OK too? (Score:3, Insightful)
You can't "steal" it. Copyright infringement is NOT theft. It's copyright infringement.
Unlike most people here, I don't think that's much of a problem. After all, we'll have the basis of any mods you make, and we can then work out a better version, even without your modified source.
Re:It's you who are to blame (Score:3, Insightful)
Problem is none of those things are true. We know that most media is overpriced and most actual content creators(artists, programmers, etc) are underp
Re:It's you who are to blame (Score:5, Insightful)
Yup. All it takes is any.
The legal principal is this: if the {object, device, chemical, drug} has a purpose for which it is legal, then the thing should be legal.
The exceptions to this (guns, marijuana, and other things we've allowed to be banned) prove the rule. The pressure to legalize or ban something evinces arguments about its legitimate uses, and it's these arguments that are persuasive. Saying "We'll do it anyway" is unproductive.
In this case, since downloading Free software is so much more efficient with P2P, it's inappropriate to ban it even if that software is only a small percentage of the service's traffic.
Parent
Re:It's you who are to blame (Score:3, Informative)
Says who? Considering the popularity *and* size of, say, ISO images of Linux distros/*BSD releases/..., I actually would think twice before making statements like this. There is no study yet that examines the ratios of illegal vs. legal or illegit vs. legit BitTorrent traffic, and furthermore, not everything that you might think illegal at first glance actually is - copyright laws are quite varied throughout the world.
Legal Torrents (Score:5, Informative)
Sites that list legal torrents... (Score:5, Informative)
Parent
Re:Legal Torrents (Score:5, Informative)
Hosting the 3.85GB Gutenberg DVD image would be a bit costly for the Gutenberg folks. Without BT or something like it, it would be much less convenient for volunteers like me to help them out by spreading the load around.
Parent
Such an unused potential (Score:5, Interesting)
But I'm afraid they are not going to get it in time.
My dream about a P2P PVR:
http://www.oberle.org/blog/2004/08/02/a-p2p-video
Re:Such an unused potential (Score:4, Interesting)
The fact is that their business model is d.e.a.d.: I have become an extremely selective media user. I refuse to purchase cable television; the cost is an order of magnitude more than the value I would receive. The same applies for movies; I do not derive fifteen dollars worth of enjoyment from all but a few very exceptional films (and the commercials at the beginning are, in fact, a significant reduction in their value).
I rely exclusively on torrents and rental DVDs for my television entertainment now. I get the benefit of selecting the time and location (I use a laptop) of viewing. There are no commercials, saving me ten minutes of annoying, aggravating brainwashing, and at "free," the price is sweet.
If the producers would simply skip the distributors and make it easy for me to pay them directly, I'd actually be willing to flow some cash their way.
My price points are:
Family Guy: probably a buck an episode if the quality of humour remained as surreal, unexpected, and edgy.
Scrubs: about the same, especially if it helps them avoid becoming maudlin.
Regenesis: a couple bucks an episode, but that's going to plummet if they don't start wrapping up some of the damned stories. Too many loose-ends, unless they're going to all come together in one brainfucking twist that scares the living bejesus out of me.
The trick, really, is to ask me to pay after I've seen the episode. Sometimes I've been hurting from laughing at, say, Family Guy. Hit me up then and I'd throw a wallet at you: give me more, damn the cost!
Parent
Bartering? (Score:5, Interesting)
Does this actually work? I find that when there are limited seeds, those first in line essentially transmit as fast as they recieve, and increasing upload doesn't really affect total speed much. When there are lots of seeders there's plenty of bandwidth to go around so it's always fast. Does anyone notice that restricting upload significantly affects download speed?
Re:Bartering? (Score:3, Informative)
Re:Bartering? (Score:3, Insightful)
And, no, it doesn't do anything to your download speed. Yeah, I usually only average 30kbps down, but I also commonly get around 150kbps down, which leaves me with better-than-realtime download of compr
Re:Bartering? (Score:5, Insightful)
Parent
BT is great, but: (Score:5, Interesting)
Yep (Score:3, Funny)
You're right; HTTP is so much better, because when something is being downloaded by the masses from a single Web server you get about 0 bytes/s.
They missing the most important quality (Score:5, Funny)
How about the ability to withstand lawsuits? Isn't that more important than flash crowds?
I'd like another name (Score:5, Funny)
Yeah, performance problems should be fixed, but fix the name too. Name the next generation P2P client something like FuckTheRIAADickheadCunts. It would be interesting to see it get mentioned in the news each time RIAA sues something related to that P2P network. Call the "servers" instead "ejaculators" or something worse, and go on like that to introduce terms that violate various taboos. Soon enough, it can't get mentioned in the news anymore and (...now I get to my point, and now you will understand I'm not crazy, now you will see how this idea will triumph and free information once and for all...) RIAA's plans to scare customers by getting sue news in the newspapers won't work anymore!
HA HA HA!
Are you listening RIAA!?
We have you now!!!
THE NERDS HAVE YOU!
No, no no. (Score:5, Funny)
Parent
Re:No, no no. (Score:5, Insightful)
Parent
If you can't beat 'em, use their names. (Score:3, Funny)
Then follow-up and make an overall sharing program called CopyRight.
irony (Score:5, Funny)
So why don't they just use Bittorrent to distribute their mirrors?
I don't infringe copyrights (Score:5, Funny)
That's why I always go to thepiratesbay.org.
They are located in Finland, of course, where US Copyright Law doesn't apply. So it's legal for them to offer files for downloading.
And, of course, in the US it's legal to download files. What is illegal is to offer more than $1000 worth of them for uploading.
So, please, let us all keep our Bittorrent downloads legal, folks. Thank you.
On Finland-Sweden, and funny legal threats (Score:5, Informative)
Yes.
Also, everyone should take a look at their hilarious responses to the letters from lawyers
here [thepiratebay.org].
It's therapeutic to see the slimeball lawyers really getting what is coming to them. These guys have really got a daring attitude
Parent
had to be said ... (Score:4, Funny)
Attack of the sucking parasites (Score:3, Interesting)
Don't forget the psychology! (Score:5, Interesting)
But Bittorrents have organized around websites. These sites typically require registration and monitor the share ratio of users. Users can no longer leach. There's social stigma attached to it. Also, you have some investment in making sure others have a copy of the file. If you liked it enough to d/l it, you probably want to share. Better yet, the action of the users of the site are focused on the same files, so resources are allocated fairly. Generally, it works better all around.
This leaves out the boost in nerd status of those who have large share ratios and upload lots of torrents. That helps with file availability too.
for those who didn't read the article... (Score:5, Informative)
Single point of failure (Score:5, Insightful)
First, you don't need servers to distribute ed2k links. A short ASCII string effectively replaces a large
Second, the servers play only a secondary role, even if many servers would go down, that would have a small impact on the network because of source exchange. And using Kad it's even possible to operate entirely without servers.
I do not hate BitTorrent, really. Even though I am a long time eMule user and even though I am very annoyed by the apparent popularity of BitTorrent here on
Re:Single point of failure (Score:5, Insightful)
Moreover, all those people that say: "please seed after you finish! Don't be a leecher!" are thinking in standard P2P terms, but this is NOT what BT was written for. It was written to aid standard http downloads, as numerous sites already do.
Parent
Interesting stats (Score:5, Informative)
Compare the stats from week ago, and today. Guess what changed?
Most telling is the last graph indicating traffic for the whole year.
The largest Finnish torrent site, Finreactor got busted by [p2pnet.net] Keskusrikospoliisi [poliisi.fi] (roughly the same as FBI of USA).
I guess they weren't sharing just Linux images
Traffic estimate is suspect (Score:5, Insightful)
I think any estimate made without measurements at many major routers would be suspect. While there is no doubt that BT is quite popular, the evidence presented thus far for the amount of traffic using BT protocol is extremely flimsy. I would take it with a grain of salt.
burris
Slashdot effect salve (Score:5, Interesting)
As long as I'm asking Santa, I'll be more specific. That "www" host has its DNS resolved by the nameserver at whatever.com , which hands out IP#s of the other "torrent" servers distributed around the "Web". torrent servers get the IP# of the real host at whatever.com, so they get content. There are problems: HTTPS requires each serialized object requested/replied to be encrypted with/for the actual private key of the requesting client, unknown until the request is made. And "CGI" or other dynamic content creates a huge space of permuted object states. But, Santa, Google figured out how to deal with all this in a centralized datacenter, and they're damn fast. Get the elves on this, and children around the world will sleep with visions of sugarplums streaming to their download directories.
My response to the author: (Score:5, Insightful)
BitTorrent is designed to replace and enhance the performance of a standard http or ftp download server. Where even ten simultaneous downloads can slow the performance of most inexpensive server setups to a crawl, BitTorrent can easily handle ten thousand or more, and in this it is an enormous success.
One necessary element of a true BitTorrent distribution is a dedicated seed server. This server ought to be always working, and should have a significant amount of bandwidth behind it; I'd recommend 30KB/s minimum, but more is better. You complain that seeders are "punished" and this is why torrents die, but while long-term seeders are nice, they aren't necessary. It is better for me as a content distributor to allow people to close their torrent and play with their new download as soon as they'd like to. Having torrents die off when interest fades is an artifact of misuse of this specification.
You worry about pollution on Suprnova.org, and so do I; there's no reason why it wouldn't exist. But as BitTorrent was normally intended this isn't a problem at all. People visiting Blizzard's website to download content via BitTorrent (actually Blizzard uses a modified downloader, but the concept would be the same if users received a standard
You're also concerned about tracker availability. I recommend content distributors run their own trackers, which is an easy task given the numerous types of trackers available, including script-based trackers. There's no reason for a tracker to go down unless the web server goes down, in which case no one would probably be able to get a copy of the
As a sharing method BitTorrent indeed has some deficiencies, but it simply wasn't designed for that. That BitTorrent is being misused for that purpose only testifies to its effectiveness. Perhaps a sharing system with elements taken from BitTorrent will someday arise; I know Suprnova.org is attempting to create one with "Exeem". But please don't badmouth BitTorrent.
Re:I work for.. (Score:4, Interesting)
Wow. Not really impressive. So-called "piracy" and more importantly, the RIAA's and MPAA's tactics are getting more and more press. To date, I know of few cases of people being busted. Sued civilly by greedy and useless corporations, sure. But not busted.
I cannot wait until I am done with law school and can contribute, knowledgeably, to the defense of such bullshit and hopefully the creation of more realistic and fair and beneficial laws. This artificial IP shit is harming the American consumer more than ever.
Parent
Re:I work for.. (Score:3, Interesting)
Witch Trials (Score:3, Insightful)
The problem here lies not in the "Copyright Cartels" but in your Terms Of Service with your ISP. The problem is that the contract you signed with them for acess lets them disable said acess arbitrarily.
Mod parent -1, misleading (Score:4, Interesting)
To me, the parent sounds more like someone who is actually trying to scare people away in general, not someone trying to be helpful.
Parent
Sure... (Score:4, Insightful)
I always listen to warnings like that! Y2K, update to SP2, don't download anything from the internet.
BitTorrent is inherently "safer" than any P2P (like KaZaa). Can you be busted for sharing illegal files? Sure. But.. You are at most only in trouble for the ONE copyright violation from one
Could they monitor EVERY tracker and EVERY torrent on those trackers and log EVERY IP address, maybe.. But don't forget torrents are time based, ie. you are only sharing file for a certain percentage of the time that
Parent
"safety" of filesharing (Score:3, Informative)
Except the copyrig
Re:I work for.. (Score:5, Insightful)
Wrong. There are no investigations going on to bust bittorrent users. There are investigations going on to bust people doing illegal file sharing, and some of them happen to be using bittorrent.
Parent
Re:I WROTE THE PARENT MESSAGE, and this is to you. (Score:3, Insightful)
Now would be a good time to put as much legitimate traffic (e.g. Linux distro's) as possible to make the case that Bit Torrent has legitimate use.