Optical Fiber Storage 71
TypeCast writes "When you've got Canada's elbow room, perhaps you can squeeze in a 'disk drive' 5,000 miles in diameter. But the plan by Canada's CANARIE researchers for a Wavelength Disk Drive (WDD) within optical networks suggests all of Universal Music's library would still make for a tight squeeze as light-speed storage. Here's a white paper on the WDD for those who aren't afraid of MS Word documents."
Re:Bad news for MPAA and friends (Score:1)
[geek]Yes, sir.
[judge]I sentence you to 15 years in a federal ass-pounding facility.
Re:Bad news for MPAA and friends (Score:1)
[geek]No sir.
[judge]Did you realize we really hate jokes aboot ass-pounding?
[geek]Oh, no sir!
[judge]Did you know that I caress statues?
[geek]yes sir.
[judge]Did you finish your supper?
[geek]fuck no, sir.
[judge]Where is the stolen data?!
[geek]it travels around as light waves, sir.
[judge]This is no excuse. Pokey
Bad news for MPAA and friends (Score:5)
[judge] So does your controversial web page reside in California?
[geek] It resides in California 15 milliseconds every 350 milliseconds, your honor.
[judge] Pardon me?
[geek] My web page is served on optical fiber storage. It goes around the country in a big circle.
[judge] B-but it's stored somewhere in California, r-right?
[geek] No sir, it's encoded in photons travelling at the speed of light, you honor.
[judge] [thinking for a few seconds] Goodness, I'd rather be put on a simple divorce case.
Re:Makes no sense at all (Score:1)
Re:I can just see it.... (Score:1)
Crowded? If you put every human on the planet in Texas, everyone would have more square feet of space than you have in your dorm room. Don't get out much, do you?
I don't believe you, not even a tiny bit. According to Britannica [britannica.com], Texas is 266,807 square miles. That's 1,408,740,960 square feet. According to Ask Jeeves [askjeeves.com], the world's population is currently at 6,127,565,379 people. Dorm rooms are usually about 10 feet by 12 feet and are designed for two people, which works out to about 60 square feet per person. Without going into exact calculations we can immediately see that there would be under a square foot per person which directly contradicts your statement that each person would have more room than he does in his dorm.
Now if you take everyone on the planet and cram them into Ontario, Canada... There is signficantly more breathing room! Ontario occupies 412,581 square miles, or 2,178,427,680 square feet. That's almost twice the square footage per person. Ontario is only the second biggest province in Canada... Kinda puts Texas to shame considering it's twice as large!
Let's expand to the entire U.S. If you were to cram every person on the planet into the United States (3,679,192 square miles, or 19,426,133,760 square feet) you end up with a mere 3.17 square feet per person, or about 1/20 the room you'd have if you were in his dorm (assuming he has an average dorm room as given above).
Texas is the biggest state, sure... That don't mean shit when you're talking about six billion people though.
The BOFH has thought of this before (Score:1)
Peak Usage? (Score:1)
Re:Fiber Disk Drive (Score:2)
This has been done before, but not with light. With sound! That's right, back in the 1950's they actually made memories from long mercury-filled tubes conducting sound impulses. The impulses would be amplified and "squared-up" each time around. They could only store a few thousand bits that way, but you could always have several of them running in parallel.
Nothing new (~tweaked FDDI) (Score:3)
The "new" idea was not the ring as network topology nor the storage itself (has been done acoustically as stated above), but to coordinate client-server clusters with this. But clusters organized in ring-topology are not new either.
In the proposed topology the master server just injects "to-be-done" packets into the ring. The clients pick up (and remove) one packet from the ring each time they want to start crunching the next work packet. The other packets will be circulating the ring until solved.
Main problem is that one will be either wasting a lot of transmission capacity for idle data circulation - or be running into capacity problems. There is a reason why most detail work when designing clusters goes into designing the optimum network architecture for the specific problem...
Fsck the network now...? (Score:1)
/dev/fibre0 contains a file system with errors, check forced.
/dev/fibre0:
Inode 23271 has illegal blocks.
/dev/fibre0: unexpected inconsistency; run fsck manually.
Every time some farmer puts a hoe through a cable...
What the future might hold. (Score:1)
automatic conversion to html (Score:2)
Re:Nothing new (~tweaked FDDI) (Score:1)
| Tolken ring actually allows for several
| packets to circulate...
Well, duh... Of course a Tolkien ring has to have several packets circulating at the same time.
Three packets for the Elven-Kings under the sky,Seven for the Dwarf-Lords in their halls of stone,
Nine for Mortal Men doomed to die,
One for the Dark Lord on his dark throne
in the land of Mordor where the Shadows lie.
One Packet to rule them all, One Packet to find them,
One Packet to bring them all and in the darkness bind them
Re:Fiber Disk Drive (Score:1)
All serial storage has an access time problem, however. You may have to wait a couple of seconds to get the data you want from the moonbounce recirculation.
-Martin
DNS? (Score:1)
Isn't this almost the definition of DNS?
All your base are belong to us.
BOFH (Score:1)
Technology is circular (Score:4)
Now people are talking about fibre optic delay lines as storage devices. Some of the earliest computers stored data as sound waves in mercury [cam.ac.uk] and
nickel wires [science.uva.nl]. A speaker injected sound in one end, it was picked up my a microphone at the other, re-shaped and squirted back in.
Same idea, different medium.
Re:I can just see it.... (Score:2)
Oh, you're worried about a hundred years from now? Become a teacher. More education reduces population growth rates.
Re:Bad news for MPAA and friends (Score:2)
Square Feet in Texas (Score:2)
You multiplied the number of square miles times 5,280, the number of feet in a mile. But that's only the number of square feet along a one-foot-wide strip of a square mile.
266,807 square miles times 5,280 feet (one side of a square mile) times 5,280 feet (the number of one-foot strips in a square mile) is 7,438,152,268,800 square feet. Now do the division by the number of people. 1,213 square feet per person.
Re:I can just see it.... (Score:1)
A hundred years from now, when the earth's human population is sky-high, and there are more of us than there are roaches and rats, that 'empty space' might be all that's left for people to go to in order to get away from the insanity of constant, close space contact with other humans.
Living in a dorm, I find such close-space contact near traumatic. It really takes a hit on my performance as a student and a human being. If you're like me, such a society would be unlivable, and would quickly drive you to insanity. (At least there are some cliffs nearby where I can get away from it all and relax every once in a while.)
While magnificant skyscrapers are quite beautiful in their own way, they still can't compare with the natural beauty of millions of differently shaped and sized trees, all (mostly) unharmed by humans.
-------
CAIMLAS
Re:...and HTML (Score:1)
This html translation was generated (blindly) by StarOffice [sun.com].
--
Re:Bad news for MPAA and friends (Score:1)
--
Re:Viruses (virii?) Worms & K1DD1eZ (Score:1)
This protocol essentially eats bandwidth. If you have 10GB of of storage available in 80Gbits of bandwidth on CA*net3, and you're using 5GB of storage, you're sucking 40Gbits of bandwidth across the whole network before you even start to count "normal" data on the network.
Granted, they mention making this bandwidth low priority, but you're still eating a LOT of bandwidth. Since it's across the whole network, it's actually more of a strain on the network than a 40GB point-to-point feed. This could, in some instances, affect the maximum burst bandwidth of the network for normal data and/or the data loss of 'normal' data when the saturation point is reached.
The time savings is very theoretical. In fact, it's statistical. Mostly, what you're going to save is the cost of injecting data into the network. Beyond that, the savings you get improve as the space between nodes increases.
example
Let's take the example of a 100ms loop in Canada. The average delay for a piece of data in the loop is going to be 50ms. I've got an ADSL link in Vancouver. My ping time to UBC is 20MS. My ping time to UMontreal is 100MS. My ping time to what I presume is Telus's backbone appears to be 14MS. I'm going to presume that the 14ms is overhead (my distance to the loop). This gives me an average access time of 50+14=64MS for data in the loop.
If my data originates in Montreal, then I'm going to save something like 100-64=36MS over calling the machine at Umontreal. directly. (this presumes that the Umontreal machine has the data in RAM).
If my data originates at UBC, we have 20-64= -44ms. In other words, I LOSE 44ms over directly contacting the UBC machine for the data. (note that reducing my distance to the loop doesn't change the savings/loss since it also reduces my distance to both UBC and UMontreal).
Mostly, where the savings lie are in the difference between sucking data out of the loop vs pulling it off of disk. You can also get some savings if the data is being essentially multicast. Those savings do not appear to be available to the current protocol which seems to remove a packet from the loop once a machine requests it. The data then needs to be re-injected for a second recipient.
--
Re:...and HTML (Score:3)
And here is the HTML version [vitrualave.net] kindly genereated by freviewer [freeviewer.com].
Re:Fiber Disk Drive (Score:1)
Nor will the light stay confined to a simple glass strand. Not if it touches another piece of itself. glass optical fibers are a core of one type of glass surrounded by another of a different refractive index, and light never reaches the inside edge of the fiber.
This is nothing new... (Score:1)
Instead of fiber it used 16 mercury delay lines that yielded 256 35-bit words (or 512 17-bit words) of storage.
Source: Chronology of Digital Computing Machines [best.com]
Light is slower in glass (Score:2)
What happens... (Score:1)
Re:I can just see it.... (Score:1)
"Everything you know is wrong. (And stupid.)"
defrag on the fly (Score:2)
-Daniel
Re:What the future might hold. (Score:1)
A yottabyte is 10 to the 24th power bytes or 2 to the 80th power bytes. I found it interesting how we have adopted the SI metric terms which are decimal based for information units which are binary based. It is all explained here http://physics.nist.gov/cuu/Units/binary.html [nist.gov]
Re:the backhoe again (Score:2)
But they aren't planning to store anything long-term on it! It's only intended for very short-term data, such as which computer is working on what part of a large job, or the results of one piece of the job that finished running.
They only will have 10GB for the whole ring; that wouldn't be much for all of Canada if people try to store MP3 files on it!
And anyway, if you are going to make a peer-to-peer, massively parallel computer, you need to make the system robust. Forget the backhoe; suppose a power failure takes out an entire town's worth of computers all at once?
P.S. It would be serious overkill, but I keep picturing this being used to release Linux kernel 2.6! 10:00, it ships; 10:01, every computer in Canada has a copy...
steveha
Canada, the InterComputer (Score:5)
SETI@home [berkeley.edu] works in client-server fashion: your desktop computer asks the main server for a chunk of data, then chews on the data and talks to the server again. This is massively parallel computation, but it isn't peer-to-peer, it's client/server.
When you put data on this fiber ring, within a very short time all the computers on the ring have seen the data. So if you want a bunch of computers to cooperate on a job, this would be a great way for them to update each other on what they are doing. If you did it right, you would have massively parallel distributed processing: all the computers in Canada tied into a single InterComputer. And just as Napster [napster.com] can spread popular songs around where a single FTP server would be hammered, an InterComputer potentially could handle truly large computations that any single computer (or even Beowulf [beowulf.org] cluster) couldn't.
Multicast data packets aren't new; that's why they said it takes only a few changes to try out their ideas. Multicast packets are currently designed to die fairly quickly so they can't clog a network up too much; these guys want the packets to go all the way around the ring.
P.S. That joke about the backhoe chopping the fiber was only a little bit funny, and then only the first time. When a backhoe hits a cable today, half of Canada does not lose Internet service! It isn't a trivial ring; it has some redundancy redundancy.
steveha
Another Storage Device (Score:1)
with SPEED of access? I really don't look at
most of my files (like, why bother? they are
really not important).
Get myself a USENET site. Deliberatly insert
junk into messages and recirculate them.
I think I could jam many gigabytes into the
system without too many people noticing.
Use steganography to hide the messages...
Or, SPAM with the info hidden into the anti-
SPAM defeaters. Or, encode into junk emails
that will be bounced.
Ok, it's silly. But I really have to do something
about the 30GB of music that I am collecting but
not listening too...
Liberate my hard disc!
Re:DNS? (Score:1)
With this system, the data stays on the line. If it were used for DNS, that would mean something like the root servers would broadcast their _entire_ database, and the packets would keep circling the loop for a while until the root servers update them again. Any lookups, then, would only have to look at the packets already there; no connection necessary.
Of course, 10GB isn't nearly enough storage capacity to hold all the root servers' data. And that doesn't even include any subdomains. Their data would have to be there too if DNS would really work like that.
It could be really cool for distributed processing, though. Reserve a certain portion of the available bandwidth as shared memory, so that every box can read simultaneously. I think that's more what the article had in mind.
--
To go outside the mythos is to become insane...
How does this work? (Score:1)
Nathaniel P. Wilkerson
Domain Names for $13
trees? (Score:1)
Nathaniel P. Wilkerson
Domain Names for $13
Converted it to PDF... (Score:5)
You can download it here:
Cheers,Wavedisk White Paper (PDF) [dyndns.org]
Chase
Re:Converted it to PDF... (Score:1)
ls -l wave*
-rw-r--r-- 1 msevior users 64000 Feb 10 00:04 wavedisk.doc
-rw-r--r-- 1 msevior users 12057 Feb 10 00:05 wavedisk.zabw
Get your FREE abiword for your platform of choice at http://www.abisource.com
Abi is cool :-)
Martin [msevior@chaos ~]$
If latency=storage space.... (Score:1)
Re:Technology is circular (Score:1)
An old calculator, the Friden EC-130 used sound traveling down a wire as memory. You can read about it at http://www.geocities.com/oldcalculators/friden130. html [geocities.com].
It is a wonderfully convoluted machine.
I can just see it.... (Score:1)
Re:I can just see it.... (Score:2)
Fiber Disk Drive (Score:1)
a spool and bring both ends out. I have a fiber transceiver at each end. I have then
created one of these drives but for local use.
Glass strands are cheap, in fact, they are sold for fiberglass "chopper guns". The strand
should not require any sheathing as the light should remain confined in the fiber strand.
A spool of this glass can be bought at a fiberglass supply house....how the inner end
is accessed is a problem which may require you to unwind it from one spool onto another
without breaking the strand. Or, chop into the side of the spool and get a strand close to
the inner end.
With no moving parts, and encapsulated, this should be really reliable.
Lots of hacking potential here...how many miles of cheap plain glass strand can you have for
a cheap fiber transceiver?
Re:And the point is......? (Score:3)
So shared data between processes executing in multiple computers from vancouver to halifax can be quickly accessed and updated.
The speed increase over requesting the data from ether over it being in some computer's cache depends on how fast that computer's connection is to a backbone's router.
Although now that I do some quick calcs, the max latency turns out to be, 180000(k/s)/8000(km) = 1/23rd of a second = 45ms, and avg latency 22ms, which is slower than HD.
You'd be saving 5ms to 10ms maybe over getting the data from a cpu behind a router, so the applications are indeed pretty narrow, but not non-existant.
Laser, telescope and asteroid? (Score:1)
--
Re:I can just see it.... (Score:1)
Cure for Slashdot effect (Score:1)
The BOFH Comes to Life (Score:1)
Re:That's not much storage, really... (Score:1)
For instance, 10 gigs/sec with a latency of 100 ms would result in 1 gig of data, but put ten routers with a (hypothetical) gig of buffer, and you have 101 gigs of space at a latency 10.1 seconds. There is sort of a space/speed ratio that has to be met. Increase the speed, and you lose space on the network. However, increase the speed of the connections (100 gig/sec if thats possible) and you can bypass this restriction.
Not worth it? (Score:1)
Re:Makes no sense at all (Score:2)
Re:I can just see it.... (Score:1)
> Whoops, power failure!
Talk to Microsoft. They'll set you up with some five-nines reliability.
Re:Bad news for MPAA and friends (Score:1)
ObNote: A method of data storage the relies on continuous uninterrupted power for maintainence of storage is BAD. Yeah, the umpteen Tera-byte hard drive is still out of the hands of your average User, but if the power goes out, it doesn't necessarily wipe my drive. (That's what the magnets are for!)
Kierthos
Re:Fsck the network now...? (Score:1)
Big deal, he picked on farmers. If he had been talking about French farmers, it would have been completely merited. Anyway, how many times have we heard stories about Joe Farmer cutting fiber lines? It seems to make the news (at least here in the wilds of South Carolina) more then any news of road crews, inept technicians or drunk college students playing with the fiber lines.
Finally, it seems just a touch odd that someone using a quasi-Roman name (Solidus) would call anyone gwailo....
Just my 2 shekels.
Kierthos
Here's what can happen (Score:1)
Viruses (virii?) Worms & K1DD1eZ (Score:1)
What other ways do you think people will find to abuse this new method of storage? Only time will tell...
Re:Fsck the network now...? (Score:1)
Solidus Fullstop, Esq.
Re:Nothing new (~tweaked FDDI) (Score:1)
Learn Canada (Score:1)
Currently, the High School which I attend (Holy Heart Of Mary [k12.nf.ca], St. John's, NF) has access to the Ca*net 3 (whereas I always thought it was called CA3net...) for the purpose of participating in a project called "Learn Canada".
Through this project, we are able to videoconference with schools across the country with an extremly high-quality video feed. This way, one of our teachers can teach a class in Victoria, BC, without leaving the province, teachers can be evaluated by teachers elswhere in the country, etc.
Unfourtunately, though, I'm not allowed to play with the new server we received for the project. The entire project is running Red Hat 7.2, whereas my school uses NT servers... I was looking forward to using a Linux box at school...
Yours ect.
Re:And the point is......? (Score:1)
"Advanced Networking Technology"..Pah (Score:1)
The originator of the idea proposed bouncing radio waves or a laser beam off the moon - giving about a 4 second latency.
After much discussion (and beer) we agreed that optical fibre wound onto a drum would be more reliable.
So if Jim Murray or Kirk Whelan are still alive out there, get in touch!
George
And the point is......? (Score:1)
Someone please calculate - what is the worldwide capacity of the network to hold data based in this article?
Sure it's a neat technical idea and I am not against that, but get real guys - storage should be on STORAGE devices - disk, tape whatever....... What level of reliability, backup etc could ever be given to this concept?
how could this be used in the real world?
what are the capacity implications?
what backup could ever be made available>
Go on...
Tell me what this is really about!!!!
get your data at WFBQ - 1.432Gz on your Radio dial (Score:1)
Latency, Rate, and Integrity... (Score:1)
The paper correctly asserts that TCP as a transport introduces significant overheads to IPC in distributed systems, but glosses over the detail. The generic nature of TCP assumes that the underlying network technology is imperfect, which as far as I can tell, the WDD does not. Hence, the cost of TCP's ability to tolerate failures is an overhead of protocol processing to establish a reliable stream transport. TCP is not ideal for high performance message passing systems, but this should not come as any surprise - just look at the inefficiencies inherent in the HTTP protocol (particularly early versions).
It would be fairer to compare the likely performance of the WDD with a messaging system based upon a transport without retransmission support - message passing over UDP being an obvious contender. Here, protocol processing is drastically reduced, but a new communications issue must be raised: what happens if a packet is lost in-transit owing to corruption? (I admit that this is far less likely in typical optical networks of today, than yesterdays less robust CSMA/CD offerings, but this problem must be considered, particularly if the stability of a large scale distributed processing system depends upon it!
When I read the WDD proposal I see a clear comparison with token ring systems, the only significant difference being that the "transmitting node" is able to pre-empt what data requires to be sent. To me, the storage capacity of a WDD renders it more comparable to a shared memory,. This highlights a need for a strategy to decide what to store in the shared medium, and what to store on traditional media... a page (packet) replacement algorithm if you will. A successful PRA would present a considerable performance improvement, as it would significantly reduce latency - the curse of distributed computing! Conversely, such a PRA could equally well be applied to all communications, as it effectively presents a mechanism to pre-empt what data requires transmission, and everyone likes clairvoyant systems.
This aside, my primary objection to the usefulness of this sort of facility is that the authors assume that a WDD would present a use for spare bandwidth. I would argue that there is no such thing. When utilisation of a shared resource (the transport) is low, then latencies are lower, and this is of fundamental importance to the performance of processes interacting over a communications channel. Cf. write-times on an empty vs. full hard disk:-)
To summarise - an interesting idea from which I can imagine many practical spin offs, but surely it is frivolous to suggest that this will revolutionise computer communication or shared data storage.
Re:Latency, Rate, and Integrity... (Score:1)
My fundamental objection is that the overwhelming majority of communications systems, and all general-purpose systems, are not synchronous... and for good reason. While we see a proliferation of synchronous transmission media, we must also consider the nature of the processes on the computers effecting communication over these networks, which are almost universally asynchronous, not to mention the effects of truly external events, such as communication triggered by user actions.
Re:the backhoe again (Score:1)
How many copies are floating around? If a small segment of the network gets cut off and my important data (silly me) happens to be in that network segment and then, as another reader mentioned, the power goes off, what happens to my data? Connectivity can be lost and restored. Data lost on a fiber network cannot.
Yikes (Score:2)
The glass just seems a little fragile...
Makes no sense at all (Score:1)
Let's see, the ring is 5000 miles or roughly 8000 km. The signal takes
So just let's put in more routers, increase the latency of the signals, and thus increase the capacity of your "drive".
The suggestion that an optical signal stores any info, is very misleading.
Re:Makes no sense at all (Score:2)
Look at it this way. If there were no delays in the network, only optical repeaters, no routers, the signal would travel at the speed of light, and travel the 8000 km. in
Now, this ring has a latency of
(Or have they invented optical repeaters that delay the speed of light and have a memory of their own?)
You could also buy 20 routers, hook them up with ethernet in a circle, pump around data through it as fast as you can, and enjoy an 'ethernet' drive at home. Be sure to buy routers with large buffers for increased storage!