ZFS For Mac OS X Source Code Available 251
nezmar writes "Noel Dellofano, who is part of the ZFS development team at Apple, has a post on Mac OS Forge announcing a late Christmas gift: he is making available binaries and source code, plus instructions, of the ZFS filesystem for Mac OS X."
The real questions are... (Score:5, Interesting)
Re:The real questions are... (Score:5, Informative)
sh-3.2# zfs
Read-Only ZFS Implementation
missing command
usage: zfs command args
Re: (Score:2, Insightful)
Re:The real questions are... (Score:4, Insightful)
Re:The real questions are... (Score:4, Informative)
This is also why, when you create a ZFS pool using the read/write drivers, it defaults to creating a pool with ZFS version 6 on disk, so that it's compatible with the version of ZFS shipping with Leopard. (You run "zfs update" to transform your pool to the most recent on disk version if this kind of compatibility isn't an issue for you.)
BTW, Leopard also reads from BSD and Solaris-created ZFS drives just fine.
Re: (Score:3, Informative)
I could say the same of NTFS. After throwing in the towel with regard to Windows as a base OS, I have years of accumulated data on NTFS volumes spread across a small pile of drives. Linux support for NTFS is still a little shaky. But with read-only access to NTFS, I can throw those old desktop or laptop drives into an enclosure, connect it, and either pull all the data over to a writable volume for ongoing work (and perhaps dispose of the old drive), o
NTFS-3G on Linux is stable (Score:5, Informative)
Since ZFS is new, I don't think your scenario applies, and it's not intended for DVD/CD use.
Re: (Score:2)
Re: (Score:3, Interesting)
Re:The real questions are... (Score:5, Interesting)
Re:The real questions are... (Score:5, Informative)
Re: (Score:2, Insightful)
http://kerneltrap.org/FreeBSD/ZFS_Stability [kerneltrap.org]
But that doesn't stop the buzzword fanboys.
Re: (Score:3, Informative)
I've be
Re:The real questions are... (Score:5, Informative)
Re: (Score:3, Interesting)
I doubt that. Setting up a RAID array in Linux is about 4-5 lines in the CLI.
Re:The real questions are... (Score:5, Interesting)
Re:The real questions are... (Score:5, Insightful)
I'm not trolling, it's just that ZFS has been developed without the traditional and orthodox methods of disk-partition-filesystem and put everything on a single "layer", and instead of losing flexibility, we gain more, just because zfs developers were thinking outside the box (the now "traditional" way of doing things is segregation: the OSI layers, etc, claim to be more flexible, efficient and manageable than throwing everything together). I know, I know, veritas had this for years, so we could say that it was stole^H^H^H^H^Hcopied from them -- just as gates copied jobs, and jobs copied xerox.
Imagine the possibilities of breaking traditionalisms (like linux does "socially" but not "technologically").
linux md is grow-able, as is xfs and ext3 (Score:4, Interesting)
then you need to mkfs, and if you run out of space you're screwed because you can't easily grow.
All of Linux's md raid modes are grow-able.
LVM2, XFS, and ext3 are all capable of not just expansion, but *online* expansion. With xfs, it's one command- xfs_grow -d. It automatically senses the new block device size and presto, you've got a larger file system.
BTDT two weeks ago when I added a drive to my RAID5 array, expanded the LVM2 physical volume, grew the logical volume, and then grew the XFS volume (I make the choice to run LVM2 on top of the array- I could have just as easily put XFS directly on the array device itself.) The only caveat is that you won't see the extra space until the resilvering is done.
I'm not saying it's equal to ZFS, but Linux's filesystems and volume management are a lot more capable than you're claiming, and everyone needs to calm down and realize that RAID is not ZFS, ZFS is not RAID, etc.
Re:linux md is grow-able, as is xfs and ext3 (Score:4, Informative)
For anyone who has not seen the ZFS demonstration videos by Bill Moore you must watch the link.
High Bandwidth versions - http://www.sun.com/software/media/real/zfs_learningcenter/high_band [sun.com]...
Low Bandwidth versions - http://www.sun.com/software/media/real/zfs_learningcenter/low_bandw [sun.com]...
Also general info here:
- http://www.sun.com/software/solaris/ds/zfs.jsp [sun.com]
- http://www.sun.com/software/solaris/zfs_learning_center.jsp [sun.com]
Re: (Score:2)
Those layers weren't invented to make life complicated, they serve important functions.
Some kind of device-spanning file system other than what Linux already has may be a good idea; ZFS is not it.
Re: (Score:2)
Re: (Score:2)
I think the real question to ask is whether ZFS provides anything you actually need. If not, it's probably better to stick with your current system.
Re: (Score:2)
Re: (Score:3, Interesting)
Re: (Score:3, Insightful)
For those of you who have not used Solaris yet, or aren't sure whether ZFS is up to the hype; that notation is "disk n of target 6 of controller 5." Your home server has absolutely nothing on the dreadnoughts from Sun. They sell a box with 50+ hotswap drive bays, and the CPU power to back it up (and it's not even the top of their line).
-:sigma.SB
Re: (Score:3, Informative)
No you don't, LVM Physical Volumes can be initialised straight onto whole unpartitioned disks (/dev/sda).
Re:Linux md isn't rocket science...nor is ZFS raid (Score:5, Interesting)
The data integrity advantages of ZFS over traditional RAID-4 and RAID-5 are hard to argue with... it validates the entire input-output path.
Re: (Score:2)
Can you point me at an article that would provide more information on this? It'd definitely be a lot easier then having to back up the entire contents of the array.
I don't have any links handy and it's bedtime, but...from what I recall, you stop the existing array and then use mdadm to "create" a raid 5 array with those two drives. It'll bitch and say there's an array there already, but ignore the warning and force the operation. Apparently, md lays out data identical to a mirror if you create a 2-disk
oop, one last note (Score:2)
Then, use mdadm to add another drive as a spare, and grow the raid device out (ie using -n to change the number of devices along with the grow command.)
One last note: I accidentally 'added' a drive straight to the array without changing the number of drives. It seemed to just mirror the array onto the third drive. I believe the important bit is to add it as a spare, and then grow with a new #-of-devices param (-n). You might be able to do the add & change-# at the same time, and I just forgot to g
Not ready for prime time... (Score:4, Interesting)
Re:Not ready for prime time... (Score:5, Interesting)
I'll bet one of the reasons they're putting it out there is the hope that a few kind souls with some time on their hands will submit some patches and work out the kinks; given the amount of interest there is for this to be working on Mac OS X -- and there's a lot.
Maybe between Apple, some Sun devs on their breaks and Amit Singh they can have this all wrapped up in a few months :)
Academic question: What would have happened if MS had open sourced WinFS? Even under their PL, there would probably have been enough interest among enough dedicated nerds to... who knows.
Re: (Score:2)
Re: (Score:2)
Re: (Score:2)
"Hey guys, I have this great idea - Let's take a passably fast storage medium, the hard drive... And instead of using a one-layer mapping of filenames to physical locations, we can store everything in an SQL database the size of the whole drive! That way, we can take advantage of all the speed, reliability, and economy of resource use of MSSQL, and apply that to every file operation, no matter how trivial! Sure, we might get timeouts under heavy loa
Doesn't that go without saying? (Score:2, Funny)
It's a windows family tradition.
Re: (Score:2)
Re: (Score:2)
Like being able to grow the RAIDZ data pool. Maybe this isn't such a big deal in the large data pools and extremely capable servers that Sun usually deals with.
But for me it was big deal when I went from 1.6 TiB to 4.0 TiB and I'm really hoping that this is all worked out before I have to expand again.
To me a proper RAID would fully & automagically utilize whatever drive I stuck
Re: (Score:2)
Notes (Score:5, Informative)
Re:Notes (Score:5, Informative)
http://forre.st/storage [forre.st]
It works with newegg.com to find the best deals on HDs
Re: (Score:2, Insightful)
Re: (Score:3, Insightful)
Re:Notes (Score:5, Funny)
Re: (Score:2)
Geez, I should hope OS X would have the whole binary thing down pretty good by now.
Re: (Score:2)
Geez, I should hope OS X would have the whole binary thing down pretty good by now.
Oh, I don't know... They still seem to be stuck with Roman numerals.
Then again, since Microsoft patented ones and zeroes [theonion.com], I guess OS X is the best analog computing can offer today.
When do they say, "Just Kidding!" (Score:5, Informative)
An absolutely, positively, amazing feature set. I can't wait until it's stable enough for production use. After 7 years of staying away from Apple products, I'm going back to the Mac.
Re:When do they say, "Just Kidding!" (Score:4, Informative)
Re: (Score:3, Interesting)
FreeBSD... maybe... I kind of like the Apple hardware, though.
Re: (Score:2)
Well, last time I checked they used pretty ordinary PC components. I'm sure you can build your own computer with (almost) same components and even spray paint a picture of an apple to the chassis :)
Re: (Score:2)
Re: (Score:2)
Why wait? OpenSolaris (x86, x64, SPARC) or download a free license of the real deal Solaris (X86, x64, SPARC)....
www.opensolaris.org or www.sun.com
either way - zfs rocks, and they keep adding more features frequently....
Re: (Score:2)
Re: (Score:2)
More like available externally since Nov 2005 (in opensolaris), and running internally for at least 3 more years than that.
Alex
Re: (Score:2)
Hmm (Score:2)
Re:Hmm (Score:5, Informative)
Re: (Score:3, Interesting)
Well then I wonder what Sun thinks of this.
Not that it really matters what Sun thinks about their F/OSS filesystem that anyone can download, modify or incorporate into their OS, but they are excited about Apple's adoption of ZFS, and have been contributing resources to the 'ZFS for OS X' project. It was widely rumored that ZFS would at least be an option in the shipping version of Leopard, if not the default filesystem. Someone over at Sun was even crowing about this a few months before Leopard was released.
I'd say Sun looks favorably upon thi
Sun CEO Encourages Apple to Use ZFS (Score:5, Informative)
Re:Hmm (Score:5, Funny)
Re:Hmm (Score:5, Funny)
Great new filesystems (Score:5, Interesting)
Re:Great new filesystems (Score:5, Informative)
I've had no problems with 5T+ datasets, and we even get about a 10-20% performance boost out of it compared to UFS.
snapshotting & all those neat features work totally as expected.
Only minor issue I see is that a zfs send is single threaded, so you cant parralellize it over multiple processes easily.
Re: (Score:3, Funny)
Well, a multithreaded filesystem is only a performance hack anyway.
Re:Great new filesystems (Score:4, Informative)
Here's a link explaining the parent [oreilly.com] for all you c|net "reporters" and NYT technology stringers who read slashdot. You know who you are.
Best ZFS Presentation (Score:5, Informative)
Re: (Score:2)
But what are we going to do with all of our dev>null jokes?
That's nice. (Score:5, Funny)
Re:That's nice. (Score:5, Funny)
Good One! :o) (Score:2)
Re: (Score:2)
Re: (Score:2)
Re: (Score:2)
Re: (Score:2)
Re: (Score:2)
It is almost like they are separate identities, and his alleged criminal behaviour didn't introduce bugs into his code or something.
"he is making" (Score:5, Informative)
Re: (Score:2, Funny)
Oh my Lord!
So what, move on guys..??
Actually, (Score:5, Informative)
What if someone did port ZFS to Linux? (Score:3, Interesting)
Re: (Score:3, Interesting)
Short answer: nobody and nothing.
Long answer: The biggest issue (to my understanding) is that it will not be included in the official kernel. Google sponsored it to be included in FUSE to cover their butts because I suppose they just didn't want to get involved in the issues. I don't see why it couldn't be released as a patchset that someone would have to patch and install manually, at the very least.
But then again, this is my view and understa
Patents.. (Score:2)
That is of course unless you're in a country such as the UK which doesn't believe in software patents, then it's the users problem, not yours.
Doesn't work with iTunes? (Score:2, Insightful)
I wish they'd finished UFS support first. (Score:3, Informative)
HFS? I've had HFS partitions get corrupted just be letting them get too full. That's just nuts.
ZFS? Sun says ZFS doesn't need file system check and repair tools, it can't fail. That's what DEC said about AdvFS, than then later on came up with salvage tools to pull data out of a damaged AdvFS file system. That's what the Linux folks used to say about Reiser FS, too. Even before the Hans Reiser incident it had become clear that it wasn't true, and I've got no reason to assume that ZFS will be any better, not over the long term.
The only journalled file system I've found that has come anywhere near that goal has been Network Appliance's, and they have complete control over the hardware and software and no third-party applications and drivers running on the hardware. And, of course, few places have very many NetApps (we certainly never had more than 4 at a time) so I can't say that the apparent stability of our boxes isn't due to the fact that we simply never had many of them...
Apple refreshed UFS for Panther, bringing in SoftUpdates to give it the performance advantages of journalling, then dropped it.
Apple has created layers that run over network file systems that implement almost all of the application-visible differences between HFS and remote CIFS and NFS shares, but you can't take full advantage of these for local UFS file systems. Why not? Don't ask me, ask Apple.
I blame corporate ADHD.
Re: (Score:2, Insightful)
Re:Linux? (Score:4, Informative)
Re:Linux? (Score:4, Informative)
Or.. (Score:2)
Frankly, no one is going to do anything about it, so I look forward to the day that common sense breaks out and we quit letting legal mumbo jumgo get in
Re:Linux? (Score:5, Interesting)
And I think most people will agree with you that Fuse isn't good enough. But at the moment, there are only two options: complete reimplementation from the ground up, and Fuse. Fuse is easiest.
Re: (Score:2)
So are you saying that the "zealot" is Sun because they won't relicense their code as GPL 2?
Re: (Score:2)
Re:Linux? (Score:4, Interesting)
Re: (Score:2)
they are very similar OSs and both offer more or less the same userland (you can bring up the latest Gnome on both).
Re: (Score:3, Informative)
Re: (Score:2)
Re:Total garbage - has no error result codes! (Score:5, Informative)
ZFS is designed to perform writes asynchronously. If the write should be able to complete, it returns success and then goes off to do it. It's a different way of thinking about a filesystem. You need to do a "zpool export" or something before you can unplug a detachable disk to avoid the panic when you unplug it. That's not a bug. It's by design.
No it isn't. You're just misunderstanding the semantics of ZFS.
No it isn't. It's just not a filesystem that's suitable for the masses. Average users cannot understand or manage an advanced storage pool system like ZFS. They're better off with filesystems that make sense to them, like HFS+, ext2 or NTFS.
Shame on all the geeks for telling everyone that ZFS will solve all their problems. ZFS is great under certain circumstances. It does what it does very well, but it isn't a filesystem for the masses.
Just plain not reporting errors is a bug. ZFS asynchronous write semantics is intentional, although counter-intuitive, behaviour.
Re: (Score:2, Funny)
Huh? Music, movies, Office, and porn. And lots of web browsing (goes with the porn).
Do I want ZFS or not?
Re: (Score:2)
I beg to differ. Even with a single disk preformatted with ZFS from the factory, users can benefit from ZFS's paranoid checksumming.
Re: (Score:3, Informative)
Then, of course, checksumming everything does wonders to protect against bit rot and flaky cables.
Re:Port it to Linux (Score:4, Informative)
Re: (Score:3, Interesting)
Re: (Score:2)