LWN.net Logo

RAID 5/6 code merged into Btrfs

RAID 5/6 code merged into Btrfs

Posted Feb 4, 2013 21:09 UTC (Mon) by man_ls (subscriber, #15091)
In reply to: RAID 5/6 code merged into Btrfs by daglwn
Parent article: RAID 5/6 code merged into Btrfs

Using git for backups must be just for the brave! How do you deal with huge incompressible files such as media data?


(Log in to post comments)

RAID 5/6 code merged into Btrfs

Posted Feb 4, 2013 21:12 UTC (Mon) by dlang (✭ supporter ✭, #313) [Link]

if they don't change, git based backups aren't going to be any worse than other backups. The big problem with git comes if the large, un-diffable files change.

RAID 5/6 code merged into Btrfs

Posted Feb 4, 2013 21:38 UTC (Mon) by jaa (subscriber, #14170) [Link]

If anybody is already using git for backups, I highly recommend to familiarise yourself with bup. It's really interesting concept to backup data (incremental backups, deduplications of data etc...)

From bup's website: bup is "Highly efficient file backup system based on the git packfile format." https://github.com/bup/bup

RAID 5/6 code merged into Btrfs

Posted Feb 4, 2013 23:24 UTC (Mon) by daglwn (subscriber, #65432) [Link]

Yes, I've looked at bup. I wish the author would try to get it integrated as part of the git suite (or at least in contrib/). Having to specify things like GIT_DIR before using bup commands seems dangerous. Plenty of git commands keep their own metadata in .git.

I would love to see "git bup!"

The reason I'm sticking with git is that's is easily available anywhere and right now I mostly just use it as a more convenient rsync. That is, I simply want to make a bunch of files easily available anywhere. As a bonus, replication provides a incremental backup capability.

RAID 5/6 code merged into Btrfs

Posted Feb 5, 2013 2:18 UTC (Tue) by josh (subscriber, #17465) [Link]

RAID 5/6 code merged into Btrfs

Posted Feb 5, 2013 10:27 UTC (Tue) by daglwn (subscriber, #65432) [Link]

That's pretty close. Unfortunately:

"But, git-annex also extends git's concept of remotes, with these special types of remotes. These can be used just like any normal remote by git-annex. They cannot be used by other git commands though."

RAID 5/6 code merged into Btrfs

Posted Feb 4, 2013 23:19 UTC (Mon) by daglwn (subscriber, #65432) [Link]

Any such files I have don't change once created.

I've looked at bup but haven't yet taken the plunge. I'd rather keep a fully git-compatible format until I am forced to change.

Copyright © 2013, Eklektix, Inc.
Comments and public postings are copyrighted by their creators.
Linux is a registered trademark of Linus Torvalds