Posted Feb 4, 2013 21:09 UTC (Mon) by man_ls (subscriber, #15091)
[Link]
Using git for backups must be just for the brave! How do you deal with huge incompressible files such as media data?
RAID 5/6 code merged into Btrfs
Posted Feb 4, 2013 21:12 UTC (Mon) by dlang (✭ supporter ✭, #313)
[Link]
if they don't change, git based backups aren't going to be any worse than other backups. The big problem with git comes if the large, un-diffable files change.
RAID 5/6 code merged into Btrfs
Posted Feb 4, 2013 21:38 UTC (Mon) by jaa (subscriber, #14170)
[Link]
If anybody is already using git for backups, I highly recommend to familiarise yourself with bup. It's really interesting concept to backup data (incremental backups, deduplications of data etc...)
From bup's website: bup is "Highly efficient file backup system based on the git packfile format." https://github.com/bup/bup
RAID 5/6 code merged into Btrfs
Posted Feb 4, 2013 23:24 UTC (Mon) by daglwn (subscriber, #65432)
[Link]
Yes, I've looked at bup. I wish the author would try to get it integrated as part of the git suite (or at least in contrib/). Having to specify things like GIT_DIR before using bup commands seems dangerous. Plenty of git commands keep their own metadata in .git.
I would love to see "git bup!"
The reason I'm sticking with git is that's is easily available anywhere and right now I mostly just use it as a more convenient rsync. That is, I simply want to make a bunch of files easily available anywhere. As a bonus, replication provides a incremental backup capability.
RAID 5/6 code merged into Btrfs
Posted Feb 5, 2013 2:18 UTC (Tue) by josh (subscriber, #17465)
[Link]
Posted Feb 5, 2013 10:27 UTC (Tue) by daglwn (subscriber, #65432)
[Link]
That's pretty close. Unfortunately:
"But, git-annex also extends git's concept of remotes, with these special types of remotes. These can be used just like any normal remote by git-annex. They cannot be used by other git commands though."
RAID 5/6 code merged into Btrfs
Posted Feb 4, 2013 23:19 UTC (Mon) by daglwn (subscriber, #65432)
[Link]
Any such files I have don't change once created.
I've looked at bup but haven't yet taken the plunge. I'd rather keep a fully git-compatible format until I am forced to change.