|
|
Subscribe / Log in / New account

Btrfs support coming to AlmaLinux 10.1

The AlmaLinux project has announced that the upcoming 10.1 release will include support for Btrfs:

Btrfs support encompasses both kernel and userspace enablement, and it is now possible to install AlmaLinux OS with a Btrfs filesystem from the very beginning. Initial enablement was scoped to the installer and storage management stack, and broader support within the AlmaLinux software collection for Btrfs features is forthcoming.

Btrfs support in AlmaLinux OS did not happen in isolation. This was proposed and scoped in RFC 0005, and has been built upon prior efforts by the Fedora Btrfs SIG in Fedora Linux and the CentOS Hyperscale SIG in CentOS Stream.

AlmaLinux OS is designed to be binary compatible with Red Hat Enterprise Linux (RHEL); Btrfs, however, has never been supported in RHEL. A technology preview of Btrfs in RHEL 6 and 7 ended with the filesystem being dropped from RHEL 8 and onward. AlmaLinux OS 10.1 is currently in beta.



to post comments

RHEL's default is XFS?

Posted Oct 23, 2025 15:01 UTC (Thu) by rsidd (subscriber, #2582) [Link] (42 responses)

I didn't realize RHEL had never supported Btrfs. XFS is a fine filesystem but lacks features that have been stable in other filesystems for well over a decade. By which I don't mean Btrfs (I don't know) but, in particular, ZFS. I have been using ZFS on desktop and laptop for 10+ years and zero issues. It in fact once helped me recover from a failing disk in time to back up with no data loss. And it supports a bunch of things XFS doesn't; snapshots in particular are a lifesaver.

Yes, I know the legal status debate. I find Ubuntu's position completely logical and nobody has challenged it in nearly a decade: OpenZFS is not a derived work of Linux (it works on FreeBSD and IllumOS) and obviously Linux is not a derived work of OpenZFS. Loading the kernel module is "mere aggregation". A decade after Ubuntu laid the legal argument out, it's time it was accepted.

This is philosophically, though maybe not legally, different from the loadable proprietary binary module debate. OpenZFS is free software. It is ironic that FreeBSD considers it free enough to include by default, though it is more restrictive than the BSD licence; while most Linux distros don't include it because of the GPL interaction worry, though it is less restrictive than the GPL.

Anyway, how does an enterprise distro like RHEL bring its filesystem into the 21st century? Maybe support bcachefs and risk the maintainer's human interaction issues?

RHEL's default is XFS?

Posted Oct 23, 2025 15:05 UTC (Thu) by bobolopolis (subscriber, #119051) [Link] (1 responses)

Red Hat's answer to this is Stratis, a management layer on top of XFS: https://stratis-storage.github.io/

No idea how well it works, I haven't had time to really play with it. We're mostly using btrfs and have been happy with it for years.

RHEL's default is XFS?

Posted Oct 23, 2025 22:02 UTC (Thu) by jhoblitt (subscriber, #77733) [Link]

I think you could make the argument that the RHEL long term replacement for btrfs is actually bootc. In the "enterprise" market, the strongest use case for btrfs is OS updates / rollbacks and bootc promises a more reliable fleet management model.

RHEL's default is XFS?

Posted Oct 23, 2025 17:49 UTC (Thu) by raven667 (subscriber, #5198) [Link]

Hopefully I don't open up a huge contentious debate but I think there are two things which affect this situation:
1) Canonical is based in a different jurisdiction than Redhat so their legal analysis might be different
2) Canonical is still personally run by the founder while Redhat is run more impersonally, and their organizational tolerance for risk might be substantially different.

RHEL's default is XFS?

Posted Oct 23, 2025 18:35 UTC (Thu) by koverstreet (✭ supporter ✭, #4296) [Link]

> Maybe support bcachefs and risk the maintainer's human interaction issues?

Things have gotten a lot calmer since parting ways from the kernel :)

I've found interacting with the distros directly to be drastically less contentious...

RHEL's default is XFS?

Posted Oct 23, 2025 18:37 UTC (Thu) by tuna (guest, #44480) [Link] (21 responses)

"Loading the kernel module is "mere aggregation". A decade after Ubuntu laid the legal argument out, it's time it was accepted. "

It is accepted until Oracle's lawyers change their mind and sue IBM and all their customers.

RHEL's default is XFS?

Posted Oct 24, 2025 9:48 UTC (Fri) by paulj (subscriber, #341) [Link] (7 responses)

How exactly? When the CDDL is perfectly OK with code covered under it being combined with code of any other licence... (The CDDL by design is far less expansive in what it lays claim to than the GPL).

RHEL's default is XFS?

Posted Oct 24, 2025 11:45 UTC (Fri) by khim (subscriber, #9252) [Link] (6 responses)

Oracle has code in kernel, too and it may, in a very persuading terms claim that if it wanted these two projects to be used together then it would have released them on compatible terms.

It haven't don't so —because it obviously expected that people who wanted ZFS would either buy Solaris or use *BSD (which helps people to deal with non-Linux OSes).

I have no idea how plausibly that approach would look in court and I don't want to try to find out.

Maybe with some other company I would have risked that, but with Oracle… no.

RHEL's default is XFS?

Posted Oct 24, 2025 12:50 UTC (Fri) by paulj (subscriber, #341) [Link] (5 responses)

This is the only avenue for someone to sue over a Linux distro vendor including ZFS: a *GPL* copyright holder would have to take action alleging *GPL infringement*. I.e., this isn't a concern about Oracle particularly, but _any_ kernel copyright holder - who is not distributing ZFS for Linux themselves already.

Note carefully: The Linux kernel copyright holders could collectively fix this by making it clear they are fine with Linux being combined with ZFS. They havn't done so (to echo your words about Oracle). Admittedly, it would be a lot easier for Oracle to grant a GPL licence for ZFS, than getting all the Linux copyright holders to come together...

AFAICT Oracle have never distributed ZFS for Oracle Linux, however it is possible to install ZFS on Oracle Linux from third party sources. Though, even if they did, the issue is not that Oracle alone could sue but /any Linux copyright holder/.

RHEL's default is XFS?

Posted Oct 24, 2025 13:47 UTC (Fri) by khim (subscriber, #9252) [Link] (4 responses)

You are forgetting one important thing: Oracle is a copyright holder of upstream Linux, too.

And because Oracle is copyright owner for both Linux and ZFS it has a pretty high chance of arguing that it intented to keep ZFS out of Linux: after all the only thing it needs to make it available under GPL terms is one press-release.

That's why getting all the Linux copyright holders to come together is not needed: Oracle is in that group and it can make ZFS available for Linux pretty trivially, why try anything else, if Oracle agreement is needed anyway?

RHEL's default is XFS?

Posted Oct 24, 2025 14:26 UTC (Fri) by rsidd (subscriber, #2582) [Link]

That was certainly Oracle's intention. Note also that Oracle has closed-sourced ZFS many years ago, so the OpenZFS that is in FreeBSD is not the ZFS that is developed by Oracle, but is forked from the last CDDL version. So Oracle does not intend for ZFS to be available under open source terms, period.

So, in terms of "intent", the question is not what Oracle wants today, but what the CDDL permits free software users to do with OpenZFS which is a continuation from the last free-software version of ZFS.

FreeBSD has decided, years ago, that they can include OpenZFS in their OS. Ubuntu has decided, years ago, that they can do the same as a loadable kernel module. I'm not sure Oracle's actions permit them to selectively claim the Linux version is disallowed based on "intent" when their intent has been exhibited to far exceed this particular interdiction.

RHEL's default is XFS?

Posted Oct 24, 2025 14:45 UTC (Fri) by paulj (subscriber, #341) [Link]

Uhm, I wrote:

> this isn't a concern about Oracle particularly, but _any_ kernel copyright holder -

The "Not just X, but any Y" construct naturally implies that X is a Y. That Oracle is a Linux copyright holder, and that it is Linux copyright holders from whom there is any legal peril, is the entire thrust of my comment. ;)

RHEL's default is XFS?

Posted Oct 24, 2025 15:19 UTC (Fri) by koverstreet (✭ supporter ✭, #4296) [Link]

> it has a pretty high chance of arguing that it intented to keep ZFS out of Linux: after all the only thing it needs to make it available under GPL terms is one press-release.

I think for that argument to stick they'd need to actually make some sort of statement. Given that they employee a bunch of people who work on the kernel, there's no way they could plausibly say after the fact "oops, we didn't want that!" - they could very easily make themselves heard if they wanted to.

RHEL's default is XFS?

Posted Oct 24, 2025 18:09 UTC (Fri) by Cyberax (✭ supporter ✭, #52523) [Link]

> And because Oracle is copyright owner for both Linux and ZFS it has a pretty high chance of arguing that it intented to keep ZFS out of Linux: after all the only thing it needs to make it available under GPL terms is one press-release.

The next month, in a lawsuit filed by RedHat: "Your Honor, the defendant admits that the ZFS module that they include in their Unbreakable Linux can not be treated under the 'mere aggregation' clause of GPL. Please see the copies of the court documents filed by Oracle".

RHEL's default is XFS?

Posted Oct 24, 2025 10:07 UTC (Fri) by anselm (subscriber, #2796) [Link] (12 responses)

It is accepted until Oracle's lawyers change their mind and sue IBM and all their customers.

Because that was such an unqualified success when “The SCO Group” did it (over JFS, among other things) …

RHEL's default is XFS?

Posted Oct 24, 2025 11:47 UTC (Fri) by khim (subscriber, #9252) [Link] (1 responses)

In case of The SCO Group JFS was third-party code with no obvious ancestry toward anything copyright “The SCO Group”.

Here we are, literally, talking about two products from the exact same, very litigous, company.

RHEL's default is XFS?

Posted Oct 24, 2025 12:25 UTC (Fri) by anselm (subscriber, #2796) [Link]

IIRC, The SCO Group's contention vis-à-vis JFS was (in a nutshell) that JFS was used in AIX, which was a derivative of Unix, to which The SCO Group claimed to hold the copyright. Hence, they said, IBM should not have been allowed to contribute JFS to Linux under the GPL (certainly not without seeking TSG's permission). As it turned out, the JFS implementation in Linux is derived from IBM's JFS implementation for OS/2, which is independent of the one used in AIX, but that was just one of the problems with TSG's legal omnishambles.

Oracle's claim to ownership of ZFS is a lot more clear-cut, but – legitimate differences of opinion with respect to its license vs. the GPL notwithstanding – in my non-professional opinion, the fact that Oracle has let Canonical include ZFS with Ubuntu for a decade or so without intervening isn't going to increase the likelihood of their prevailing in a court of law if they ever do decide to take the plunge after all. Also there is always the risk of losing, which would presumably encourage every other Linux distributor to reconsider including ZFS with their offerings, too (right now the uncertainty seems to put most people off the idea). Therefore it seems unlikely to me that Oracle wants to embark on this type of expensive and long-running PR nightmare with a very uncertain outcome anytime soon.

RHEL's default is XFS?

Posted Oct 24, 2025 18:15 UTC (Fri) by tuna (guest, #44480) [Link] (9 responses)

How much do you think that law suit cost IBM? Even better than winning is not getting sued in the first place.

RHEL's default is XFS?

Posted Oct 24, 2025 22:56 UTC (Fri) by anselm (subscriber, #2796) [Link] (8 responses)

How much do you think that law suit cost IBM?

Not as much as it cost The SCO Group. Hint: IBM is still around but The SCO Group isn't.

Even better than winning is not getting sued in the first place.

Sure, but anyone can sue anyone else about anything, so sometimes you can't help it. IBM, after all, has pretty deep pockets and as such presents a juicy target for nuisance-type lawsuits. OTOH this means they can afford good lawyers when they need them, so that's something of a two-edged sword. One popular hypothesis is that The SCO Group sued IBM hoping that IBM would just buy the company outright in order to make the lawsuit go away with the least fuss, but as we know that's not how it turned out in the end.

RHEL's default is XFS?

Posted Oct 27, 2025 19:54 UTC (Mon) by tuna (guest, #44480) [Link] (7 responses)

"Sure, but anyone can sue anyone else about anything, so sometimes you can't help it." You can do your best to avoid it, especially if you are potentially dealing with Oracle.

RHEL's default is XFS?

Posted Oct 27, 2025 20:15 UTC (Mon) by pizza (subscriber, #46) [Link]

> You can do your best to avoid it, especially if you are potentially dealing with Oracle.

It's been said that Oracle is a legal department with a database; this was famously captured by Manu Cornet's unofficial org chart:

https://bonkersworld.net/organizational-charts

RHEL's default is XFS?

Posted Oct 28, 2025 0:46 UTC (Tue) by anselm (subscriber, #2796) [Link] (5 responses)

You can do your best to avoid it, especially if you are potentially dealing with Oracle.

Red Hat does it by not distributing ZFS. (There are probably other reasons for that, too, and I wouldn't presume to speak to Red Hat's motivations here.) Which is not to say that if Oracle was desperate to sue Red Hat/IBM they might not find something else to sue about instead, but I think it's unlikely.

At this point Oracle would probably find it difficult to (successfully) sue Canonical for distributing ZFS with the Ubuntu kernel. They would have to claim standing as copyright holders in the Linux kernel, not ZFS, in the first place, and it would be a challenge to explain to the court why they sat back and did nothing at all for a decade or so while Canonical was being quite up-front about what they were doing with ZFS during all that time.

RHEL's default is XFS?

Posted Oct 28, 2025 10:17 UTC (Tue) by Wol (subscriber, #4433) [Link] (4 responses)

And as a UK based company (I believe Canonical is), it's a lot harder to launch a nuisance lawsuit here.

Not impossible, but it's a lot more expensive (you can easily find yourself paying your victim's legal costs - well most of them), and the English legal system is much much easier to short-circuit, as in "please can we have a ruling on the evidence so far, we want a summary dismissal". There's not all this gathering evidence up front for the entire trial. They tend to work their way down the claim-sheet collecting evidence and ruling on each claim in turn, so if you can get the initial claim dismissed, the trial would typically collapse there and then.

And while I gather it's almost never happened, the defendant has the option of filing to have a nuisance plaintiff declared a "vexatious litigant". Which pretty much bars them from the legal system. They need the permission of a Judge before they're even allowed to file a suit, which means they have to prove they have a reasonable case, on their own dime, before their target even officially gets told of the suit ...

Cheers,
Wol

RHEL's default is XFS?

Posted Oct 28, 2025 13:37 UTC (Tue) by draco (subscriber, #1792) [Link] (3 responses)

It's possible to file for a summary judgement in the US to dismiss civil claims as well. It's a little different in that if the facts are at all contentious, the judge will deny the motion in favor of the jury making that call, but if the claim has no chance to proceed with the evidence at hand, the judge can dismiss it. From what I've seen of lawsuit coverage, motions for summary judgement are routine. There have also been some cases where one side thought they'd avoid penalties by failing to comply with discovery orders, and after being given ample opportunity to obey, those claims were simply found against them. So lawsuits collapse from summary judgements in the US too.

Further, it's my impression that it's simply ritual that the defense attorney in US criminal trials will move to dismiss the trial for lack of evidence. I gather that rarely succeeds, but it's allowed to if the facts are right.

But the fact that a jury generally must be empaneled to decide points of fact does make it unlikely for a trial with multiple claims to be split into multiple smaller trials like it sounds like you can do in the UK. I don't think it's disallowed in the US (I've seen judges suddenly start trial proceedings in sanctions or show cause order proceedings when a jury isn't required, so it seems the rules of procedure are flexible enough) but I've never seen a jury trial split that way.

Also, it's possible to bar nuisance litigants from filing claims in US courts without permission from the judge. I think it happened to the Prenda Law lawyers (in addition to eventually disbarring them).

RHEL's default is XFS?

Posted Oct 28, 2025 15:31 UTC (Tue) by paulj (subscriber, #341) [Link] (2 responses)

IANAL, and don't have much experience... but England and Wales (note: you can not say "UK" wrt law - Scotland has a distinct legal system; the republic of Ireland's legal system is closer to England's than Scotland's) have codified a number of "pre-action protocols", which aims to strongly steer claimants and defendants to settling out of court by negotiation or some form of "alternative dispute resolution" (e.g. mediation or arbitration); and to try ensure that anything that gets to court is well-founded. Failing to follow the protocols can have adverse consequences, particularly for decisions on costs (in a system which already defaults to "loser pays all costs").

https://www.justice.gov.uk/courts/procedure-rules/civil/p...

I guess US systems have something similar?

RHEL's default is XFS?

Posted Oct 28, 2025 16:04 UTC (Tue) by draco (subscriber, #1792) [Link] (1 responses)

IANAL either, but I've read case transcripts and followed various cases & listened to lawyers talk about them.

You can't really talk about a single US law system either, since there's a federal system and 50 different state systems (plus slightly different rules for criminal and civil). But there's a lot of similarity between them regardless.

I don't know how to answer your other question. I know parties are always encouraged to settle or find resolution via mediation, but as far as I know, that's largely driven by court costs, legal fees, court schedules, and fear of the jury more than any formal rules. That said, there's a lot of steps before the trial starts, and I think there are quite a few legal standards and precedents that may serve a similar function. After all, all court systems need to contend with high demand for their services. People are people, after all!

RHEL's default is XFS?

Posted Oct 29, 2025 8:51 UTC (Wed) by taladar (subscriber, #68407) [Link]

Settling out of court also seems to be a common way to avoid creating precedent that might be a bigger problem than the individual case to the party that decides to settle.

RHEL's default is XFS?

Posted Oct 23, 2025 19:11 UTC (Thu) by IanKelling (subscriber, #89418) [Link] (2 responses)

> Yes, I know the legal status debate

If you know it, you have not made an accurate or a good summary of it here.

> I find Ubuntu

Other people do not agree with you or Ubuntu.

RHEL's default is XFS?

Posted Oct 31, 2025 6:34 UTC (Fri) by linuxrocks123 (subscriber, #34648) [Link] (1 responses)

> If you know it, you have not made an accurate or a good summary of it here.

Yes, he did.

> Other people do not agree with you or Ubuntu.

Those people are wrong, which is why you were unable to say anything substantive about the reasons for disagreement. ZFS on Linux is no more of a problem than proprietary NVidia drivers on Linux, which are clearly fine, so Red Hat could obviously do DKMS instead of pre-built if they were skittish about distributing the .ko files directly.

They're not doing that because they're not skittish; they're paranoid.

I don't have a dog in this fight. I use Slackware and ext4 with the journaling disabled, libeatmydata in ld.so.preload, and these sysctl.conf settings:

vm.dirty_ratio = 90
vm.dirty_background_ratio = 50
vm.dirty_expire_centisecs = 360000
vm.dirty_writeback_centisecs = 60000

My filesystem is screaming fast.

RHEL's default is XFS?

Posted Oct 31, 2025 10:40 UTC (Fri) by taladar (subscriber, #68407) [Link]

You fail to take into account that proprietary Nnvidia drivers have no long-term state, so it is easy to later change to e.g. an open source driver while filesystems are about as close to having all the state on a system as any component. As a distro you would essentially have to ask all your users to reinstall from scratch, likely killing your distro in the process, if you were forced to switch away from a choice of filesystem that is no longer viable for e.g. legal reasons.

RHEL's default is XFS?

Posted Oct 24, 2025 7:21 UTC (Fri) by taladar (subscriber, #68407) [Link]

With the possible exception of ZFS none of these filesystems have been stable enough long enough for anyone to be comfortable supporting the current version (at the time of consideration) in a distro with 10 years (plus potentially longer for some extra extended support models).

RHEL's default is XFS?

Posted Oct 24, 2025 10:12 UTC (Fri) by nim-nim (subscriber, #34454) [Link]

Mostly, Red Hat has found that its funding of XFS maintenance, was more relevant to its market than its funding of BTRFS development. And it’s hard to disagree, given the dismal BTRFS track record on raid for example.

Red Hat customers really care about data loss (that includes software raid when economics dictate deployment on cheap nodes without hardware raid) and care mildly about new features such as COW and snapshots (that require expensive specialists to make use of). Data loss on plain old basic filesystems is not sexy but in the Enterprise space that saves you a lot of embarrassing and *expensive* incidents (a post-mortem with review of god knows how many historical mistakes and piles of technical debt is not cheap).

RHEL's default is XFS?

Posted Oct 28, 2025 13:33 UTC (Tue) by claudex (subscriber, #92510) [Link] (10 responses)

>And it supports a bunch of things XFS doesn't; snapshots in particular are a lifesaver.

You can snapshot, compress and deduplicate with LVM.

RHEL's default is XFS?

Posted Oct 29, 2025 8:52 UTC (Wed) by taladar (subscriber, #68407) [Link] (9 responses)

And arguably snapshots in particular do not need to be part of the filesystem itself because unlike the other features you mentioned you rarely want a snapshot of a part of your filesystem but instead want one of the whole filesystem.

RHEL's default is XFS?

Posted Oct 29, 2025 18:20 UTC (Wed) by mbunkus (subscriber, #87248) [Link] (8 responses)

I regularly make use of btrfs subvolumes & snapshot those volumes at different intervals (e.g. I auto-snapshot my /home subvolume every 15min & keep those around for 24h, whereas I only snapshot other subvolumes once per day). This kind of flexibility is worth a lot to me. Furthermore I do not need to plan in advance how much space to reserve for snapshots.

RHEL's default is XFS?

Posted Oct 30, 2025 8:57 UTC (Thu) by claudex (subscriber, #92510) [Link] (7 responses)

>Furthermore I do not need to plan in advance how much space to reserve for snapshots.

You don't need to with LVM thin

LVM thin & snapshots & edge cases

Posted Oct 30, 2025 9:09 UTC (Thu) by mbunkus (subscriber, #87248) [Link] (6 responses)

I haven't used LVM _thin_ much myself yet. How does this work in practice? Let's say I have a 4 TB drive that I'd like to use for my non-snapshot capaable file system (XFS, ext4, whatever) but also use snapshots. Is this how it'd go?

1. Create partition table (not necessarily needed if it's a second disk, I'm aware) with one partition spanning the whole drive, type LVM
2. Create VG with that partition
3. Create _thin_ LV with 100%FREE extents = 4 TB size ??
4. Create file system on LV
5. Create LVM snapshot whenever I need one

How does this setup handle the underlying storage (the VG) getting full due to snapshots occupying at least some part of the VG? With snapshot-capable file systems the file system itself is aware of all allocated space & can just calmly reject further allocations with ENOSPACE. But how does ext4 or XFS cope with the underlying storage suddenly being full even though the device (the LV in this case) is supposed to be 4 TB large?

LVM thin & snapshots & edge cases

Posted Oct 31, 2025 18:58 UTC (Fri) by raven667 (subscriber, #5198) [Link] (5 responses)

I'm not an expert and not using thin LVs with snapshots right now but I would think that in _either_ case (XFS or btrfs) you'd want to estimate how much space the snapshots are likely to take and factor that into your allocations, don't make the entire 4TB VG into one thin LV, but make a 3TB thin LV (or 3.5TB or whatever) and track the usage of the VG to ensure the snapshots don't run it out of space. You should have a lot of space because the LV is thin, but by setting a max size you create a kind of quota that should prevent ENOSPACE, which is probably fatal to your application regardless of the filesystem you are using. btrfs dosen't make more space happen, so if you want some amount of snapshots even if the filesystem is near full then you need to plan your snapshot rotation scripts appropriately and don't let the main filesystem allocate space such that you have no space for snapshots.

LVM thin & snapshots & edge cases

Posted Oct 31, 2025 19:10 UTC (Fri) by mbunkus (subscriber, #87248) [Link] (4 responses)

The big difference is that the normal syscalls for determining free space work correctly on btrfs no matter how many snapshots there are & how large they are, as in: they report how much space applications can really still allocate. `df` works & shows correct values.

With a file system on LVM thin+LVM snapshots an application cannot rely on `df` & the corresponding syscalls anymore, as the file system doesn't know about how much space the VG actually still has.

Furthermore I'd be interested in how a file systems without snapshot support would react to the kernel reporting ENOSPACE while writing to a block device that the file system thinks should have free space left. Is this a kernel panic? Is this handled gracefully?

With file systems that support internal snapshots such as btrfs but also zfs (and I bet bcachefs) you really just allocate the whole VG to btrfs & let btrfs deal with how much space there is.

> you'd want to estimate how much space the snapshots are likely to take and factor that into your allocations

That's what I thought, too, but what claudex claimed was _not_ needed with LVM thin+LVM snapshots.

LVM thin & snapshots & edge cases

Posted Oct 31, 2025 19:29 UTC (Fri) by raven667 (subscriber, #5198) [Link] (3 responses)

> With a file system on LVM thin+LVM snapshots an application cannot rely on `df` & the corresponding syscalls anymore, as the file system doesn't know about how much space the VG actually still has.

Right, you have to look at the free space in the Volume Group and manage that, which is a different command (`vgscan` or `vgdisplay` IIRC), but that's just a small technical difference, it doesn't make the space usage *unmanageable*

> but what claudex claimed was _not_ needed with LVM thin+LVM snapshots.

That seems risky, but what do I know? I think in most common cases where you aren't bumping up against the limits this would work fine, but as soon as you start really filling the filesystem, or have very large snapshots, you are going to run into conflicts and surprise ENOSPACE is no fun at all. Even in the best case, regardless of the reliability of the underlying filesystem, something is going to break in my experience. Neither thin provisioning nor btrfs/zfs make more space than exists, so the free space has to be managed one way or another regardless of which flavor you choose, layering lvm/filesystem or integrated filesystem with volume management.

I haven't used Stratis from Redhat either but as I understand it that puts some automation and tools around the stack to make this kind of management straightforward and reliable.

LVM thin & snapshots & edge cases

Posted Nov 1, 2025 0:38 UTC (Sat) by intelfx (subscriber, #130118) [Link] (2 responses)

> Right, you have to look at the free space in the Volume Group and manage that, which is a different command (`vgscan` or `vgdisplay` IIRC), but that's just a small technical difference, it doesn't make the space usage *unmanageable*

It does make free space unmanageable by normal means.

It's not a "small technical difference", it breaks the tool *everyone* knows to use, as well as the the API the tool relies on. Now if you need to retrieve the free space programmatically, it's suddenly not enough to call `df -P` or `lsblk -f` or `findmnt` do a stat() on the mountpoint — now you have to maintain a bespoke code path and resolve numerous levels of indirection yourself (find the filesystem corresponding to the mountpoint, find the LV corresponding to the filesystem, find the VG...).

This *is* a big deal for programmability and maintainability of the resulting system, and for mental load of anyone who comes into contact with this system.

LVM thin & snapshots & edge cases

Posted Nov 1, 2025 11:58 UTC (Sat) by cesarb (subscriber, #6266) [Link] (1 responses)

> now you have to maintain a bespoke code path and resolve numerous levels of indirection yourself (find the filesystem corresponding to the mountpoint, find the LV corresponding to the filesystem, find the VG...)

Can you do all that as non-root (honest question, I don't know)? At work, I've written code which detects when disk space is running low, and dynamically limits the size of an on-disk cache to leave at least 5% of free space in the disk (that cache also has a configurable maximum size, detecting the available disk space is an extra layer of defense in case something else is filling the disk); that code runs as a normal user, or sometimes within a container.

(Also, containers are an issue, they obviously don't have access to do all that; the traditional disk space API works fine in them.)

LVM thin & snapshots & edge cases

Posted Nov 1, 2025 17:59 UTC (Sat) by raven667 (subscriber, #5198) [Link]

> Can you do all that as non-root

No, managing LVM is a root-only activity, but I think we are talking about very different use cases and audiences here (also responding to intelfx), I'm talking about professional sysadmins running fleets of servers, or manufacturers writing firmware for products who use LVM and snapshots (or btrfs and snapshots) as part of their system management, not enthusiasts with their own highly bespoke setup or j-random-application managing its own storage needs but not managing the whole system.

I haven't used LVM snapshots, but I've been using LVM since it was available in Linux (and briefly EVMS from IBM before that, anyone remember that one?) and I've used VMware VMFS with thin provisioned VMs and snapshots, which I imagine has the same overall problems and constraints and so the experience would be relevant, ill-advised (or forgotten) use of snapshots can get you into trouble in VMware as well, changing the IO access pattern of the VM and filling up a tight volume unintentionally, and use of thin provisioning doesn't mean you can oversubscribe the storage forever without running into eventual consequences, it just gives you extra breathing room in the common case where not all storage is used.

I think of thin provisioning like a quota, it allows you to oversubscribe your storage but puts a quota on each individual usage of the storage, if all the users of the storage tried to use their max quota at the same time you'd be in trouble (because over-subscription) but no single (or small number) of users hitting their quota will break the storage for anyone else.


Copyright © 2025, Eklektix, Inc.
Comments and public postings are copyrighted by their creators.
Linux is a registered trademark of Linus Torvalds