GNOME's new versioning scheme
GNOME's new versioning scheme
Posted Sep 17, 2020 21:57 UTC (Thu) by nix (subscriber, #2304)Parent article: GNOME's new versioning scheme
I know other software has done the exact same thing (Emacs being the major one I can think of), and "the minor version number is too big" is almost the only rationale ever used for bumping the kernel's major version number... but that rationale still makes no sense at all to me. Of course version numbers are totally arbitrary as long as they always go up, and it's not like we're going to run out of integers, but, still, this feels to me like wheel-spinning, change for change's sake.
(Libraries in the platform have still not finished renumbering themselves to 3.x -- another few renumber every new GNOME release -- so it's a good thing all the libraries don't need to renumber again. On past form it'd be 2035 before they were all finished.)
Posted Sep 17, 2020 22:28 UTC (Thu)
by ebassi (subscriber, #54855)
[Link] (19 responses)
The problem is not the number in and of itself, but the fact that it's following another number, and that creates expectations. If you see "3.large-number", you'll be tempted to ask "when are we going to move to 4.0?", especially since the 1.x series stopped at 4, and the 2.x series stopped at 32.
The whole point of dropping the current major version is to say: we are not going to do major versions any more. The core toolkit can bump up its API version without causing a massive change in the platform, such that we have to stop and port everything; and the UX can change iteratively as well.
Posted Sep 18, 2020 9:00 UTC (Fri)
by geert (subscriber, #98403)
[Link] (1 responses)
Which is exactly the opposite of what the phone vendors are doing wr.t. Linux: don't move to the next major version, move to the next minor (LTS) version instead, perpetually.
Posted Sep 22, 2020 22:55 UTC (Tue)
by khim (subscriber, #9252)
[Link]
When they *do* want to sell you something... S20 follows S10 because S11 would be too small of an update.
So Linus did that right: by bumping kernel version occasionally (even if arbitrarily) it makes these numbers interesting for Joe Average. Who can count to ten, sometimes, but it's "number too large to care" after that.
Posted Sep 18, 2020 13:25 UTC (Fri)
by nix (subscriber, #2304)
[Link] (16 responses)
I guess the only possibility there would be renaming the project as a whole :( I suppose if any change you can envision is so large that it would be tantamount to a whole new project, this might still be the right thing to do.
(I certainly did expect that the ports of packages to Gtk 4 would be such a step change, particularly given that it seems likely to need to happen to all libraries in the framework simultaneously as long as they might get loaded into the same process, but apparently not? I suppose, if anyone knows if that's true it would be you, so nobody *other* than you can safely make this determination :) )
Posted Sep 18, 2020 15:30 UTC (Fri)
by ebassi (subscriber, #54855)
[Link] (15 responses)
We'll burn that bridge when we cross it.
Though, again, the only thing that would warrant a major release is a complete overhaul of our HIG to use holograms and telepathic input, dropping any other input and output method. Short of that, an incremental approach will always be preferred.
> I certainly did expect that the ports of packages to Gtk 4 would be such a step change
Releasing GTK4 will require API bumps in other libraries, indeed; but we do have strong parallel installability guarantees for a reason, and we can phase out the GTK3 reverse dependencies in time. GTK3 is still supported, and so will be the libraries that depend on it; once all the libraries used by an application have been updated to support GTK4, porting your application should not require a major step.
Even if GTK4 is a fair amount of rework of the internals of the API, though, it's not like GTK4 widgets have suddenly become entirely different from GTK3 in appearance and behaviour; a GTK4 application side by side with a GTK3 one will look and behave in a fairly similar fashion; and once GTK4 is out, everything will be frozen, so at most we expect visual refreshes (and maybe some new widget), like we do for GTK3.
The reason why GTK2 and GTK3 were a fair amount of work such that they required bumping the whole UX of GNOME was that both deprecated large swaths of the application development platform, or introduced new API at the bottom of the stack—below GTK itself. We've consolidated various functionality inside GTK4, and these days you only have libraries that provide you with additional, ad hoc widgets—like libhandy, for supporting multiple form factors; or GtkSourceView, for code editing; or WebKitGTK, for embedding web content. Once those libraries get ported (and they are in the process of being ported), most GNOME applications will be able to move to GTK4 on their schedule, instead of a mad rush to get everything sorted in 6 months.
Posted Sep 18, 2020 19:48 UTC (Fri)
by nix (subscriber, #2304)
[Link] (14 responses)
This sort of thing caused a number of problems for distros in the Gtk 2 transition period and is probably one reason why packagers and distributors groaned at the new plan of breaking the Gtk ABI more frequently. ABI breakage hurts. I think glibc and the X libraries have the right of it here: widely-used libraries should never, ever break ABI at all, for any reason. Yes, this makes library design really hard: blame ELF :(
(You probably know all this already and have planned for it, though it's a hell of a lot of work and honestly I'm not sure how you can make it less than horrendously painful for everyone: I'm just posting this in case you overlooked this particular pile of festering nightmares and the degree to which it hurts all your direct and indirect library users. It's amazing how many major projects overlook it: GhostScript is one, which forked libcms into a multithread-capable version for internal gs use without changing any of the symbol names, so now any libcms users which also include libgs are likely to dump core. The only solution to that is to not use the gs fork of libcms, which is explicitly unsupported and planned to go away. I guess that means libgs users that want to do colour management are all screwed when that happens. Sigh.)
Posted Sep 19, 2020 1:15 UTC (Sat)
by mathstuf (subscriber, #69389)
[Link] (6 responses)
And yes, embedding libraries is a real pain. We do it because we have Windows and macOS deployments and who is going to have a viable HDF5 SDK just laying around there? No one, that's who. But I make sure that every library name, header file, and exported symbol is mangled to avoid conflicts. Sometimes static globals still bite us, but those errors usually have the symbol name in them so we can go and fix it. We don't mangle data types because no one should be including our mangled library and a real one in the same TU anyways. Alas, Python module paths/names are also nigh impossible to mangle in practice, so we do end up colliding there, but AFAIK, there's nothing we can do about that.
Posted Sep 19, 2020 11:40 UTC (Sat)
by nix (subscriber, #2304)
[Link] (5 responses)
Posted Sep 19, 2020 18:46 UTC (Sat)
by mathstuf (subscriber, #69389)
[Link] (4 responses)
- -Bsymbolic: don't look for symbols we know are in our own library anywhere else
Posted Sep 19, 2020 19:24 UTC (Sat)
by nix (subscriber, #2304)
[Link] (3 responses)
DF_GROUP (as usual I got this one wrong, it's a flag, not a tag) constrains symbol searches from within this library to happen only within the library and its transitive DT_NEEDED libraries: it stops global symbols or symbols in other branches of the search tree from interposing. The relevant ld flag to look for is '-Bgroup'. It is *not* the same as --start-group/--end-group or the linker script GROUP command: fairly confusing naming really. Weak symbols still work, but only if they're resolved by objects loaded by this shared library or things it loaded. (So the old pthreads trick wouldn't work, not that it's a good idea anyway in glibc 2.32+.)
Posted Sep 22, 2020 16:33 UTC (Tue)
by mathstuf (subscriber, #69389)
[Link] (2 responses)
I have a PR (that's likely fallen on deaf ears) for macOS' linker to have a "any symbol you find in this library should be looked up at runtime" behavior which is, I think, exactly the kind of behavior I'd like. https://github.com/apple-opensource/ld64/pull/1
For reference, the search term to use for the ELF flag is `DF_1_GROUP`.
Posted Sep 22, 2020 21:38 UTC (Tue)
by nix (subscriber, #2304)
[Link] (1 responses)
Posted Sep 22, 2020 21:54 UTC (Tue)
by mathstuf (subscriber, #69389)
[Link]
Posted Sep 19, 2020 3:04 UTC (Sat)
by pabs (subscriber, #43278)
[Link] (4 responses)
Posted Sep 19, 2020 11:32 UTC (Sat)
by smcv (subscriber, #53363)
[Link] (3 responses)
No, GTK doesn't have versioned symbols. Versioned symbols have two main uses: disambiguating between incompatible SONAMEs of the same library (which is the use you have in mind here), and keeping track of which version is required. In the GObject world, versioned symbols are not useful for the first of those uses, because the GObject type registry is a flat global namespace that is basically a hash table in GObject could in principle gain a concept of versioned type-names analogous to versioned symbols, and people have experimented with doing just that, but that would likely lead to an API and ABI break throughout the GLib-based stack, which conflicts with the fact that GLib/GObject is effectively following the glibc model for ABI compatibility (i.e. don't break ABI, ever). A SONAME bump in GObject would force every GObject-dependent library to also change its SONAME (or crash a lot, I suppose, but let's not go there). You might think moving from GTK 2 to 3 (and in future to 4) has already been a disruptive transition, but moving from GObject 2 to 3 would also involve non-GUI libraries, and lower-level-than-GTK GUI libraries like GDK-Pixbuf and Pango. That's a major reason why GLib/GObject didn't break ABI in GNOME 3. Versioned symbols can still be useful in GObject-based libraries whose namespace conventions collide with a non-GObject library (for example json-glib, json-c and jansson, which unfortunately all use
Posted Sep 19, 2020 11:44 UTC (Sat)
by nix (subscriber, #2304)
[Link] (2 responses)
I didn't sleep well last night so probably there is some really obvious reason why this wouldn't work which I just can't identify right now.
(... and now I'm wondering if CTF could help fix the type side of this. Alas, probably not, not unless we augment CTF with version info *and* ld.so starts using it somehow. Which is a possibility for the distant future, hmmm... another reason for me to come up with the do-less-mallocs version of libctf, since ld.so's early-operation malloc is so crude it's best to avoid doing complex patterns of temporary allocations in it.)
Posted Sep 21, 2020 14:02 UTC (Mon)
by smcv (subscriber, #53363)
[Link] (1 responses)
This is more or less how the experiments that were done in the past worked (I think they might have just hard-coded the name-mangling as a proof of concept, but that's an implementation detail).
> As long as version 1 had an unmangled name, it seems to me you could bring this in without disrupting existing users of (necessarily unmangled) GObject names
For *some* users, yes. The experiments I saw were on GTK 2/3 compatibility (back when GTK 2 was still maintained) so they assumed that significant changes to GTK 2 and GTK 3 source code wouldn't be allowed, and they also made the simplifying assumption that the versioned naming would have to apply globally, to all GObject libraries; but you're right to say that continuing to use the simple names for existing libraries, and only bringing in the versioned names on an opt-in basis for new SONAMEs, would be a migration strategy less likely to cause regressions.
It might already be too late for that in GTK 4, but perhaps it's viable for GTK 5, or for the next time Evolution breaks ABI.
For GObject users that have to be able to deal with unknown types generically, I could see the mangled names still causing breakage: for example if code generation tools like Vala assume that the type named "GtkWidget" is a "GtkWidget *" in C source code, that assumption will no longer hold. (But it already wasn't true for some particularly creative/evil/broken GObject libraries, like dbus-glib with its parameterized types.)
Posted Sep 21, 2020 14:30 UTC (Mon)
by nix (subscriber, #2304)
[Link]
Yeah, some things would definitely need adjusting to know that mangling was *possible*. (This was, of course, true when ELF gained symbol versioning, too: some things needed to know what the @ and @@ in symbol names meant. But most things didn't need to know at all.)
Posted Sep 19, 2020 13:00 UTC (Sat)
by ebassi (subscriber, #54855)
[Link] (1 responses)
Yes, we know. That's why you cannot load different versions of GTK in the same process; as soon as you do, you will hit an assertion failure, and since initialising GTK must be the first thing that you do, it'll happen pretty much instantaneously.
It's not our first rodeo.
Posted Sep 19, 2020 14:15 UTC (Sat)
by nix (subscriber, #2304)
[Link]
Posted Sep 17, 2020 23:43 UTC (Thu)
by flussence (guest, #85566)
[Link] (17 responses)
I guess it's easier to shed the masive stigma of "GNOME 3" by simply rendering it impossible to correlate public perception to versioning, than to address the root cause of that public perception.
Worked for Mozilla, which as we can see is a flourishing and healthy corporation with no problems whatsoever.
Posted Sep 18, 2020 3:40 UTC (Fri)
by rsidd (subscriber, #2582)
[Link] (15 responses)
Posted Sep 18, 2020 6:19 UTC (Fri)
by flussence (guest, #85566)
[Link] (8 responses)
Rust hasn't been under Mozilla's umbrella for a while (the project lead resigned not long after that whole Looking Glass thing) and they recently sacked a whole lot of important side-project Rust devs.
Posted Sep 18, 2020 10:21 UTC (Fri)
by rsidd (subscriber, #2582)
[Link]
Posted Sep 18, 2020 11:08 UTC (Fri)
by LtWorf (subscriber, #124958)
[Link]
Posted Sep 19, 2020 3:00 UTC (Sat)
by pabs (subscriber, #43278)
[Link] (3 responses)
Posted Sep 19, 2020 12:10 UTC (Sat)
by farnz (subscriber, #17727)
[Link] (2 responses)
The official Looking Glass retrospective is online - it was a tie-in with the "Mr Robot" TV show, and they used their experiments platform to install an add-on for all users:
Posted Sep 19, 2020 15:31 UTC (Sat)
by rsidd (subscriber, #2582)
[Link] (1 responses)
Posted Sep 19, 2020 20:58 UTC (Sat)
by Wol (subscriber, #4433)
[Link]
Hint - I DON'T PLAY GAMES !!! (or only one or two that is - AOE Age of Empires and Kpat). (And probably not AOE much longer as it's an XP install that is likely to break in the near future.)
Cheers,
Posted Sep 25, 2020 14:08 UTC (Fri)
by robbe (guest, #16131)
[Link] (1 responses)
Looks like this is fixed with FF 80.
For MS Teams, support for non-Chromium browsers seems to be low priority. Their focus clearly is on the (Electron) app, and Chromium support kind-of emerges for free out of that.
Posted Sep 25, 2020 14:59 UTC (Fri)
by mathstuf (subscriber, #69389)
[Link]
Posted Sep 18, 2020 12:06 UTC (Fri)
by Conan_Kudo (subscriber, #103240)
[Link] (5 responses)
This is absolutely not true. If anything, Mozilla is slowly dying. They just killed another pair of products today: Firefox Send and Firefox Notes.
They are hemorrhaging people, both voluntarily and involuntarily. Their share in the marketplace is dwindling rapidly. And they're unable to keep up with the development of web standards to the point that people are forced to use Google Chrome to visit websites and expect things to work.
That is not not the mark of a flourishing company. That is the mark of an increasingly irrelevant company. And as someone who values Firefox and work Mozilla does, that's deeply disheartening and depressing.
Posted Sep 18, 2020 13:01 UTC (Fri)
by rsidd (subscriber, #2582)
[Link]
Yes, their financial and other difficulties are a worry. But they have been around for a long time, they will survive.
Posted Sep 22, 2020 23:16 UTC (Tue)
by khim (subscriber, #9252)
[Link] (3 responses)
Yes, I know that Chrome still adds crap at breakneck pace... but when was something added that actually improved experience of the end user? I would say that was probably Webrtc. It made something which was impossible before... possible. That was almost 10 years ago.
Everything after that? Mostly a way to make marketing guys happy by adding useless bells and whistles which only suck bandwidth, CPU and Memory without providing anything meaningful in return.
Google is now the master of EEE strategy which, naturally, kills everything else. Just like it happened when Microsoft did that.
Posted Sep 23, 2020 9:02 UTC (Wed)
by nix (subscriber, #2304)
[Link] (2 responses)
Posted Sep 24, 2020 12:07 UTC (Thu)
by khim (subscriber, #9252)
[Link] (1 responses)
Oh, right, Mozilla and Google foolishly (well... foolishly on Mozilla side... Google knew what it did) killed it, so now we have no choice but to add everything including kitchen sink to the browser...
Not convinced, sorry.
Posted Sep 24, 2020 12:32 UTC (Thu)
by nix (subscriber, #2304)
[Link]
(And... well, yeah, it could be a plugin, but plugins are a security nightmare themselves and usually much harder to both keep working and audit than something that's part of the browser to start with: and the interface between the plugins and the browser would need revising before that would work in any case, and if you're doing that, why not just build in U2F support? In practice by the time U2F got going nobody wanted to write new plugins if they had any alternative...)
Posted Sep 18, 2020 7:58 UTC (Fri)
by ibukanov (subscriber, #3942)
[Link]
As a mozillian at that time I only wished that Mozilla has not blindly copied exact setup from Google. 6-week cycle and the exact arrangement of channels were nothing magic and reflected internal Google processes.
GNOME's new versioning scheme
GNOME's new versioning scheme
GNOME's new versioning scheme
GNOME's new versioning scheme
GNOME's new versioning scheme
GNOME's new versioning scheme
Releasing GTK4 will require API bumps in other libraries, indeed; but we do have strong parallel installability guarantees for a reason, and we can phase out the GTK3 reverse dependencies in time. GTK3 is still supported, and so will be the libraries that depend on it; once all the libraries used by an application have been updated to support GTK4, porting your application should not require a major step.
Oh dear. Unless you've changed every public symbol name in Gtk 4, this will fail: the moment one library is ported to use Gtk 4, even if it bumps soname and gains parallel installability at the same time, any process that depends directly or transitively on both that library and Gtk 3 will suffer symbol name clashes between the two Gtks, a pile of unintended interposition, and likely disaster (so this also happens if you port any application to Gtk 4, if any of its libs still uses Gtk 3, and vice versa). You can hack around this to some degree using -Bsymbolic and DT_GROUP, but this is a) ELF-specific and b) won't help with data structures passed between the incompatible Gtks: so you probably have to change the names of all datatypes in the public API as well. Worse yet, this also applies to non-GNOME users of Gtk, so you can never be sure this won't trip you up.
GNOME's new versioning scheme
GNOME's new versioning scheme
GNOME's new versioning scheme
So this doesn't seem like it would help with other code using my symbols from getting confused. Do you have documentation links for DT_GROUP? My manpages have nothing about it. From your descriptions, it sounds like it restricts symbol lookups to those found via DT_NEEDED for the library itself? So basically, a better `RTLD_LOCAL`. How does this interact with weak symbols (like, say, Anaconda where libpython.so symbols are meant to be provided by the loading executable)?
GNOME's new versioning scheme
GNOME's new versioning scheme
GNOME's new versioning scheme
GNOME's new versioning scheme
GNOME's new versioning scheme
GNOME's new versioning scheme
libgobject-2.0.so.0
, a library that hasn't broken ABI for something like 20 years. So you'd still have the same collisions with versioned symbols, but instead of being over which version of gtk_widget_activate()
is the right one to find in ELF symbol lookup, they'd be over which version of g_type_from_name("GtkWidget")
is the right one to find in GObject type lookup.json_*
), and they can still be useful to track when symbols where introduced (for example in telepathy-glib), but neither of those is immediately relevant here.GNOME's new versioning scheme
GObject could in principle gain a concept of versioned type-names analogous to versioned symbols
I'm wondering if you could do that by adding a g_mangle_name() with which you could say g_mangle_name("GtkWidget", 2, 0) and get back GtkWidget@2 (the 0 is a minor number): equally you could unmangle it to find that the version of GtkWidget@2 was 2, etc. As long as version 1 had an unmangled name, it seems to me you could bring this in without disrupting existing users of (necessarily unmangled) GObject names at all, and *certainly* without the horror show which would be breaking glib's ABI.
GNOME's new versioning scheme
GNOME's new versioning scheme
GNOME's new versioning scheme
GNOME's new versioning scheme
GNOME's new versioning scheme
GNOME's new versioning scheme
> Worked for Mozilla, which as we can see is a flourishing and healthy corporation with no problems whatsoever.
Sounds like you're being sarcastic, but in fact Mozilla is providing us
And Mozilla is surviving, I would say flourishing among people who matter.
GNOME's new versioning scheme
Might be the same reason Jitsi Meet doesn't work on Firefox?
GNOME's new versioning scheme
GNOME's new versioning scheme
GNOME's new versioning scheme
GNOME's new versioning scheme
Instead of giving users the choice to install this add-on, we initially pushed an update to Firefox that installed the “Looking Glass” add-on for English speaking users. This add-on was installed and set to ‘OFF’ and made no changes in the user experience unless it was explicitly turned on by a user, but it was added. Even when turned on no user data was collected or shared
GNOME's new versioning scheme
GNOME's new versioning scheme
Wol
Firefox, Teams, Jitsi Meet
Firefox, Teams, Jitsi Meet
GNOME's new versioning scheme
And Mozilla is surviving, I would say flourishing among people who matter.
GNOME's new versioning scheme
GNOME's new versioning scheme
GNOME's new versioning scheme
GNOME's new versioning scheme
GNOME's new versioning scheme
GNOME's new versioning scheme