LWN: Comments on "Brian Kernighan on the origins of Unix" https://lwn.net/Articles/881431/ This is a special feed containing comments posted to the individual LWN article titled "Brian Kernighan on the origins of Unix". en-us Sun, 14 Sep 2025 09:48:34 +0000 Sun, 14 Sep 2025 09:48:34 +0000 https://www.rssboard.org/rss-specification lwn@lwn.net Brian Kernighan on the origins of Unix https://lwn.net/Articles/883382/ https://lwn.net/Articles/883382/ jdisnard <div class="FormattedComment"> It&#x27;s always nice to to see Brian&#x27;s deep perspective into Unix. One thing I&#x27;d like to see more from folks like Brian is how Plan9 fit into the Unix big picture, and how that relates to Linux? I&#x27;d also like to understand how one might go about recreating something as magical like Bell Labs in the modern era?<br> </div> Tue, 01 Feb 2022 13:17:11 +0000 Brian Kernighan on the origins of Unix https://lwn.net/Articles/883167/ https://lwn.net/Articles/883167/ scientes <div class="FormattedComment"> <font class="QuotedText">&gt; The C language hit a &quot;sweet spot&quot; in language design that has proved hard for anybody else to hit since, Kernighan said. </font><br> <p> Absolutely. I got really excited about Zig-lang&#x27;s goals to replace C, while still being Turing complete, but it has IMHO since abandoned that goal. <br> <p> The features of Zig that could feasibly be ported to C (with a great deal of work) would be--<br> <p> 1. Remove the need of C pre-processor, which is a language of its own (the original Go compiler written in C avoided the C pre-processor, but Zig does it better).<br> <p> 2. Better memory allocation. malloc and free are a commonly slow in C applications, leading to Firefix and Chromium using custom allocators (jmalloc and tcmalloc) but these, and also the quite novel Mesh-allocator are not as good as the Zig abstractions. Also, C programs that use malloc and free are generally at the mercy of the OOM killer, and these type of bugs have plagued systemd due to the incredible bug-hunter Evvrx.<br> <p> 3. Make integer overflow part of the language, instead of obscure &quot;undefined behavior&quot; rules which are often over-ruled by an excessive number of non-standard-behavior compiler switches which are even used by Linux.<br> </div> Sat, 29 Jan 2022 15:12:13 +0000 Brian Kernighan on the origins of Unix https://lwn.net/Articles/883020/ https://lwn.net/Articles/883020/ farnz <p>Cgroups have two things that a virtual machine setup does not have: <ol> <li>Limits to determine which containers swap more than others. By setting memory.low to your "fair" share without overcommiting, and memory.high to your limit with overcommit, you bias the kernel's paging to page out memory hogs (both to swap and paging out their executable pages), and to slow down processes that can't reclaim memory to stay in their lane. <li>An interface for a management process to use to identify cgroups that are using more than their fair share. You can monitor memory.events for changes, and use the notifications to tell containers to reduce their memory use. </ol> <p>Now, if you're dealing with people who overcommit physical RAM but who've not read and understood <a href="https://chrisdown.name/2018/01/02/in-defence-of-swap.html">In defence of swap</a>, you're in trouble anyway - they're working on a faulty model of how the OS allocates memory to processes to begin with, and both models are going to break because they're expecting "magic" to save them. But with competent people, cgroups already does better than VMs; and because cgroups has more visibility into what the workload is doing, it's more likely that cgroups will improve over time. <p>As an example, EPOC32 had low memory signals it sent to the applications to let them know that the system was low on memory, and that it was out of memory. Applications were expected to handle these signals by discarding caches, performing an early GC etc - and could also (ab)use them for better performance (e.g. don't run GC until the system is low on memory). You can get similar signals in a cgroup-aware application by having the application monitor memory.events, and treating a breach of the "low" threshold as "memory is running low" and a breach of the "high" threshold as "out of memory". Then, your JVM could be aware of this, and whenever it breaches the "low" threshold (container using too much memory), it does a GC run, while when it breaches the "high" threshold, it also discards any cached JITted sections etc. <p>This interacts in a good way with the kernel's preference to swap stuff that breaches low more than it swaps stuff that breaches high - when you breach low, you try to come back under control, when you breach high, you try to avoid being killed. Fri, 28 Jan 2022 14:48:36 +0000 Brian Kernighan on the origins of Unix https://lwn.net/Articles/882988/ https://lwn.net/Articles/882988/ wahern <div class="FormattedComment"> cgroups doesn&#x27;t solve the memory sharing problem any better, though admittedly VMs do currently compound the problem. virtio-balloon, which is widely supported (including by typical Linux hosts and guests) permits a guest to return memory (e.g. filesystem buffer caches) to the host. The problem (AFAIU) is that currently there&#x27;s no implementation on either side (host or guest) that communicates memory pressure back-and-forth, opportunistically shifting memory around. See defunct auto-ballooning project at <a href="https://www.linux-kvm.org/page/Projects/auto-ballooning">https://www.linux-kvm.org/page/Projects/auto-ballooning</a>. So, just as with cgroups, if the memory accounting budget is overcommitted and the VM manager hits a hard OOM condition, it&#x27;s already too late to guarantee ideal behavior; that is, it&#x27;s too late to first recover caches and other any pages across all processes/guests that aren&#x27;t strictly necessary for correct continuation (if at all possible) of every process/guest.<br> <p> The alternative in each case--VMs and cgroups--is to preallocate memory so that the sum is no more than available backing space. But the Kubernetes clusters I&#x27;ve worked on, for example, all overcommitted cgroups memory--the sum of all pod cgroup memory limits was greater than physical memory (and machines had no swap space, despite my protests). Use of cgroups couldn&#x27;t prevent the OOM killer from unnecessarily shooting down processes when under high aggregate load; it only helped blunt edge cases where individual pods allocated much more memory than ever expected (e.g. because of a memory leak). This was especially true if a JVM was running in a pod, as for whatever reasons the Java applications people liked to run on those clusters aggressively used anonymous memory. Whenever some other team complained about their pod being OOM killed despite not going over their cgroup budget, the host invariably had a JVM running in another, unrelated pod. (This was especially problematic for the period, 2019-2020, when Linux kernels had a regression that made it *much* more likely that the OOM killer couldn&#x27;t flush buffer caches faster than processes would dirty them. Worse, the result was the OOM killer spinning, sleeping, and eventually timing out in its flush routine; and often times multiple processes could end up in that routine--or end up trying to take a lock held by that routine--effectively resulting in a situation where the entire system could lock-up for an indeterminate amount of time. Even if you could get an SSH session, poke the wrong process and your session would lock-up, too.)<br> <p> </div> Fri, 28 Jan 2022 06:05:56 +0000 Brian Kernighan on the origins of Unix https://lwn.net/Articles/882228/ https://lwn.net/Articles/882228/ ceplm <div class="FormattedComment"> Hmm, I have to revert myself a bit. I was talking about completely independent system and then I was talking about using “normal” formats, which is mutually exclusive. Damn.<br> <p> Concerning Perkeep, it looks interesting, but more as a secondary story for backup and archiving (something similar to <a href="https://github.com/ThinkUpLLC/ThinkUp">https://github.com/ThinkUpLLC/ThinkUp</a> ?) not as something where you actually work.<br> </div> Sat, 22 Jan 2022 21:57:44 +0000 Brian Kernighan on the origins of Unix https://lwn.net/Articles/882221/ https://lwn.net/Articles/882221/ ceplm <div class="FormattedComment"> OK, an interesting idea I will try to learn more about it. Two problems seem obvious, why I think keeping it on the lower level of a filesystem makes more sense is that nobody wants to use any format they don’t already use (<a href="https://xkcd.com/743/">https://xkcd.com/743/</a>), and the second is that I have never heard about, so I don’t expect it to take over the world anytime soon.<br> </div> Sat, 22 Jan 2022 19:28:18 +0000 Brian Kernighan on the origins of Unix https://lwn.net/Articles/882195/ https://lwn.net/Articles/882195/ malmedal <div class="FormattedComment"> My own memory also rather lacking at this point, but I think the deal-breaker for me was that the migrated process would die if the node it originally ran on rebooted. <br> <p> Did MOSIX ever fix that issue?<br> </div> Sat, 22 Jan 2022 13:03:36 +0000 Brian Kernighan on the origins of Unix https://lwn.net/Articles/882174/ https://lwn.net/Articles/882174/ intgr <div class="FormattedComment"> <font class="QuotedText">&gt; What I was thinking was that all my data are somewhere in The Cloud and whatever machine I use to access them (workstation, my hobby home laptop, tablet, or phone) I get access to the same data.</font><br> <p> Perkeep (previously Camlistore) is an attempt to solve this problem.<br> </div> Fri, 21 Jan 2022 23:54:30 +0000 Brian Kernighan on the origins of Unix https://lwn.net/Articles/882135/ https://lwn.net/Articles/882135/ Cyberax <div class="FormattedComment"> Sorry, I&#x27;m a writer, not a reader. 🤦<br> <p> Yes, of course you&#x27;re correct. I used a Beowulf cluster with MOSIX back in the day, so that&#x27;s why I&#x27;m confusing two of them.<br> </div> Fri, 21 Jan 2022 18:38:50 +0000 Brian Kernighan on the origins of Unix https://lwn.net/Articles/882134/ https://lwn.net/Articles/882134/ malmedal <div class="FormattedComment"> ?<br> <p> I believe I said Beowulf couldn&#x27;t but MOSIX could migrate processes, they are different things. <br> </div> Fri, 21 Jan 2022 18:36:50 +0000 Brian Kernighan on the origins of Unix https://lwn.net/Articles/882132/ https://lwn.net/Articles/882132/ Cyberax <div class="FormattedComment"> Yes, they did. You could migrate processes between nodes: <a href="https://web.archive.org/web/20031002104248/http://www.openmosixview.com/docs/openMosixAPI.html">https://web.archive.org/web/20031002104248/http://www.ope...</a> with some measure of automatic load balancing.<br> </div> Fri, 21 Jan 2022 18:14:22 +0000 Brian Kernighan on the origins of Unix https://lwn.net/Articles/882088/ https://lwn.net/Articles/882088/ gwolf <div class="FormattedComment"> Indeed, that book was my favorite 2020 read. Much recommended!<br> </div> Fri, 21 Jan 2022 15:24:30 +0000 Brian Kernighan on the origins of Unix https://lwn.net/Articles/882067/ https://lwn.net/Articles/882067/ smurf <div class="FormattedComment"> … or something like the GNU Hurd.<br> </div> Fri, 21 Jan 2022 14:01:44 +0000 Beowulf https://lwn.net/Articles/882066/ https://lwn.net/Articles/882066/ corbet Yeah...Beowulf clusters still exist, they are just called "data centers" now... Fri, 21 Jan 2022 14:01:14 +0000 Brian Kernighan on the origins of Unix https://lwn.net/Articles/882064/ https://lwn.net/Articles/882064/ malmedal <div class="FormattedComment"> I don&#x27;t think Beowulf clusters had that capability. You could schedule your job in any cluster-member, but not move them. Similarly with VMS, you could maintain the illusion of 100% uptime of a specially written application even while replacing all hardware.(admittedly I&#x27;ve only used VMS on VAX, maybe later versions could actually move jobs).<br> <p> MOSIX however, could move arbitrary processes between cluster machines.<br> <p> Another option is Condor, which uses CRIU to move simple processes. <br> </div> Fri, 21 Jan 2022 13:58:25 +0000 Brian Kernighan on the origins of Unix https://lwn.net/Articles/882056/ https://lwn.net/Articles/882056/ Cyberax <div class="FormattedComment"> People tried that with Linux (famous Beowulf clusters!) but this really doesn&#x27;t buy you a lot. Why would you migrate jobs between hosts in the first place?<br> <p> You can do full machine migration easily either via VM checkpoint/restore or via CRIU, and this is useful in virtualization scenarios. You can also do high-availability via Xen where the same code runs on two computers at once, in case one of them goes down.<br> </div> Fri, 21 Jan 2022 12:01:09 +0000 Brian Kernighan on the origins of Unix https://lwn.net/Articles/882053/ https://lwn.net/Articles/882053/ ceplm <div class="FormattedComment"> Yes, VMSClusters look like something I was thinking about (as far as I can get from the Wikipedia article on it). I speak mostly out of my frustration with the current state of the affairs.<br> <p> What I was thinking was that all my data are somewhere in The Cloud and whatever machine I use to access them (workstation, my hobby home laptop, tablet, or phone) I get access to the same data. Perhaps I don’t have all applications for all data (thinking that tablet or phone), then I cannot access those, but for those data which I have application for I can access the exact same data. And of course all that over the Internet, so fully secure, with authorizations and all that crap. And all that cached on the local disc, because otherwise latency will kill any user experience. It should be the normal state of everyday affairs not something like pulling your teeth slowly.<br> <p> If you try something like that today you have NFS or Samba or stuff like that, which is unuseable for everyday work over even slightly non-local network (not mentioning a potential security disaster, so one switches to something even more obscure like sshfs and that’s even slower; NFSv4 may be more secure). Or you have some ultra-high-level stuff like Coda/OpenAFS etc. which requires really high-end hardware (no chance of running it on my tablet, phone could not be even mentioned) and even there I am not sure how well it works. Or you have series of mutually incompatible ad-hoc synchronization hacks (offline-IMAP, similar for CardDAV/CalDAV/etc., some weird in-browser proprietary caching for Google Docs, scripts using rsync, etc.).<br> <p> <a href="http://ninetimes.cat-v.org/">http://ninetimes.cat-v.org/</a> seems to claim that Plan9 was supposed to be able of something like that, but I have my deepest doubts and I will believe it when I see it.<br> <p> If you have some system which fulfils my requirements than you are either God or a liar, and I be on the latter.<br> </div> Fri, 21 Jan 2022 11:16:52 +0000 Brian Kernighan on the origins of Unix https://lwn.net/Articles/882022/ https://lwn.net/Articles/882022/ sfeam <i>We have either local systems (BTRFS, XFS, etc.) or network systems (NFS, Samba, etc.), but nothing in between.</i><p> Well, there were VAXClusters. Start a job on the cluster and it would migrate from machine to machine or node to node as they connected or disconnected themselves from the cluster. So far as I know unix/linux clusters never have reached this level of flexibility. Or maybe you were focusing specifically on <i>file</i>systems? Thu, 20 Jan 2022 22:44:58 +0000 Brian Kernighan on the origins of Unix https://lwn.net/Articles/882021/ https://lwn.net/Articles/882021/ ceplm <div class="FormattedComment"> One thing which is very much not A Solved Problem™ is really working networked system. Something which would be networked but it would allow seamless work offline (or when the network is not that really fast as we would like it to be). We have either local systems (BTRFS, XFS, etc.) or network systems (NFS, Samba, etc.), but nothing in between.<br> <p> I believe that Plan9 was more on the way towards this ideal, but Plan9 unfortunately died.<br> </div> Thu, 20 Jan 2022 22:37:22 +0000 Brian Kernighan on the origins of Unix https://lwn.net/Articles/881988/ https://lwn.net/Articles/881988/ ermo <div class="FormattedComment"> I can&#x27;t help but think that what you&#x27;re asking for is a micro-kernel-like design from the ground up, where e.g. the user graphical session is its own set of processes (possibly related via a cgroup or namespace-like idiom), each browser tab is its own process and each container is its own proces and where all these processes use the fundamental micro-kernel message-passing paradigm (possibly wrapped) to communicate with each other?<br> <p> If all processes used the same form of containerisation/namespacing/layering and the same means of IPC (possibly with some faster-than-TCP-but-still-reliable network transport available), this might function as seamlessly as one could ideally expect.<br> <p> At least, that&#x27;s the endpoint my imagination extrapolates to from your problem statement. I could be (very) wrong of course.<br> <p> I don&#x27;t know how close Plan 9 comes to this hypothetical scenario or whether it&#x27;s even close. But perhaps Zircon/Fuchsia might very well become the closest modern approximation of what I outline?<br> </div> Thu, 20 Jan 2022 17:10:42 +0000 Brian Kernighan on the origins of Unix https://lwn.net/Articles/881986/ https://lwn.net/Articles/881986/ karim <div class="FormattedComment"> Thanks for this, interesting point of view.<br> <p> I somewhat feel git might actually a good example of commoditization. I followed this very much in &quot;real-time&quot; as the BitKeeper drama unfolded and was at OLS in 2005 when Matt Mackall first presented Mercurial -- I loved mercurial btw, and I was sad to see git prevail, but I digress. It was my understanding that BitKeeper was tailor-built by Larry McVoy for Linux development based on direct conversations between Linus and Larry. I don&#x27;t have a reference for this, so I could be misremembering, but that was my understanding. As such, when the history section of git on Wikipedia (<a href="https://en.wikipedia.org/wiki/Git#History">https://en.wikipedia.org/wiki/Git#History</a>) states: &quot;Support a distributed, BitKeeper-like workflow.&quot; as one of the goals set out by Linus for git, one can probably easily overlook the work that Larry presumably did to actually and actively listen to Linus and come up with something that fit &quot;the customer&#x27;s needs&quot;. [side bar: I&#x27;ve butted heads with Larry several times in the early 2000s on unrelated topics, but credit should go where it&#x27;s deserved.]<br> <p> And maybe this is what it boils down to. &quot;Listening to the customer&#x27;s needs&quot; and &quot;creating a product the customer will actually use&quot; have nothing to do with the ability of replicating in an open source manor the end result of what those customer-facing steps entail. In fact, I&#x27;d venture to say that the open source community generally has had a bad history of being able to listen to customer needs. It&#x27;s been, on other hand, very effective at replicating what those that have have produced, albeit sometimes in a more sustainable fashion ... because direct monetization wasn&#x27;t the end goal or even possibly a need.<br> <p> Again: 1) very rough ideas/arguments off the top of my head, 2) I care not of being right nor making a point. i.e. destroy/demolish at will.<br> </div> Thu, 20 Jan 2022 16:55:32 +0000 Brian Kernighan on the origins of Unix https://lwn.net/Articles/881899/ https://lwn.net/Articles/881899/ farnz <p>The other thing that would be nice to solve that VMs don't is good resource utilization; a VM's memory allocation is hard to vary dynamically based on overall system load, as is its filesystem size. The only host resource that's demand-shared in a VM setup is CPU. <p>It would be nice if we didn't have to preallocate resources to processes, but instead could rely on the system sharing all resources fairly and reasonably for the use cases in question. That's a hard problem, but it's one that (e.g.) filesystem quotas and cgroups aim to solve for containerized systems. Thu, 20 Jan 2022 11:16:27 +0000 Brian Kernighan on the origins of Unix https://lwn.net/Articles/881890/ https://lwn.net/Articles/881890/ gasche <div class="FormattedComment"> Interesting discussion! I can think of several open source projects that were disruptive to the rest of the ecosystem (even if they are often built on pre-existing ideas that hadn&#x27;t seen wide diffusion yet). They are limited to my own expertise and I&#x27;m sure there are many more examples:<br> <p> - Git made distributed version-control widely available and changed our development practices in a radical way.<br> - Haskell is a radical programming language that gave a lot of ideas now adopted by other languages<br> - Nix and Guix are proposing a fresh take on software package management and generally the OS<br> - QubesOS is also a fairly radical take on OS (although it is a layer on top of existing systems for usability reasons)<br> - the Coq proof assistant ( <a href="https://en.wikipedia.org/wiki/Coq">https://en.wikipedia.org/wiki/Coq</a> ), and in general Interactive Theorem Provers, are radical projects and all the active ones are open source, with most run as free software projects (with a strong academic bias among contributors).<br> - I believe that some peer-to-peer projects also had a radical impact (Bitorrent these days), but I don&#x27;t know enough about their history to tell if the open source / free software community participated actively. (I think there was a fair amount of Windows-based freeware at the time.)<br> - I would guess that Bitcoin was also operated by a crew of enthusiast hackers from the open source community at the start -- but again I&#x27;m not sure.<br> <p> Many of those projects were born in academia (a natural place to look for radical ideas), but they were also open source projects from the start, and in many cases the free software community contributed greatly to the fact that they became successful enough to spread their ideas to the rest of the software world.<br> <p> For Git one could argue that this is a commoditization of the proprietary system BitKeeper; but there were also open source ancestors (GNU Arch) and competitors (darcs, Mercurial) that were also influential.<br> (I think it would be worth articulating whether we are discussing inventions that were born in the open source community and became successful-enough within it, or inventions that were born anywhere but remained fairly confidential, and became successful thanks to the open source community. I rather have the later in mind, and I think it is different from &quot;commoditization&quot;.)<br> <p> One important area of innovation that is missed here is machine learning, that saw relatively little involving from well-identified open source communities, possibly as the requirements for entering the space (having a *lot* of training data at hand) made distributed development difficult. There are now striving open source projects within the machine learning software ecosystem, but I wouldn&#x27;t say that the field would be substantially different without the open source community (by which I mean: without large-scale cooperation of hobbyists / benevolent contributors). <br> <p> <p> </div> Thu, 20 Jan 2022 09:37:53 +0000 Brian Kernighan on the origins of Unix https://lwn.net/Articles/881871/ https://lwn.net/Articles/881871/ ikitayama <div class="FormattedComment"> I very much enjoyed this specific piece, thank you Jon!<br> </div> Thu, 20 Jan 2022 02:49:41 +0000 Brian Kernighan on the origins of Unix https://lwn.net/Articles/881851/ https://lwn.net/Articles/881851/ epa <div class="FormattedComment"> If you don&#x27;t want the users to communicate with each other (except over network links) then yes. You give each user their own system, whether by physical hardware or a virtual machine. My vision of a multi-user system is that it has the properties I mentioned, but at the same time you can communicate between users in the lightweight way you do on a current Linux system, provided you&#x27;ve granted permission. The multi-user interface provided by a set of virtual machines is pretty basic, because usually the only way for them to communicate is via TCP/IP.<br> <p> We have approximations such as sandboxes used by web browsers to isolate one tab from another. Again, I see those as a kind of workaround or a hazy approximation to the right answer: creating a new user on the fly for each tab, giving it its own memory and CPU budget, and then communicating via signals, Unix domain sockets, or a shared filesystem. But yeah, talk is cheap. The point I want to make is that if it&#x27;s considered a solved problem, that may be because we&#x27;re too used to the limitations of the current systems. Before git, software version control might have been seen as a solved problem by some.<br> </div> Wed, 19 Jan 2022 19:55:53 +0000 Brian Kernighan on the origins of Unix https://lwn.net/Articles/881833/ https://lwn.net/Articles/881833/ mpr22 <div class="FormattedComment"> (Also it charges rent on business-use access to its services.)<br> </div> Wed, 19 Jan 2022 17:42:47 +0000 Brian Kernighan on the origins of Unix https://lwn.net/Articles/881832/ https://lwn.net/Articles/881832/ mpr22 <div class="FormattedComment"> The trick is that Google doesn&#x27;t sell software at all.<br> <p> It sells advertising space (and possibly trademark licences?), and uses a slice of the revenue to pay the salaries of its technology division.<br> </div> Wed, 19 Jan 2022 17:40:50 +0000 Brian Kernighan on the origins of Unix https://lwn.net/Articles/881825/ https://lwn.net/Articles/881825/ dgm <div class="FormattedComment"> The moment you have per-user everything (programs, libraries, permissions, filesystems, network, ...) what you have is, in essence, a per-user kernel. I think that the best solution for running per-user kernels are good &#x27;ol Virtual Machines (in the VirtualBox sense), so it is a solved problem indeed.<br> </div> Wed, 19 Jan 2022 17:07:13 +0000 Brian Kernighan on the origins of Unix https://lwn.net/Articles/881749/ https://lwn.net/Articles/881749/ farnz <p>Technical writing is a very different discipline to software writing, and needs a different set of skills. Unfortunately, too many companies fail to value tech writing, and instead expect that the software authors will write good documentation themselves. <p>A really good tech writer knows how to take a developer's documentation (written from a place of deep familiarity with the code) and turn it into something useful for people unfamiliar with the code. A software developer just doesn't have that skill. Wed, 19 Jan 2022 13:56:36 +0000 Brian Kernighan on the origins of Unix https://lwn.net/Articles/881746/ https://lwn.net/Articles/881746/ cyperpunks <div class="FormattedComment"> Yep, sometimes I puzzled how Google can earn all that money and have all these brilliant minds; the software they produce and release lacks both pooper documentation and sane release policy. If they sold software the Microsoft way they would be out of business many years ago.<br> </div> Wed, 19 Jan 2022 12:10:23 +0000 Brian Kernighan on the origins of Unix https://lwn.net/Articles/881745/ https://lwn.net/Articles/881745/ cyperpunks <div class="FormattedComment"> Indeed, a very nice read. Thanks to Brian for that gem!<br> <p> </div> Wed, 19 Jan 2022 12:01:49 +0000 Brian Kernighan on the origins of Unix https://lwn.net/Articles/881716/ https://lwn.net/Articles/881716/ nilsmeyer <div class="FormattedComment"> <font class="QuotedText">&gt; Disclaimer: I work for Google, and while they would probably *like* me to tell you that we have already gotten to that point with GCP, I&#x27;m not 100% convinced that we&#x27;re fully there yet.</font><br> <p> I think as a proprietary solution it&#x27;s a bit of a non-starter anyways. <br> </div> Wed, 19 Jan 2022 05:45:27 +0000 Brian Kernighan on the origins of Unix https://lwn.net/Articles/881715/ https://lwn.net/Articles/881715/ jkingweb <div class="FormattedComment"> This has been my experience with all Google documentation I&#x27;ve ever seen. <br> </div> Wed, 19 Jan 2022 05:36:40 +0000 Brian Kernighan on the origins of Unix https://lwn.net/Articles/881702/ https://lwn.net/Articles/881702/ bartoc <div class="FormattedComment"> <font class="QuotedText">&gt; Sure source availibility isn&#x27;t everything, and isn&#x27;t the same thing as community (the point Andy Rubin makes) but, when the source is available with no community it is still possible for a community to form later (by forking if needed). To some extent this happened, albeit temporarilly, with Android with early &quot;community&quot; Android forks like Cyanogen actually bringing significant new features that ended up becoming available in official Android only later (stuff like tethering and permissions modifications come to mind).</font><br> <p> Interestingly this happened with iPhones too! Despite most of their software not being open source. All those quick control popouts and a lot of the additional interaction options for stuff like notifications were added by third party mods for &quot;jailbroken&quot; iphones long before apple implemented them. I&#x27;m not sure if this is Android/Apple taking ideas from the &quot;community&quot; or just obviously good ideas being implemented by the community first, because a hobbyist doesn&#x27;t need to polish things up that much before shipping (or go through endless UI redesigns, UX research, etc, etc).<br> </div> Wed, 19 Jan 2022 00:37:10 +0000 Brian Kernighan on the origins of Unix https://lwn.net/Articles/881694/ https://lwn.net/Articles/881694/ bartoc <div class="FormattedComment"> I bet many do see k8s as the &quot;one true container solution&quot;. I also bet around 100% of those people work for Google.<br> <p> I&#x27;ve tried to understand k8s multiple times and it&#x27;s like they refuse to _ever_ document what anything actually does, just some high-level abstract theory of what the results might be. It feels like reading a formal standard but more arbitrary.<br> </div> Wed, 19 Jan 2022 00:29:00 +0000 Brian Kernighan on the origins of Unix https://lwn.net/Articles/881674/ https://lwn.net/Articles/881674/ mfuzzey <div class="FormattedComment"> I see what you&#x27;re getting at and don&#x27;t really disagree, major open source projects do seem to often be better at improving an existing idea rather than implementing completely new things.<br> <p> However I think there are other factors at play in your examples.<br> <p> Android: hardware was a huge factor too. The Android OS would be useless with appropriate hardware and that is still difficult / impossible to fully open source and even harder to develop in a community manner.<br> Now that suitable hardware exists there are projects building open source, non AOSP based, operating systems for them. They will probably never become mainstream, just as Linux isn&#x27;t and will probably never be mainstream on the desktop but they do exist.<br> I also think Android wouldn&#x27;t have succeeded as well as it has if it hadn&#x27;t been open source, even though it definitely isn&#x27;t a community driven project.<br> Furthermore Android had specific time to market pressures (to have a chance of avoiding Apple dominating the market and Microsoft taking the rest).<br> <p> ChromeOS: hardware too (though you can run it on a PC so not entirely). But also the chromeOS web centric model relies on huge Google data centres that aren&#x27;t really reproducible outside of huge companies.<br> <p> GCC / LLVM: I think this was more a question of the incumbrent being less nimble. GCC, as the dominant OSS compiler saw less need to innovate and, because they had a large existing code base doing so was harder. This happens in the proprietary world too where innovation is often more likely to occur from a new entrant than a large existing player.<br> <p> But I think where the open source community has really suceeded is in the development model rather than particular technologies.<br> Back in the 90&#x27;s many people thought the future of computing would be building systems from sets of commercial , closed source, components. That was the model Microsoft technologies like ActiveX, OLE, COM/DCOM etc were supposed to enable.<br> That failed to materialize and most new languages / frameworks today are non starters unless they are open source.<br> For many if you can&#x27;t get it with &quot;git clone&quot; and no jumping through hoops it doesn&#x27;t exist.<br> <p> Sure source availibility isn&#x27;t everything, and isn&#x27;t the same thing as community (the point Andy Rubin makes) but, when the source is available with no community it is still possible for a community to form later (by forking if needed). To some extent this happened, albeit temporarilly, with Android with early &quot;community&quot; Android forks like Cyanogen actually bringing significant new features that ended up becoming available in official Android only later (stuff like tethering and permissions modifications come to mind).<br> <p> </div> Tue, 18 Jan 2022 18:36:05 +0000 Brian Kernighan on the origins of Unix https://lwn.net/Articles/881668/ https://lwn.net/Articles/881668/ kleptog <div class="FormattedComment"> I personally found that Docker Swarm actually did reasonably well for the middle. The user experience was pretty good and it was really easy to set-up. Together with docker-compose for the configuration you could get fairly complicated set-ups working pretty quickly with sensible defaults.<br> <p> Its main problem was that the implementation was plagued with bugs that made it really annoying to run in production. When its internal state got corrupted (which was often in the beginning) the only fix was to blow away the entire cluster. Which is really annoying when you&#x27;ve got a hundreds of containers spread over dozens of nodes. Bringing everything up at once was a guaranteed way to get more corrupted state.<br> <p> It&#x27;s better now, and it&#x27;s has been pretty stable for a while, but the mind share has all gone to k8s. Swarm is good for smaller set-ups, but if you want to build another layer of automation on top of it, Swarm is a real pain while k8s does this easily. Silly things like secrets that can&#x27;t be updated are just nails in the coffin.<br> <p> I&#x27;ve wondered about how the world would have turned out if the Swarm UI could have been merged with a k8s reliable backend. I see there is something called Kompose, but I&#x27;ve never tried it.<br> </div> Tue, 18 Jan 2022 17:23:28 +0000 Brian Kernighan on the origins of Unix https://lwn.net/Articles/881628/ https://lwn.net/Articles/881628/ ballombe <div class="FormattedComment"> UNIX/POSIX was instrumental to the free software movement. POSIX provided interface definition that allowed independent developers to write operating system code and userspace code that worked together without requiring too much coordination.<br> The ability to work in parallel was crucial to the growth the free software.<br> <p> Creating a new operating system paradigm from scratch that is not a UNIX copycat require a different mindset.<br> </div> Tue, 18 Jan 2022 16:20:25 +0000 Brian Kernighan on the origins of Unix https://lwn.net/Articles/881656/ https://lwn.net/Articles/881656/ epa <div class="FormattedComment"> Multi-user systems are not a solved problem. If they were, there would hardly be any need for containers. Most container setups work around the inherently single-user setup of typical Linux distributions or Microsoft Windows.<br> <p> In theory each user can have an independent set of software, sharing only the kernel; in practice it&#x27;s damned awkward to run your own software stack from your home directory, and there aren&#x27;t package management tools to make it easy.<br> <p> In theory each user can have their own share of CPU time and I/O budget; in practice it&#x27;s far too easy for one user to take more than their fair share, or to bust global limits with fork bombs and the like.<br> <p> Users and permissions are themselves not per-user; there&#x27;s a single global set of users and groups and it does not nest. You can have subdirectories in the file system but you can&#x27;t have sub-accounts under your user account or make your own groups. It all has to go through a single global administrator. A true multi-user system would let you manage your own permissions within your space and delegate to sub-users.<br> <p> Can you set up a multiuser Linux system where each user gets their own IP address, so they can run their own httpd on port 80 serving that address, and not interfere with other users? I am sure it&#x27;s possible with enough hackery, but it&#x27;s far from being straightforward or manageable.<br> </div> Tue, 18 Jan 2022 15:36:19 +0000 Brian Kernighan on the origins of Unix https://lwn.net/Articles/881663/ https://lwn.net/Articles/881663/ nilsmeyer <div class="FormattedComment"> <font class="QuotedText">&gt; I think this missed the point of the question &quot;Could Unix happen again?&quot;</font><br> <font class="QuotedText">&gt; Though it could be that it just sees a different point to the one that I see - it is a rather vague question.</font><br> <p> Maybe it is happening right now? Without the benefit of hindsight who would have known that Unix or Linux would have such an impact?<br> </div> Tue, 18 Jan 2022 15:32:00 +0000