LWN.net Logo

Kernel development statistics for 2.6.34 and beyond

By Jonathan Corbet
May 4, 2010
As of this writing, the current kernel prepatch is 2.6.34-rc6. A couple more prepatches are most likely due before the final release, but the number of changes to be found there should be small. In other words, 2.6.34 is close to its final form, so it makes sense to take a look at what has gone into this development cycle. In a few ways, 2.6.34 is an unusual kernel.

This kernel has seen the addition of 9100 non-merge changesets from just over 1100 developers. That makes it somewhat smaller than its predecessors, as can be seen in this table:

KernelPatchesDevs
2.6.29 11,600 1170
2.6.30 11,700 1130
2.6.31 10,600 1150
2.6.32 10,800 1230
2.6.33 10,500 1150
2.6.34 9,100 1110

Developer participation in this development cycle was slightly lower than the usual, but not in any significant way. But, it seems, those developers had a bit less than usual that they needed to get done. One might be tempted to chalk that up to the shorter-than-usual merge window at the beginning of this cycle, but the fact of the matter is that Linus let enough new material in after 2.6.34-rc1 to make the merge window effectively as long as it ever was.

The lists of the most active developers suggest that perhaps something else was going on: many of the developers who traditionally put large amounts of code into the kernel essentially sat out this cycle.

Most active 2.6.34 developers
By changesets
Sage Weil2122.3%
Joe Perches1691.9%
Paul Mundt1531.7%
Uwe Kleine-König1091.2%
Mark Brown1021.1%
Ben Dooks961.1%
Rafał Miłecki881.0%
Dan Carpenter840.9%
Alex Deucher830.9%
H Hartley Sweeten800.9%
Christoph Hellwig750.8%
Johannes Berg740.8%
Arnaldo Carvalho de Melo720.8%
Bartlomiej Zolnierkiewicz640.7%
David S. Miller630.7%
Magnus Damm630.7%
By changed lines
Sage Weil302334.1%
Vladislav Zolotarov231193.2%
Jarod Wilson196892.7%
Mark Brown185132.5%
Dimitris Michailidis139191.9%
Manuel Lauss118311.6%
Jörn Engel108101.5%
Kukjin Kim101421.4%
Alex Deucher97851.3%
Amit Kumar Salecha93911.3%
Michael Chan93361.3%
Joe Perches87381.2%
Paul Mundt84381.2%
Haojian Zhuang84031.1%
Magnus Damm83201.1%
Matthias Benesch77391.1%

Sage Weil jumped to the top of both lists with the merger of the Ceph distributed filesystem and the subsequent bug-fixing activity. Joe Perches is the new king of the trivial patch; his work includes lots of checkpatch fixups, reworking print statements in network drivers, and no less than 37 patches implementing a rather belated cleanup of the floppy driver. Paul Mundt's work falls almost exclusively within his role as the maintainer of the Super-H architecture. Uwe Kleine-König works mostly within the ARM architecture code, and Mark Brown continues as the source of large amounts of sound driver and embedded processor code.

On the "lines changed" side, Vladislav Zolotarov only contributed nine patches, all with the Broadcom NetXtreme II driver - but they included a large replacement of the in-tree firmware. Jarod Wilson's count was even smaller - three patches; he contributed the Broadcom Crystal HD driver to the staging tree. Dimitris Michailidis earned his place on the list with the new Chelsio Communications T4 Ethernet driver.

Just over 180 employers were identified as having contributed to 2.6.34 - almost exactly the same as 2.6.33. With the 2.6.33 summary, your editor suggested that Red Hat's position as the top contributor may soon be threatened; let's see how that prediction worked out for 2.6.34:

Most active 2.6.34 employers
By changesets
(None)145516.0%
(Unknown)95910.5%
Red Hat93410.3%
Intel4725.2%
IBM3543.9%
Novell3293.6%
(Consultant)2743.0%
Nokia2482.7%
New Dream Network2372.6%
Renesas Technology1882.1%
Texas Instruments1802.0%
Pengutronix1541.7%
Oracle1441.6%
HP1281.4%
(Academia)1251.4%
Analog Devices1231.4%
AMD1211.3%
Fujitsu1211.3%
Marvell1201.3%
Wolfson Microelectronics1011.1%
By lines changed
Red Hat7523510.3%
(None)7516010.3%
(Unknown)675419.2%
Broadcom565957.7%
Intel331754.5%
New Dream Network315014.3%
(Consultant)291404.0%
Novell242173.3%
Wolfson Microelectronics206602.8%
Renesas Technology162052.2%
Chelsio139371.9%
IBM136181.9%
QLogic131821.8%
MSC Vertriebs GmbH125451.7%
Samsung122241.7%
Marvell119141.6%
Texas Instruments112281.5%
Analog Devices110471.5%
AMD108941.5%
Nokia102171.4%

Looking at absolute numbers, Red Hat's contributions declined considerably from 2.6.33: 1223 changesets dropped to 934. Everybody else declined even further, though; Intel's changeset count was less than half of its value from 2.6.33. So Red Hat stays firmly at the top of the list. Many of the other companies on the list will be unsurprising, but readers may be forgiven for wondering about New Dream Network; that is a business co-founded by Ceph developer Sage Weil.

If we look at non-author signoffs, we get a view of who the most active gatekeepers for the kernel are. Here, there are no surprises at all:

Most non-author signoffs
By developer
David S. Miller103413.0%
Greg Kroah-Hartman7809.8%
Andrew Morton5466.9%
John W. Linville5466.9%
Ingo Molnar3484.4%
Mauro Carvalho Chehab3304.2%
James Bottomley2443.1%
Dave Airlie1501.9%
Ralf Baechle1441.8%
H. Peter Anvin1411.8%
By employer
Red Hat286536.1%
Novell129316.3%
Intel5657.1%
Google5476.9%
(None)3654.6%
IBM2893.6%
(Consultant)1942.4%
Wind River1451.8%
Atomide1301.6%
Oracle1281.6%

Ten development cycles ago (2.6.24), Andrew Morton was the most active gatekeeper, signing off on almost 1700 patches. His role as subsystem maintainer of last resort has declined over the years as more maintainers manage their own repositories and push patches directly to Linus. Speaking of Linus, he not only didn't make the list above, but he wasn't even close: his 71 signoffs put him in the 22nd position. Dave Airlie's position on the list is an indication of how much activity we are currently seeing in the graphics area.

Once again, over 50% of the patches heading into the mainline kernel pass through the hands of somebody employed by either Red Hat or Novell.

Looking forward

As of this writing, the opening of the 2.6.35 merge window can be expected sometime in the next 1-3 weeks. By the stated rules of the kernel development process, the bulk of the code intended for that merge window should already be in the linux-next tree. With that in mind, your editor pulled down the May 4 edition of linux-next to see what was up. There are currently 5144 non-merge changesets in that tree, representing 758 developers. The top contributors are:

Most active linux-next developers
By changesets
Mauro Carvalho Chehab2454.8%
Eric Paris1032.0%
Alexander Graf841.6%
Johannes Berg591.1%
Juuso Oikarinen591.1%
Jean-François Moine581.1%
Luis R. Rodriguez581.1%
Greg Kroah-Hartman521.0%
Sujith521.0%
Dan Carpenter511.0%
By changed lines
Mauro Carvalho Chehab287436.2%
Eliot Blennerhassett184294.0%
Bob Beers117032.5%
Luis R. Rodriguez105072.3%
Steve Wise94472.0%
Viresh Kumar94262.0%
Jason Wessel87391.9%
Sjur Braendeland86851.9%
Stephen Rothwell79081.7%
Matthias Benesch77391.7%

Mauro Carvalho Chehab has had a busy development cycle; beyond large amounts of Video4Linux work, he's jumped into the Nehelem EDAC (memory error detection and correction) code and is adding a new core for the management of infrared controllers. Eric Paris has done a bunch of security cleanup work; he also has the fanotify subsystem queued up. Eliot Blennerhassett, instead, has a single patch: a driver for AudioScience sound devices.

It will be interesting to see how this list changes by the end of the 2.6.35 merge window. Even more interesting, arguably, will be the list of top non-author signoffs:

Most non-author signoffs (linux-next)
Mauro Carvalho Chehab65113.8%
John W. Linville50710.8%
David Miller4629.8%
Greg Kroah-Hartman4118.7%
Ingo Molnar1703.6%
Avi Kivity1563.3%
James Bottomley1553.3%
Reinette Chatre982.1%
David Woodhouse932.0%
Marcelo Tosatti721.5%

Subsystem maintainers are the folks who are charged with getting work into linux-next, so, if they all are doing their jobs, this list should not change much through the merge window.

If the numbers do hold, 2.6.35 looks like another relatively subdued development cycle without huge amounts of exciting new stuff. Things do tend to change during the merge window, though, and surprises always show up from somewhere. So, even with resources like linux-next, it's hard to tell what the next development cycle will truly bring.


(Log in to post comments)

Kernel development statistics for 2.6.34 and beyond

Posted May 4, 2010 22:45 UTC (Tue) by bojan (subscriber, #14302) [Link]

Nice to see Broadcom folks chipping in. Now, if we could have this:

http://www.broadcom.com/support/802.11/linux_sta.php

And this:

http://wireless.kernel.org/en/users/Drivers/b43

Come together, through the knowledge that Broadcom folks have, that would be awesome.

Kernel development statistics for 2.6.34 and beyond

Posted May 5, 2010 12:40 UTC (Wed) by miguelzinho (subscriber, #40535) [Link]

I'm done with Broadcom. I've got a new laptop that came with BCM4321. I knew it could be problematic, but there was no option to change it.

The laptop came and, guess what? The WiFi card didn't work.

The error was something like this:
http://ubuntuforums.org/showthread.php?t=1266620&high...

My solution? I've got a Atheros half mini pci-express card and replaced the Broadcom one. It Just Worked (R) with every single WiFi network I've tried perfectly.

Kernel development statistics for 2.6.34 and beyond

Posted May 5, 2010 17:35 UTC (Wed) by Trelane (guest, #56877) [Link]

"I knew it could be problematic, but there was no option to change it."

This didn't come with Linux drivers? How did the Linux pre-install work? What distro?

Kernel development statistics for 2.6.34 and beyond

Posted May 5, 2010 14:42 UTC (Wed) by waucka (subscriber, #63097) [Link]

I really wonder why Broadcom is so secretive. What do they feel the need to hide? Have they done something illegal in producing their hardware, or are they just gripped by the intellectual "property" paranoia that is sadly common in the modern business world? Why is Broadcom the last anti-Linux holdout among the wireless chipset vendors?

Kernel development statistics for 2.6.34 and beyond

Posted May 5, 2010 14:44 UTC (Wed) by waucka (subscriber, #63097) [Link]

I should also mention that this is particularly suspicious given that their Linux driver for the Crystal HD video decoding chipset is GPL.

Kernel development statistics for 2.6.34 and beyond

Posted May 5, 2010 16:07 UTC (Wed) by iabervon (subscriber, #722) [Link]

My impression is that Broadcom is entirely driven by their customers. If someone is purchasing a million units of a chipset, but only if there's a Linux driver, Broadcom will write a Linux driver. If the customer demands a Windows driver, Broadcom will write one of those. Customers at that layer never demand programming specs, because they don't write software, and if they're going to get software written, they might as well get Broadcom to do it instead of a third-party. Broadcom isn't really secretive, they just don't do anything they're not getting paid for, and they get paid for very specific things. I think the change is that their customers are asking for chipsets to be supported by the mainline Linux kernel, so they're doing this work.

Kernel development statistics for 2.6.34 and beyond

Posted May 5, 2010 17:38 UTC (Wed) by Trelane (guest, #56877) [Link]

So the lesson here is to buy hardware from vendors offering Linux pre-installed?

Kernel development statistics for 2.6.34 and beyond

Posted May 5, 2010 3:53 UTC (Wed) by dvhart (guest, #19636) [Link]

Fantastic breakdown. Thanks Jon!

Kernel development statistics for 2.6.34 and beyond

Posted May 5, 2010 17:39 UTC (Wed) by Trelane (guest, #56877) [Link]

Seconded! I like LWN for this reason!

Kernel development statistics for 2.6.34 and beyond

Posted May 5, 2010 17:07 UTC (Wed) by daney (subscriber, #24551) [Link]

Some of the 'employer' corporate entities have ownership relationships that I think are not reflected. It doesn't really change the overall picture that much, but Intel/WindRiver and Cavium Networks/MontaVista come to mind.

This got me thinking... What is it about 'Academia', 'Consultant', 'Unknown', and 'None' that they merit a top-level category, but all the corporate employers are broken out? Since the groupings are somewhat arbitrary, it probably makes sense as it is, but 'Academia' is probably not working in concert where as RedHat may be.

Kernel development statistics for 2.6.34 and beyond

Posted May 7, 2010 11:10 UTC (Fri) by opalmirror (subscriber, #23465) [Link]

I would argue that Wind River (no longer pronounced Win Driver) should be recognized on its own merits. Wind River remains largely independent of its owner - necessary because it supports OS and development environments across a wide range of chips, and maintains NDAs with Intel's competitors. (Yes, I am employed by Wind River). I agree Jon's binning is pretty much arbitrary. I find it pretty useful though, and appreciate his attempts to maintain a consistent sort of arbitrary.

Kernel development statistics for 2.6.34 and beyond

Posted May 10, 2010 16:34 UTC (Mon) by patrick_g (subscriber, #44470) [Link]

>>> Speaking of Linus, he not only didn't make the list above, but he wasn't even close: his 71 signoffs put him in the 22nd position.

Very strange because, according to this site, Linus has 506 signoffs during this 2.6.34 cycle and he is number 5 on the signoff list.
Where is the truth?

Linus's signoffs

Posted May 10, 2010 18:35 UTC (Mon) by corbet (editor, #1) [Link]

They're both true. Sorry, it's been a while since I explained this little detail: when counting Linus's signoffs, I disregard those which appear on patches which already carry Andrew Morton's signoff. Everything that goes through Andrew gets Linus's signoff because Andrew sends them as email; if he put them in a tree to be pulled, this wouldn't happen. Not counting those gives a much more true indication of how many patches Linus himself has reviewed and accepted.

Linus's signoffs

Posted May 10, 2010 19:01 UTC (Mon) by patrick_g (subscriber, #44470) [Link]

Thanks for the explanation.

Copyright © 2010, Eklektix, Inc.
Comments and public postings are copyrighted by their creators.
Linux is a registered trademark of Linus Torvalds