Posted Oct 19, 2009 17:22 UTC (Mon) by dyqith (guest, #31406)
Parent article: KS2009: Regressions
Maybe what we need is a group/company/foundation/person to come up with a huge collection of machines for automatic regression testing for new kernels.
There should be a couple of machines from different categories (servers, laptops, desktops, mobiles) and manufacturers (Dell, HP, etc), and for testing at different levels (configure/compile, static analysis, boot, devices, filesystems, memory, etc).
We have a set standard of tests, and users/devs can add in new tests when new features are needed to be tested.
The output of the tests can then be posted to a bug tracker somewhere.
The way I see it is testers have two problems (time and materials).
Some have lots of time to test things, but no machine to play with;
others have no time, but lots of machines.