Not logged in
Log in now
Create an account
Subscribe to LWN
LWN.net Weekly Edition for May 16, 2013
A look at the PyPy 2.0 release
PostgreSQL 9.3 beta: Federated databases and more
LWN.net Weekly Edition for May 9, 2013
(Nearly) full tickless operation in 3.10
Although I still believe that real end-user testing is a must have for final QA.
I dont know if open-source processes can guarantee that end-user testing. Anyone care to enlight here?
All the best.
openSUSE Conference 2010: Making testing easier
Posted Nov 18, 2010 12:59 UTC (Thu) by bmwiedemann (guest, #71319)
thanks for the feedback. You are right in that automated testing alone is not good enough for a final release for several reasons (which I also mentioned in the talk).
a) is Qemu/KVM only emulates one certain combination of hardware, so 99% of drivers will not be tested by it.
b) see Dijkstra's quote above - there is a huge number of possible code pathes in most programs and one test-run can only exercise one such path.
c) there are also a big number of packages in modern distributions and few come with their own test-suites
d) software (especially open-source) gets updated a lot and keeping tests for it in a working state can be quite some effort
The automated testing is intended to save developers/testers/users from obvious blocker bugs in the unstable-release-of-the-day (named openSUSE-Factory / Fedora-Rawhide or Debian-sid).
Bernhard M. Wiedemann
Copyright © 2013, Eklektix, Inc.
Comments and public postings are copyrighted by their creators.
Linux is a registered trademark of Linus Torvalds