Not logged in
Log in now
Create an account
Subscribe to LWN
LWN.net Weekly Edition for May 16, 2013
A look at the PyPy 2.0 release
PostgreSQL 9.3 beta: Federated databases and more
LWN.net Weekly Edition for May 9, 2013
(Nearly) full tickless operation in 3.10
Care to elaborate on that comment?
Btw without proper test cases and without proper debugging procedures hundreds or thousands of people testing the latest code every day is meaningless...
Left by Rawhide
Posted Jul 16, 2012 21:29 UTC (Mon) by louie (subscriber, #3285)
People testing the code gives you data on the parts of the software that people actually use. That's certainly not perfect, and shouldn't be the end-all/be-all of testing, but having people use and report back on the parts that get used is absolutely the best software testing methodology there is, period.
Posted Jul 16, 2012 21:34 UTC (Mon) by johannbg (subscriber, #65743)
Posted Jul 16, 2012 21:53 UTC (Mon) by louie (subscriber, #3285)
Hundreds or thousands of people testing the code is never, ever meaningless. If you think it is, your QA processes are broken.
Posted Jul 23, 2012 11:06 UTC (Mon) by gmatht (guest, #58961)
Posted Jul 17, 2012 0:02 UTC (Tue) by rgmoore (✭ supporter ✭, #75)
Users and test cases are different and provide different kinds of information. Test cases are great because they provide reliable, high quality information, but they're limited; nobody has enough resources to test every configuration their users are going to try out. User reports are messy, but they're documentation of real problems that your QA has to fix. The continued existence of user error reports is proof that the kind of disciplined testing represented by proper test cases and debugging procedures is inadequate. If it were enough, no problems would ever get through for users to find them.
Copyright © 2013, Eklektix, Inc.
Comments and public postings are copyrighted by their creators.
Linux is a registered trademark of Linus Torvalds