Linux lacks testing methodologies (NewsForge)

[Posted April 30, 2004 by ris]

NewsForge covers efforts at OSDL to get application vendors to test their products, and to share both methods and results. "OSDL lab manager and open source test-giver Tim Witham is on a mission to push Linux performance testing to higher-level, real-world applications, to produce reliable, retestable, comparable data that will let users compare the operating systems or open source applications in a transparent fashion."

Linux lacks testing methodologies (NewsForge)

Posted May 1, 2004 2:36 UTC (Sat) by error27 (subscriber, #8346) [Link]

I think it's important to talk about benchmarking vs reliability testing and testing for developers vs for administrators. This article is focussed on benchmarking.

Developers are foces on changing tiny things one at a time. Developers ask, "Is there a speed up from making a function inline or does that trash the cache and cause cache misses?" Administrators are thinking about the over all picture. "How does 2.4 database performance compare to 2.6." For a developer, this is too general to be usefull.

The admin benchmark that Mindcraft had an effect and generated some new code. Other than that, most admin benchmarks are pretty boring.