This isn't a particularly well-conducted test.
Most notably:
- They measure power draw under load without measuring performance. A configuration that
simply went slower and required more power in total (due to greater time requirements) to
complete a task would thus "win" their test.
- They used the "power saver" instead of "balanced" profile for 2008 server, which is a poor
choice for a server under any circumstances and may even use *more* power to complete a given
job because it can prevent the CPU from spiking to max performance to finish a job quickly.
- Their "load" test was scripted email generation not something actually likely to make a
modern server work like a file or database server load generator. I guess if it was
virus-scanning and spam-checking vast piles of mail...
- They don't seem to know that CPUs, including server CPUs, supported the HLT instruction for
reduced CPU power draw well before frequency and voltage stepping arrived on the scene even
for laptops. Servers haven't run on full-tilt power max when idle for a *long* time, but they
seem to think they do.
- They fall for the all-too-common pretty but misleading non-zero-y-origin graph trap.
- Their results aren't really very significant anyway. Given their poor methodology I'd say
they're close to useless.
A more useful test would've defined jobs to do (100 loops of this database load test; process
1 million spam-filtered and virus-scanned emails; etc). It would measure total energy (joules)
consumed to complete the task in various power modes. It would then ALSO consider idle draw
and full-tilt peak draw - both of which matter for, among other things, cooling needs - as
secondary concerns.
That said, with virtualized servers becoming more popular and most VM environments crippling
power management peak draw is certainly a concern when evaluating the hardware (if not the
OS).
Posted Jun 9, 2008 18:37 UTC (Mon) by sbishop (guest, #33061)
[Link]
I agree.
It also seems that the results of the "active tests" would be heavily dependent on the power
efficiency of the email applications being used. (Sendmail and procmail versus Exchange
Server, in this case.)
Apache on Linux versus Apache on Windows versus IIS on Windows would be a much more
interesting comparison, I think.
Linux captures the 'green' flag, beats Windows 2008 power-saving measures (Network World)
Posted Jun 10, 2008 12:56 UTC (Tue) by clugstj (subscriber, #4020)
[Link]
I would have to somewhat disagree with some of your points. The server sits there drawing
power regardless of raw performance. So, unless it can't keep up with its workload, it would
make sense to run the CPU slower if that would result in an overall energy savings.
Linux captures the 'green' flag, beats Windows 2008 power-saving measures (Network World)
Posted Jun 10, 2008 21:09 UTC (Tue) by endecotp (guest, #36428)
[Link]
> most VM environments crippling power management
Could you elaborate on that?