Compress data, gain performance [LWN.net]

Compress data, gain performance

Posted Feb 5, 2007 14:30 UTC (Mon) by dvdeug (subscriber, #10998)
In reply to: Compress data, gain performance by daney
Parent article: Embedded Linux: Using Compressed File Systems

But where's the line? Ignoring the outliers, I strongly suspect that the 97% of users running fairly close to off-the-shelf Intel/AMD boxes all fall into the same category, and I suspect that those running on other fairly modern off-the-shelf hardware also fall in the same boat. There's thousands of issues where it's possible that the choice may not be optimal for odd hardware, but it's far easier and more efficient to pick a standard choice than have every user check their system.

to post comments

Compress data, gain performance

Posted Feb 9, 2007 11:54 UTC (Fri) by robbe (guest, #16131) [Link]

Remember that this article talks about "Embedded Linux", so your CPU is
typically puny in comparison with the CPUs you seem to think of.
Furthermore, the "disk" is often flash memory: slower than DRAM, but much
faster than a harddisk.

Benchmark results for various compressed vs. standard filesystems on a
laptop (i.e. slow mass media, fast CPU) was linked to in the article:
http://tree.celinuxforum.org/CelfPubWiki/SquashFsComparisons

My guess is that the dividing line lies between desktop/laptop and
embedded machines.

I suspect what is holding back compression as a standard fs feature in
desktop/laptop systems is the complexity of fragmentation-avoidance in
the write-often case, and that the really big data (images, films, music)
is often compressed anyway (and by means better than general purpose
algorithms can offer).