Managing Rich Data Structures (O'Reilly) [LWN.net]

Dave Baker uses perl to work with Rich Data Structures on O'Reilly. "If you're like me, you've written plenty of scripts that use simple text files to store snippets of data. Those scripts might have evolved over time into using several snippets of data for each item, which translates into lots and lots of little text files in a data directory somewhere. After reading that Linux doesn't like more than a hundred or so text files per directory, and thinking about the amount of space wasted on my hard drive due to the small size of the snippets compared to the size of a sector and the hassle of all those little files when making a backup, I decided to move from snippets to a single database. Here's how I did it."

(Log in to post comments)

Managing Rich Data Structures (O'Reilly)

Posted Mar 4, 2006 22:58 UTC (Sat) by alspnost (guest, #2763) [Link]

"Linux doesn't like more than 100 or so text files per directory"? Is he serious? This surely can't be true with any modern version of the system. I thought tens of thousands was more like it, with current filesystems!