Part of the problem is the explosion of storage-to-memory ratio. 15 years ago I had a computer with 20 times more storage than memory. Now I have a thousand times more storage than memory. It takes extra memory just to manage a filesystem that scales up to that size.