Sponsored link Serve your customers, not your servers, with VERIO Linux VPS. Full-access test-drive here. |
How to use a terabyte of RAMHow to use a terabyte of RAMPosted Mar 13, 2008 15:51 UTC (Thu) by i3839 (subscriber, #31386)In reply to: How to use a terabyte of RAM by davecb Parent article: How to use a terabyte of RAM
> then a logging filesystem can > reorder and coalesce them The IO scheduler does exactly that already (also for reads). But the problem is that the writing order is very important quite often. > Alternatively, one could have an intermediate > layer which the memory filesystem could pass > operations to, which could do optimizations like > doing all directory operations asap and in-order > and delaying all file writes until close or > a certain large size had accumulated, then > writing teh whole file in one fell swoop. This sounds like the dirsync mount option and the current file caching that happens at the VM level. Currently all file operations happen on files cached in RAM. Disk IO is only done for reads for uncached files and writes explicitly requested by user space (sync), by the VM because of memory pressure, or because a time out triggered and it's time to write the written data also to disk. At which point enough data can be gathered so that there is actually anything to coalesce and reorder by the IO scheduler.
(Log in to post comments)
How to use a terabyte of RAM Posted Mar 13, 2008 18:07 UTC (Thu) by davecb (subscriber, #1574) [Link] Dirsync is somewhat similar, except it's used to guarantee the write completes serially and synchronously. It's therefor a performance pessimization, somewhat like the sync mount option (;-)) I was just talking about the need to request directory updates as they come in and in order, as opposed to delaying and reordering them. Ian's thesis actualy went into the degree to which one could delay and reorder directory writes, but I didn't want to add that complexity to a very short email. --dave
|
Copyright © 2008, Eklektix, Inc.
Comments and public postings are copyrighted by their creators.
Linux is a registered trademark of Linus Torvalds
Powered by Rackspace Managed Hosting.