Had another demo driver for S3
Had another demo driver for S3
Posted Sep 3, 2022 15:54 UTC (Sat) by rwmj (subscriber, #5474)In reply to: Had another demo driver for S3 by dacut
Parent article: Crash recovery for user-space block drivers
I don't think it's possible to write an efficient S3 driver to store an ordinary (eg. ext4) filesystem without a very large amount of local caching. The natural block size for S3 is very large (128K?) but if you try to create a naive filesystem with that block size it most likely won't work at all and if it did will break assumptions about small blocks that filesystem developers make.
Anyway, here's our attempt: https://libguestfs.org/nbdkit-S3-plugin.1.html It's written in Python and apparently used somewhat widely (judging by bug reports etc).