LWN.net Logo

The Journal - a proposed syslog replacement

The Journal - a proposed syslog replacement

Posted Nov 18, 2011 21:37 UTC (Fri) by b0ti (guest, #81465)
In reply to: The Journal - a proposed syslog replacement by jimreynold2nd
Parent article: The Journal - a proposed syslog replacement

> But then I don't get why the logs need to be in a undocumented binary format, inaccessible to anything else.
Because with this you can achieve a lot higher compression ratio if you store metadata separately. Even higher than using bzip2 on the xml or json. Not to mention lookup and search performance on very large datasets.

It would be nice to have different back-ends for this though. Since you only get an API to access it anyway, the storage format could be made transparent.


(Log in to post comments)

The Journal - a proposed syslog replacement

Posted Nov 18, 2011 22:55 UTC (Fri) by rfunk (subscriber, #4054) [Link]

Of all the limited resources involved in computing, disk space is by far the cheapest these days.

The Journal - a proposed syslog replacement

Posted Nov 18, 2011 23:06 UTC (Fri) by b0ti (guest, #81465) [Link]

With compression you not only benefit in the disk space required but also it will speed up I/O by letting the CPU work a little.

The Journal - a proposed syslog replacement

Posted Nov 19, 2011 8:42 UTC (Sat) by aleXXX (subscriber, #2742) [Link]

Are you sure it is worth it to spend time on working to reduce the size of log files on disk ???
I don't think so.

Keep it simple.
Text files rule. Or XML or JSON. But keep it text.

Alex

Copyright © 2013, Eklektix, Inc.
Comments and public postings are copyrighted by their creators.
Linux is a registered trademark of Linus Torvalds