Re: file like, regular expression driven, content splitter

J G Miller wrote:
On Friday, December 2nd, 2011, at 00:47:58h -0800, Markus asked:

Is there something like that (or simillar) possible in Linux?

Not with a virtual file,

You CAN open the logfile for reading and wait on its extension - as 'tail -f' does - and then analyse if not in real time, certainly at no great elapsed time.

Thst how I would do itk using a daemon written in C.. and NO REGEXPS. I'd just go looking for the patterns using custom code and string library functions.

Such a daemon could write other log files.
..


but just using the actual log file for analysis --
take a look at Analog, AWstats, W3Perl, Webalizer and see if one of those
can be easily modified to take the regular expressions you need to use.

Or if you just want something very simple with no fancy interface,
take a look at logwatch which will do what you want from the command line
interface.

<http://sourceforge.NET/projects/logwatch/>


If you require something more "industrial strength" for reporting
on log files, then consider SNARE which is open source and can
be installed from source files --

<http://www.intersectalliance.COM/projects/SnareLinux/>

Perhaps too much choice, rather than too little?

.

Relevant Pages

  • Re: Log Analysis
    ... > Are any of you aware of a tool that will allow an administrator to analyse ... > log files and produce statistics based on the log content. ... > I want something preferably in real time with a gui/html interface. ...
    (Security-Basics)
  • Re: reading log files in real time
    ... > I'm looking for a way to read log files in real time, ... The sender therefore does ... > this message which arise as a result of e-mail transmission. ...
    (perl.beginners)
  • Re: analysis of java application logs
    ... I need to analyse Java log files from applications (i.e., ... These logs contain Java exceptions, thread dumps, and ... log statements) and write what you found into a relational database. ...
    (comp.lang.java.programmer)
  • reading log files in real time
    ... I'm looking for a way to read log files in real time, ... E-mail transmission cannot be guaranteed to be secure or error-free as ... The sender therefore does ...
    (perl.beginners)
  • Re: analysis of java application logs
    ... I need to analyse Java log files from applications (i.e., ... There are those who advocate awk for this sort of thing, but frankly that seems like overkill. ...
    (comp.lang.java.programmer)