Received: by 10.224.189.75 with SMTP id dd11mr1961834qab.6.1348052416151; Wed, 19 Sep 2012 04:00:16 -0700 (PDT)
Received: by 10.236.176.103 with SMTP id a67mr531710yhm.2.1348052416122; Wed, 19 Sep 2012 04:00:16 -0700 (PDT)
Path: csiph.com!v102.xanadu-bbs.net!xanadu-bbs.net!news.glorb.com!i6no7166qas.0!news-out.google.com!t12ni22361614qak.0!nntp.google.com!i6no14024qas.0!postnews.google.com!glegroupsg2000goo.googlegroups.com!not-for-mail
Newsgroups: comp.lang.java.programmer
Date: Wed, 19 Sep 2012 04:00:15 -0700 (PDT)
In-Reply-To: <bd933ace-5641-4711-9105-4e949a602b87@c1g2000yqe.googlegroups.com>
Complaints-To: groups-abuse@google.com
Injection-Info: glegroupsg2000goo.googlegroups.com; posting-host=89.174.214.74; posting-account=o_LM-AoAAADS-gmg6zKExRyjN883wJES
NNTP-Posting-Host: 89.174.214.74
References: <bd933ace-5641-4711-9105-4e949a602b87@c1g2000yqe.googlegroups.com>
User-Agent: G2/1.0
MIME-Version: 1.0
Message-ID: <c2b6062c-e336-4087-8e50-d3ab944b5cbb@googlegroups.com>
Subject: Re: analysis of java application logs
From: Krzysztof <krzysztof.otrebski@gmail.com>
Injection-Date: Wed, 19 Sep 2012 11:00:16 +0000
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable
Xref: csiph.com comp.lang.java.programmer:18847

W dniu poniedzia=C5=82ek, 23 maja 2011 09:50:54 UTC+2 u=C5=BCytkownik Ulric=
h Scholz napisa=C5=82:
> Hi,
>=20
> I'm looking for an approach to the problem of analyzing application
> log files.
>=20
> I need to analyse Java log files from applications (i.e., not logs of
> web servers). These logs contain Java exceptions, thread dumps, and
> free-form log4j messages issued by log statements inserted by
> programmers during development. Right now, these man-made log entries
> do not have any specific format.
>=20
> What I'm looking for is a tool and/or strategy that supports in lexing/
> parsing, tagging, and analysing the log entries. Because there is only
> little defined syntax and grammar - and because you might not know
> what you are looking for - the task requires the quick issuing of
> queries against the log data base. Some sort of visualization would be
> nice, too.
>=20
> Pointers to existing tools and approaches as well as appropriate tools/
> algorithms to develop the required system would be welcome.
>=20
> Ulrich

I'm using OtrosLogViewer http://code.google.com/p/otroslogviewer with batch=
 processing https://code.google.com/p/otroslogviewer/wiki/BatchProcessing. =
Following method of your log processing logic is called when log event is p=
arsed.
 logDataParsed(LogData data, BatchProcessingContext context);
Additionally you are notified when processing is started/finished.

Krzysztof.