Path: csiph.com!x330-a1.tempe.blueboxinc.net!newsfeed.hal-mli.net!feeder1.hal-mli.net!border3.nntp.dca.giganews.com!border1.nntp.dca.giganews.com!nntp.giganews.com!postnews.google.com!c1g2000yqe.googlegroups.com!not-for-mail From: Ulrich Scholz Newsgroups: comp.lang.java.programmer Subject: analysis of java application logs Date: Mon, 23 May 2011 00:50:54 -0700 (PDT) Organization: http://groups.google.com Lines: 22 Message-ID: NNTP-Posting-Host: 62.156.183.195 Mime-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 X-Trace: posting.google.com 1306137055 29987 127.0.0.1 (23 May 2011 07:50:55 GMT) X-Complaints-To: groups-abuse@google.com NNTP-Posting-Date: Mon, 23 May 2011 07:50:55 +0000 (UTC) Complaints-To: groups-abuse@google.com Injection-Info: c1g2000yqe.googlegroups.com; posting-host=62.156.183.195; posting-account=6nLwcwoAAACyuDWy5iNg9hYCXPlbqduH User-Agent: G2/1.0 X-HTTP-UserAgent: Mozilla/5.0 (Windows NT 6.1; rv:2.0.1) Gecko/20100101 Firefox/4.0.1,gzip(gfe) Xref: x330-a1.tempe.blueboxinc.net comp.lang.java.programmer:4442 Hi, I'm looking for an approach to the problem of analyzing application log files. I need to analyse Java log files from applications (i.e., not logs of web servers). These logs contain Java exceptions, thread dumps, and free-form log4j messages issued by log statements inserted by programmers during development. Right now, these man-made log entries do not have any specific format. What I'm looking for is a tool and/or strategy that supports in lexing/ parsing, tagging, and analysing the log entries. Because there is only little defined syntax and grammar - and because you might not know what you are looking for - the task requires the quick issuing of queries against the log data base. Some sort of visualization would be nice, too. Pointers to existing tools and approaches as well as appropriate tools/ algorithms to develop the required system would be welcome. Ulrich