Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]

Groups > comp.lang.python > #62972 > unrolled thread

Suggest an open-source log analyser?

Back to article view | Back to comp.lang.python

Contents

  Suggest an open-source log analyser? Alec Taylor <alec.taylor6@gmail.com> - 2014-01-02 16:40 +1100
    Re: Suggest an open-source log analyser? Roy Smith <roy@panix.com> - 2014-01-02 00:48 -0500
    Re: Suggest an open-source log analyser? Walter Hurry <walterhurry@lavabit.com> - 2014-01-04 06:35 +0000
      Re: Suggest an open-source log analyser? Alec Taylor <alec.taylor6@gmail.com> - 2014-01-05 14:50 +1100
      Re: Suggest an open-source log analyser? Alec Taylor <alec.taylor6@gmail.com> - 2014-01-09 03:46 +1100

#62972 — Suggest an open-source log analyser?

I use the Python logger class; with the example syntax of:
    Formatter('%(asctime)s - %(name)s - %(levelname)s - %(message)s')

Can of course easily use e.g.: a JSON syntax here instead.

Are there any open-source log viewers (e.g.: with a web-interface)
that you'd recommend; for drilling down into my logs?

Thanks for your suggestions,

Alec Taylor

[toc] | [next] | [standalone]

#62973

In article <mailman.4787.1388641227.18130.python-list@python.org>,
 Alec Taylor <alec.taylor6@gmail.com> wrote:

> I use the Python logger class; with the example syntax of:
>     Formatter('%(asctime)s - %(name)s - %(levelname)s - %(message)s')
> 
> Can of course easily use e.g.: a JSON syntax here instead.
> 
> Are there any open-source log viewers (e.g.: with a web-interface)
> that you'd recommend; for drilling down into my logs?
> 
> Thanks for your suggestions,
> 
> Alec Taylor

I've been experimenting with elasticsearch (to store JSON-format log 
messages) and kibana (as a front-end search tool).  The jury is still 
out on how well it's going to work.  It seems like a pretty powerful 
combination, but there's definitely a bit of a learning curve to using 
it.

I certainly like the idea of logging structured data, as opposed to 
plain text.  It opens up a world of better ways to search, slice, and 
dice your log data.

[toc] | [prev] | [next] | [standalone]

#63112

On Thu, 02 Jan 2014 16:40:19 +1100, Alec Taylor wrote:

> I use the Python logger class; with the example syntax of:
>     Formatter('%(asctime)s - %(name)s - %(levelname)s - %(message)s')
> 
> Can of course easily use e.g.: a JSON syntax here instead.
> 
> Are there any open-source log viewers (e.g.: with a web-interface)
> that you'd recommend; for drilling down into my logs?
> 
If you want to do in-depth analysis, why not just stick it into an SQL 
database; e.g. SQLite or Postgres?

[toc] | [prev] | [next] | [standalone]

#63166

Because I'm thinking that something with a much less expressive query
interface would serve me better in the long run... e.g.: Redis or
maybe Hadoop

On Sat, Jan 4, 2014 at 5:35 PM, Walter Hurry <walterhurry@lavabit.com> wrote:
> On Thu, 02 Jan 2014 16:40:19 +1100, Alec Taylor wrote:
>
>> I use the Python logger class; with the example syntax of:
>>     Formatter('%(asctime)s - %(name)s - %(levelname)s - %(message)s')
>>
>> Can of course easily use e.g.: a JSON syntax here instead.
>>
>> Are there any open-source log viewers (e.g.: with a web-interface)
>> that you'd recommend; for drilling down into my logs?
>>
> If you want to do in-depth analysis, why not just stick it into an SQL
> database; e.g. SQLite or Postgres?
>
> --
> https://mail.python.org/mailman/listinfo/python-list

[toc] | [prev] | [next] | [standalone]

#63495

So yeah, if you know of a good one; please share.

Thanks

On Sun, Jan 5, 2014 at 2:50 PM, Alec Taylor <alec.taylor6@gmail.com> wrote:
> Because I'm thinking that something with a much less expressive query
> interface would serve me better in the long run... e.g.: Redis or
> maybe Hadoop
>
> On Sat, Jan 4, 2014 at 5:35 PM, Walter Hurry <walterhurry@lavabit.com> wrote:
>> On Thu, 02 Jan 2014 16:40:19 +1100, Alec Taylor wrote:
>>
>>> I use the Python logger class; with the example syntax of:
>>>     Formatter('%(asctime)s - %(name)s - %(levelname)s - %(message)s')
>>>
>>> Can of course easily use e.g.: a JSON syntax here instead.
>>>
>>> Are there any open-source log viewers (e.g.: with a web-interface)
>>> that you'd recommend; for drilling down into my logs?
>>>
>> If you want to do in-depth analysis, why not just stick it into an SQL
>> database; e.g. SQLite or Postgres?
>>
>> --
>> https://mail.python.org/mailman/listinfo/python-list

[toc] | [prev] | [standalone]

Back to top | Article view | comp.lang.python

csiph-web