Re: From logging to files to a better solution: syslog, Sentry, Logstash, ....

Path	csiph.com!eternal-september.org!feeder.eternal-september.org!border1.nntp.ams1.giganews.com!nntp.giganews.com!newsfeed.xs4all.nl!newsfeed7.news.xs4all.nl!nzpost1.xs4all.net!not-for-mail
Return-Path	<python-python-list@m.gmane.org>
X-Original-To	python-list@python.org
Delivered-To	python-list@mail.python.org
X-Spam-Status	OK 0.001
X-Spam-Evidence	'H': 1.00; 'S': 0.00; 'handler': 0.04; 'messages.': 0.04; ':-(': 0.07; 'framework.': 0.07; 'events.': 0.09; 'files:': 0.09; 'received:80.91': 0.09; 'received:80.91.229': 0.09; 'received:gmane.org': 0.09; 'received:list': 0.09; 'subject:files': 0.09; 'stored': 0.10; 'python': 0.10; 'ignore': 0.14; '...)': 0.16; 'received:80.91.229.3': 0.16; 'received:dip0.t-ipconnect.de': 0.16; 'received:plane.gmane.org': 0.16; 'received:t-ipconnect.de': 0.16; 'soup': 0.16; 'unhappy': 0.16; 'solution.': 0.18; '2015': 0.20; 'handles': 0.20; 'latter': 0.22; 'parse': 0.22; 'header :User-Agent:1': 0.26; 'header:X-Complaints-To:1': 0.26; 'define': 0.27; 'logging': 0.27; 'host.': 0.29; 'thus,': 0.29; 'handled': 0.29; 'another': 0.32; 'choices': 0.33; 'doubt': 0.33; 'file': 0.34; 'info': 0.34; 'could': 0.35; 'filter': 0.35; 'quite': 0.35; 'level': 0.35; 'remote': 0.35; 'but': 0.36; 'too': 0.36; 'there': 0.36; '(and': 0.36; 'to:addr:python-list': 0.36; 'subject:: ': 0.37; 'received:org': 0.37; 'log': 0.38; 'why': 0.39; 'easily': 0.39; 'to:addr:python.org': 0.40; 'received:de': 0.40; 'easy': 0.60; 'your': 0.60; 'skip:u 10': 0.61; 'above,': 0.63; 'thomas': 0.63; 'more': 0.63; 'different': 0.63; 'received:217': 0.66; 'therefore': 0.67; 'subject:From': 0.97; 'serious': 0.97
X-Injected-Via-Gmane	http://gmane.org/
To	python-list@python.org
From	dieter <dieter@handshake.de>
Subject	Re: From logging to files to a better solution: syslog, Sentry, Logstash, ....
Date	Sat, 12 Sep 2015 08:36:37 +0200
References	<5c1f52f5-59d2-48dd-b2e8-3a907a517261@googlegroups.com> <mailman.309.1441867332.8327.python-list@python.org> <e4146cbb-ce6e-47d0-9467-a585c80cac8d@googlegroups.com>
Mime-Version	1.0
Content-Type	text/plain; charset=iso-8859-1
Content-Transfer-Encoding	8bit
X-Gmane-NNTP-Posting-Host	pd9e09ede.dip0.t-ipconnect.de
User-Agent	Gnus/5.1008 (Gnus v5.10.8) XEmacs/21.4.22 (linux)
Cancel-Lock	sha1:uElYHtZjq20sjr9NDVGAJEnU6vY=
X-BeenThere	python-list@python.org
X-Mailman-Version	2.1.20+
Precedence	list
List-Id	General discussion list for the Python programming language <python-list.python.org>
List-Unsubscribe	<https://mail.python.org/mailman/options/python-list>, <mailto:python-list-request@python.org?subject=unsubscribe>
List-Archive	<http://mail.python.org/pipermail/python-list/>
List-Post	<mailto:python-list@python.org>
List-Help	<mailto:python-list-request@python.org?subject=help>
List-Subscribe	<https://mail.python.org/mailman/listinfo/python-list>, <mailto:python-list-request@python.org?subject=subscribe>
Newsgroups	comp.lang.python
Message-ID	<mailman.422.1442039812.8327.python-list@python.org> (permalink)
Lines	41
NNTP-Posting-Host	2001:888:2000:d::a6
X-Trace	1442039812 news.xs4all.nl 23826 [2001:888:2000:d::a6]:50789
X-Complaints-To	abuse@xs4all.nl
Xref	csiph.com comp.lang.python:96417

Show key headers only | View raw

Thomas Güttler <hv@tbz-pariv.de> writes:

> Am Donnerstag, 10. September 2015 08:42:47 UTC+2 schrieb dieter:
>> Thomas Güttler writes:
>> > ...
>> > Why we are unhappy with logging to files:
>> >
>> >  - filtering: We don't want to get INFO messages over the VPN.
>> 
>> You can quite easily control at what level messages are logged with
>> the standard Python logging framework. Each handler has a level
>> and will ignore messages at a lower level.
>
>
> I want INFO to be logged and stored on the remote host.
> Therefore I must not filter INFO messages.
>
> I don't want to pull INFO messages over the VPN.

Thus, you could define one handler which logs at INFO level and
another one which logs at WARNING level. The latter handler
would log only WARNING and more serious events.

> ...
> Yes, there are tools to parse that soup. But why create this soup in 
> the first place?
>
> That's why I want to move from file based logging to a different solution.

As you have explained above, you need this "soup" (both INFO messages
as well as messages above WARNING level - but handled differently).

Define an additional handler which handles "WARNING" (and above).
This is easy with Zope (I do not know for Django).

> Unfortunately there too many choices (graylog, logstash, sentry, ...) :-(

I do not know any of them - but I doubt that they will help you much to
untangle your "soup".

Back to comp.lang.python | Previous | Next — Previous in thread | Find similar | Unroll thread

Thread

From logging to files to a better solution: syslog, Sentry, Logstash, .... Thomas Güttler <hv@tbz-pariv.de> - 2015-09-09 01:33 -0700
  Re: From logging to files to a better solution: syslog, Sentry, Logstash, .... dieter <dieter@handshake.de> - 2015-09-10 08:41 +0200
    Re: From logging to files to a better solution: syslog, Sentry, Logstash, .... Thomas Güttler <hv@tbz-pariv.de> - 2015-09-11 00:22 -0700
      Re: From logging to files to a better solution: syslog, Sentry, Logstash, .... marco.nawijn@colosso.nl - 2015-09-11 01:17 -0700
        Re: From logging to files to a better solution: syslog, Sentry, Logstash, .... Thomas Güttler <hv@tbz-pariv.de> - 2015-09-15 02:37 -0700
      Re: From logging to files to a better solution: syslog, Sentry, Logstash, .... jmp <jeanmichel@sequans.com> - 2015-09-11 11:02 +0200
        Re: From logging to files to a better solution: syslog, Sentry, Logstash, .... Thomas Güttler <hv@tbz-pariv.de> - 2015-09-15 02:35 -0700
          Re: From logging to files to a better solution: syslog, Sentry, Logstash, .... jmp <jeanmichel@sequans.com> - 2015-09-15 16:36 +0200
          Re: From logging to files to a better solution: syslog, Sentry, Logstash, .... dieter <dieter@handshake.de> - 2015-09-16 07:57 +0200
            Re: From logging to files to a better solution: syslog, Sentry, Logstash, .... Thomas Güttler <hv@tbz-pariv.de> - 2015-09-16 01:31 -0700
      Re: From logging to files to a better solution: syslog, Sentry, Logstash, .... dieter <dieter@handshake.de> - 2015-09-12 08:36 +0200

csiph-web