Re: Daemon strategy

Path	csiph.com!fu-berlin.de!uni-berlin.de!not-for-mail
From	paul.hermeneutic@gmail.com
Newsgroups	comp.lang.python
Subject	Re: Daemon strategy
Date	Fri, 5 Feb 2016 12:36:14 -0700
Lines	44
Message-ID	<mailman.12.1454701003.2317.python-list@python.org> (permalink)
References	<CAJ4+4apHhfYBw33xVsG_dFbf9iEGfiiimh0mHCq=LGo0d96yWg@mail.gmail.com> <85d1sb9eh7.fsf@benfinney.id.au>
Mime-Version	1.0
Content-Type	text/plain; charset=UTF-8
Content-Transfer-Encoding	quoted-printable
X-Trace	news.uni-berlin.de hn99SAaBxDpvMq17RtBVfAn04lb1sH1VXVD0rqkqDsYw==
Return-Path	<paul.hermeneutic@gmail.com>
X-Original-To	python-list@python.org
Delivered-To	python-list@mail.python.org
X-Spam-Status	OK 0.062
X-Spam-Evidence	'H': 0.88; 'S': 0.00; 'budget.': 0.07; 'lines.': 0.07; 'percentage': 0.09; '2016': 0.16; '8bit%:32': 0.16; 'low.': 0.16; 'received:io': 0.16; 'received:psf.io': 0.16; 'subject:strategy': 0.16; 'wrote:': 0.16; 'memory': 0.17; 'load': 0.20; 'windows': 0.20; 'machine': 0.21; 'am,': 0.23; 'appears': 0.23; 'feb': 0.23; 'specified': 0.23; 'unix': 0.24; 'header:In- Reply-To:1': 0.24; 'command': 0.26; 'fri,': 0.27; 'message- id:@mail.gmail.com': 0.27; 'specify': 0.27; 'correct': 0.28; 'btw,': 0.29; 'cpu': 0.29; 'environment': 0.29; 'that.': 0.30; 'task': 0.30; "can't": 0.32; 'realize': 0.32; 'getting': 0.33; 'run': 0.33; 'usually': 0.33; 'windows.': 0.33; 'add': 0.34; 'that,': 0.34; 'list': 0.34; 'received:google.com': 0.35; 'installing': 0.35; 'tasks': 0.35; 'but': 0.36; 'received:209.85': 0.36; 'loaded': 0.36; 'to:addr:python-list': 0.36; 'subject:: ': 0.37; 'responsible': 0.37; 'being': 0.37; 'done.': 0.37; 'thought': 0.37; 'things': 0.38; 'monitor': 0.38; 'received:209': 0.38; 'delete': 0.38; 'wrong': 0.38; 'mean': 0.38; 'does': 0.39; 'to:addr:python.org': 0.40; 'some': 0.40; 'from:no real name:2**0': 0.60; 'email addr:gmail.com': 0.62; 'more': 0.63; 'within': 0.64; 'goal': 0.64; 'bmc': 0.66; 'skip:\xe2 10': 0.70; 'facilities': 0.72; 'bandwidth.': 0.84; 'high-end': 0.84; 'hope.': 0.84; 'imagine,': 0.84; 'lacks': 0.84; 'pip': 0.84
DKIM-Signature	v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :content-type:content-transfer-encoding; bh=Hs3XLInQ3VYVBuVsuKkuVaTSSgPgTvOxVUOZ5H39x+M=; b=qN5gUlVbR2xxKaEQvRwbpSiOT/AI9e6DJAv97Moap4C2PioYpFUugHYQl0ZEPCd436 y/eLVoeuttUbnRQLMoH3EesLu5qtvCMjyWitNV9rjiOroU4FeAis6ZeK0fbXN9unZDah tkmBlEopuvbaSEU4hTSjlTSkwpsconiLAYHHcDVEVF3bqs8BF71xvOu6y1bV3Jh+dWc9 425P3n9+MSMRT1wjVUkIxSl84RnFoxgSM86ixbAieZXPvM9+E3HhPJnyohW3jYkQo/xX gQ/hcQ6RDFwO+kyqaCyFKdekkUi4Uyzx1lT0vxDPQ8nT9dC1dwbS19Hid04dJ2b7yj1c /4yQ==
X-Google-DKIM-Signature	v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:content-type:content-transfer-encoding; bh=Hs3XLInQ3VYVBuVsuKkuVaTSSgPgTvOxVUOZ5H39x+M=; b=bye9wTD7znOOBzI8hLCRi3pYmMYhAKkmiXPYfxuIrn4tuXzz2gLsj2vvds34uQ4RZs 8tZV8oT0Umh6qrEK/J7hinYEATZ65XkKPCMiH/0kjLvxp7MYs/j5pCLuGxL+gJiKeJPH ogLL+AtGDDRWkpx0mK45BU/gi4nYy6REqvzyxyTaUpI1R3LYObdaUQpCs5+ROR12arGo jMfpy01NNnF5gJdy8FYWSHm9W15973aHGlxBZ7m2af311DwDrOd9kd1/c3AANmS0OxhV jVJ6uRS36cYF5+Ijs7r7ztEYxlvJw0rN0u9NfTzIHy5GvSGjpjXsLUSE0DeQpDLIVENq O2NQ==
X-Gm-Message-State	AG10YOQB4pl0gx0bzaUkhk+hagUA6qgZMB6G0zAa12aq/CW+PXJPQDrVdUB6+QxsoYGsjkZhPJRcV/xRmRKNbg==
X-Received	by 10.25.88.9 with SMTP id m9mr1844986lfb.137.1454700995037; Fri, 05 Feb 2016 11:36:35 -0800 (PST)
In-Reply-To	<85d1sb9eh7.fsf@benfinney.id.au>
X-BeenThere	python-list@python.org
X-Mailman-Version	2.1.21rc2
Precedence	list
List-Id	General discussion list for the Python programming language <python-list.python.org>
List-Unsubscribe	<https://mail.python.org/mailman/options/python-list>, <mailto:python-list-request@python.org?subject=unsubscribe>
List-Archive	<http://mail.python.org/pipermail/python-list/>
List-Post	<mailto:python-list@python.org>
List-Help	<mailto:python-list-request@python.org?subject=help>
List-Subscribe	<https://mail.python.org/mailman/listinfo/python-list>, <mailto:python-list-request@python.org?subject=subscribe>
Xref	csiph.com comp.lang.python:102545

Show key headers only | View raw

On Fri, Feb 5, 2016 at 11:52 AM, Ben Finney <ben+python@benfinney.id.au> wrote:
> paul.hermeneutic@gmail.com writes:
>
>> It appears that python-deamon would be exactly what I need. Alas,
>> appears not to run on Windows. If I am wrong about that, please tell
>> me.
>
> You're correct that ‘python-daemon’ uses Unix facilities to create a
> well-behaved Unix daemon process.
>
> Since MS Windows lacks those facilities, ‘python-daemon’ can't use them.

As you might imagine, I am not always able to specify which OS is
deployed. That does not mean that I am not responsible for getting the
work done. Perhaps you will tell me that what I want is not a daemon.

BTW, I thought that pip would know that python-daemon would not run on
my machine, but it had no complaints installing it. That gave me
unmerited hope.

I want to create a program that will run a list of command lines. Some
of the tasks might take 42 milliseconds, but others might take 4.2
hours. I need to be able to:

- list the tasks currently being run
- kill a task that is currently being run
- list the tasks that are not yet run
- delete a task not yet run from the list
- add tasks to the list

The goal is to load the machine up to a specified percentage of
CPU/memory/io bandwidth. I want to keep the machine loaded up to 90%
of capacity. It is important to monitor more than just CPU utilization
because the machine may already be over-committed on memory while CPU
utilization is low. Adding more processes in such an environment just
makes the system go slower.

I realize that high-end schedulers like IBM/Tivoli, CA7, and BMC might
do things like that. Those are not usually within budget.

Is a daemon what I need? Any other suggestions?

Back to comp.lang.python | Previous | Next | Find similar | Unroll thread

Thread

Re: Daemon strategy paul.hermeneutic@gmail.com - 2016-02-05 12:36 -0700

csiph-web