Path: csiph.com!usenet.pasdenom.info!news.redatomik.org!newsfeed.xs4all.nl!newsfeed3a.news.xs4all.nl!xs4all!post.news.xs4all.nl!not-for-mail
MIME-Version: 1.0
In-Reply-To: <8A3659BC-9100-4A3A-9117-47227B3D290B@gmail.com>
References: <33677AE8-B2FA-49F9-9304-C8D93784255D@gmail.com> <CAPTjJmpEHQV2PpaZvszuTGn0_GNg0sWV6aLenbQsZrSXCy2YKQ@mail.gmail.com> <mailman.18957.1424524392.18130.python-list@python.org> <mcargl$h3k$1@reader1.panix.com> <mailman.19008.1424611304.18130.python-list@python.org> <cl2g0vFfiq9U1@mid.individual.net> <mailman.19117.1424755795.18130.python-list@python.org> <cl486mFu4l9U1@mid.individual.net> <mailman.19181.1424868605.18130.python-list@python.org> <cl7pmjF7595U1@mid.individual.net> <F521BFFE-506F-4B58-9A15-20D91A019BD0@gmail.com> <CALwzidm3AngMF9aG-gLpYur6CfaADM0YXGU=p0=dv-qqYXmmFA@mail.gmail.com> <8A3659BC-9100-4A3A-9117-47227B3D290B@gmail.com>
From: Ian Kelly <ian.g.kelly@gmail.com>
Date: Mon, 2 Mar 2015 08:34:15 -0700
Subject: Re: Design thought for callbacks
To: Python <python-list@python.org>
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable
Precedence: list
Newsgroups: comp.lang.python
Message-ID: <mailman.45.1425310505.13471.python-list@python.org>
Lines: 83
NNTP-Posting-Host: 2001:888:2000:d::a6
Xref: csiph.com comp.lang.python:86750

On Mon, Mar 2, 2015 at 4:04 AM, Cem Karan <cfkaran2@gmail.com> wrote:
> On Feb 26, 2015, at 2:54 PM, Ian Kelly <ian.g.kelly@gmail.com> wrote:
>> On Feb 26, 2015 4:00 AM, "Cem Karan" <cfkaran2@gmail.com> wrote:
>> >
>> >
>> > On Feb 26, 2015, at 12:36 AM, Gregory Ewing <greg.ewing@canterbury.ac.=
nz> wrote:
>> >
>> > > Cem Karan wrote:
>> > >> I think I see what you're talking about now.  Does WeakMethod
>> > >> (https://docs.python.org/3/library/weakref.html#weakref.WeakMethod)=
 solve
>> > >> this problem?
>> > >
>> > > Yes, that looks like it would work.
>> >
>> >
>> > Cool!
>>
>> Sometimes I wonder whether anybody reads my posts. I suggested a solutio=
n involving WeakMethod four days ago that additionally extends the concept =
to non-method callbacks (requiring a small amount of extra effort from the =
client in those cases, but I think that is unavoidable. There is no way tha=
t the framework can determine the appropriate lifetime for a closure-based =
callback.)
>
> I apologize about taking so long to reply to everyone's posts, but I've b=
een busy at home.
>
> Ian, it took me a while to do some research to understand WHY what you we=
re suggesting was important; you're right about storing the object as well =
as the method/function separately, but I think that WeakMethod might solve =
that completely, correct?  Are there any cases where WeakMethod wouldn't wo=
rk?

WeakMethod only works for bound method objects. If you pass it a
non-method function, you'll get a TypeError:

>>> from weakref import WeakMethod
>>> WeakMethod(lambda: None)
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/usr/lib/python3.4/weakref.py", line 49, in __new__
    .format(type(meth))) from None
TypeError: argument should be a bound method, not <class 'function'>

This check uses duck typing, so you could perhaps write a method-like
class with __self__ and __func__ attributes and pass that to the
WeakMethod constructor in the case of non-methods. There's a bigger
issue with this however, which is that WeakMethod works by keeping
weak references to *both* the object and the function, meaning that as
soon as the function has no other references, the WeakMethod expires
even if the object is still alive. This isn't a problem for methods
because it's the transience of the method object, not the underlying
function, that WeakMethod seeks to work around. But it doesn't by
itself do anything to solve the problem of closures or lambdas that
may themselves be transient.

Revisiting the implementation I suggested previously, I want to make a
correction. This would be better solved with a WeakValueDictionary:

class Listenable:
    def __init__(self):
        self._callbacks =3D weakref.WeakValueDictionary()

    def listen(self, callback, owner=3DNone):
        if owner is None:
            if isinstance(callback, types.MethodType):
                owner =3D weakref.WeakMethod(callback)
            else:
                owner =3D callback
        # TODO: Should anything happen if the callback is already in the di=
ct?
        self._callbacks[callback] =3D owner

    def do_callbacks(self, message):
        for callback in self._callbacks.keys():
            callback(message)

This approach has two benefits over the previous one: it simplifies
the callback management a bit, and it avoids making the assumption
that the owner is hashable (it assumes instead that the callback is
hashable, but I think that's reasonable).