Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]


Groups > comp.lang.python > #36831 > unrolled thread

code explanation

Started byRodrick Brown <rodrick.brown@gmail.com>
First post2013-01-14 23:00 -0500
Last post2013-01-14 22:39 -0700
Articles 4 — 3 participants

Back to article view | Back to comp.lang.python


Contents

  code explanation Rodrick Brown <rodrick.brown@gmail.com> - 2013-01-14 23:00 -0500
    Re: code explanation Steven D'Aprano <steve+comp.lang.python@pearwood.info> - 2013-01-15 04:38 +0000
      Re: code explanation Rodrick Brown <rodrick.brown@gmail.com> - 2013-01-14 23:51 -0500
      Re: code explanation Ian Kelly <ian.g.kelly@gmail.com> - 2013-01-14 22:39 -0700

#36831 — code explanation

FromRodrick Brown <rodrick.brown@gmail.com>
Date2013-01-14 23:00 -0500
Subjectcode explanation
Message-ID<mailman.526.1358222451.2939.python-list@python.org>

[Multipart message — attachments visible in raw view] — view raw

Can someone explain what's going on here.

def _build_magic_dispatcher(method):
    def inner(self, *args, **kwargs):
        return self.__dict__[method](*args, **kwargs)
    inner.__name__ = method
    return inner

Thanks.

[toc] | [next] | [standalone]


#36833

FromSteven D'Aprano <steve+comp.lang.python@pearwood.info>
Date2013-01-15 04:38 +0000
Message-ID<50f4dd31$0$29983$c3e8da3$5496439d@news.astraweb.com>
In reply to#36831
On Mon, 14 Jan 2013 23:00:16 -0500, Rodrick Brown wrote:

> Can someone explain what's going on here.
> 
> def _build_magic_dispatcher(method):
>     def inner(self, *args, **kwargs):
>         return self.__dict__[method](*args, **kwargs)
>     inner.__name__ = method
>     return inner
> 
> Thanks.


This is a factory function, probably intended to be used as a decorator:

class K:
    @_build_magic_dispatcher
    def something(self, x, y, z): ...

except that it appears to be broken. It seems to be expecting a *string*, 
the name of a method, despite the function parameter claiming to require 
a method itself. So maybe you use it like this:

class K:
    def __init__(self):
        self.parrot = _build_magic_dispatcher("parrot")


or something similar. Without seeing the context, it's hard for me to 
tell whether it works or is broken. I suspect it is broken, or useless, 
or both.

So, this factory function seems to take the *name* of a method as 
argument. Then it builds an inner method, which accepts arbitrary 
arguments (args and kwargs), renames the inner method to the name you 
passed as argument, and returns it.

The inner method simply looks up an attribute with the same name, and 
calls it as a function with whatever args and kwargs it gets.


Does this help?



-- 
Steven

[toc] | [prev] | [next] | [standalone]


#36835

FromRodrick Brown <rodrick.brown@gmail.com>
Date2013-01-14 23:51 -0500
Message-ID<mailman.528.1358225540.2939.python-list@python.org>
In reply to#36833

[Multipart message — attachments visible in raw view] — view raw

On Mon, Jan 14, 2013 at 11:38 PM, Steven D'Aprano <
steve+comp.lang.python@pearwood.info> wrote:

> On Mon, 14 Jan 2013 23:00:16 -0500, Rodrick Brown wrote:
>
> > Can someone explain what's going on here.
> >
> > def _build_magic_dispatcher(method):
> >     def inner(self, *args, **kwargs):
> >         return self.__dict__[method](*args, **kwargs)
> >     inner.__name__ = method
> >     return inner
> >
> > Thanks.
>
>
> This is a factory function, probably intended to be used as a decorator:
>
> class K:
>     @_build_magic_dispatcher
>     def something(self, x, y, z): ...
>
> except that it appears to be broken. It seems to be expecting a *string*,
> the name of a method, despite the function parameter claiming to require
> a method itself. So maybe you use it like this:
>
> class K:
>     def __init__(self):
>         self.parrot = _build_magic_dispatcher("parrot")
>
>
> or something similar. Without seeing the context, it's hard for me to
> tell whether it works or is broken. I suspect it is broken, or useless,
> or both.
>
> So, this factory function seems to take the *name* of a method as
> argument. Then it builds an inner method, which accepts arbitrary
> arguments (args and kwargs), renames the inner method to the name you
> passed as argument, and returns it.
>
>
Thanks Steven, here is the full context of the code. I'm trying to
understand what exactly the author is trying to accomplish here.

import sys

PY3K = sys.version_info >= (3,)


methods = set([
    "__iter__",
    "__len__",
    "__contains__",

    "__lt__",
    "__le__",
    "__eq__",
    "__ne__",
    "__gt__",
    "__ge__",

    "__add__",
    "__and__",
    "__divmod__",
    "__floordiv__",
    "__lshift__",
    "__mod__",
    "__mul__",
    "__or__",
    "__pow__",
    "__rshift__",
    "__sub__",
    "__truediv__",
    "__xor__",
])
if PY3K:
    methods.add("__next__")
    methods.add("__bool__")
else:
    methods.add("__div__")
    methods.add("__nonzero__")
MAGIC_METHODS = frozenset(methods)
del methods

def _build_magic_dispatcher(method):
    def inner(self, *args, **kwargs):
        return self.__dict__[method](*args, **kwargs)
    inner.__name__ = method
    return inner


class stub(object):
    _classes_cache = {}

    def __new__(cls, **kwargs):
        magic_methods_present = MAGIC_METHODS.intersection(kwargs)
        if magic_methods_present not in cls._classes_cache:
            attrs = dict(
                (method, _build_magic_dispatcher(method))
                for method in magic_methods_present
            )
            attrs["__module__"] = cls.__module__
            cls._classes_cache[magic_methods_present] = type("stub",
(cls,), attrs)
        new_cls = cls._classes_cache[magic_methods_present]
        return super(stub, new_cls).__new__(new_cls, **kwargs)

    def __init__(self, **kwargs):
        self.__dict__.update(kwargs)


> The inner method simply looks up an attribute with the same name, and
> calls it as a function with whatever args and kwargs it gets.
>
>
> Does this help?
>
>
>
> --
> Steven
> --
> http://mail.python.org/mailman/listinfo/python-list
>

[toc] | [prev] | [next] | [standalone]


#36836

FromIan Kelly <ian.g.kelly@gmail.com>
Date2013-01-14 22:39 -0700
Message-ID<mailman.529.1358228435.2939.python-list@python.org>
In reply to#36833
On Mon, Jan 14, 2013 at 9:51 PM, Rodrick Brown <rodrick.brown@gmail.com> wrote:
> import sys
>
> PY3K = sys.version_info >= (3,)
>
>
> methods = set([
>     "__iter__",
>     "__len__",
>     "__contains__",
>
>     "__lt__",
>     "__le__",
>     "__eq__",
>     "__ne__",
>     "__gt__",
>     "__ge__",
>
>     "__add__",
>     "__and__",
>     "__divmod__",
>     "__floordiv__",
>     "__lshift__",
>     "__mod__",
>     "__mul__",
>     "__or__",
>     "__pow__",
>     "__rshift__",
>     "__sub__",
>     "__truediv__",
>     "__xor__",
> ])
> if PY3K:
>     methods.add("__next__")
>     methods.add("__bool__")
> else:
>     methods.add("__div__")
>     methods.add("__nonzero__")
> MAGIC_METHODS = frozenset(methods)
> del methods
>
> def _build_magic_dispatcher(method):
>     def inner(self, *args, **kwargs):
>         return self.__dict__[method](*args, **kwargs)
>     inner.__name__ = method
>     return inner
>
>
> class stub(object):
>     _classes_cache = {}
>
>     def __new__(cls, **kwargs):
>         magic_methods_present = MAGIC_METHODS.intersection(kwargs)
>         if magic_methods_present not in cls._classes_cache:
>             attrs = dict(
>                 (method, _build_magic_dispatcher(method))
>                 for method in magic_methods_present
>             )
>             attrs["__module__"] = cls.__module__
>             cls._classes_cache[magic_methods_present] = type("stub", (cls,),
> attrs)
>         new_cls = cls._classes_cache[magic_methods_present]
>         return super(stub, new_cls).__new__(new_cls, **kwargs)
>
>     def __init__(self, **kwargs):
>         self.__dict__.update(kwargs)


The stub class is called with keyword arguments where the keys are the
names of Python "magic methods" and the values are functions.  When
called, it builds a new subclass of itself populated with a
corresponding set of methods, each of which is built by
_build_magic_dispatcher; these look up the method with the same name
in the instance dictionary and delegate the call to whatever they
find.  For some reason that eludes me, the generated methods appear to
discard the "self" argument in the process.  After the subclass is
generated, it constructs and returns an instance of the subclass, and
then when the __init__ method is called it simply populates the
instance dictionary with the functions that were passed in.

The purpose of this appears to be to construct objects with magic
methods that are defined on the object itself rather than on the
class.  Normally, when Python calls a magic method it doesn't look in
the instance dictionary at all and only looks in the class dictionary.
 The subclasses of "stub" side-step that by having the desired magic
methods on the class delegate calls to the instance.

[toc] | [prev] | [standalone]


Back to top | Article view | comp.lang.python


csiph-web