Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]


Groups > comp.lang.python > #75361 > unrolled thread

Getting a list of all modules

Started bySteven D'Aprano <steve@pearwood.info>
First post2014-07-30 07:43 +0000
Last post2014-08-02 14:17 -0400
Articles 5 on this page of 25 — 15 participants

Back to article view | Back to comp.lang.python


Contents

  Getting a list of all modules Steven D'Aprano <steve@pearwood.info> - 2014-07-30 07:43 +0000
    Re: Getting a list of all modules Chris Angelico <rosuav@gmail.com> - 2014-07-30 18:33 +1000
    Re: Getting a list of all modules Peter Otten <__peter__@web.de> - 2014-07-30 10:46 +0200
    Re: Getting a list of all modules Robert Kern <robert.kern@gmail.com> - 2014-07-30 11:35 +0100
    Re: Getting a list of all modules Leo Jay <python.leojay@gmail.com> - 2014-07-30 21:22 +0800
      Re: Getting a list of all modules Steven D'Aprano <steve+comp.lang.python@pearwood.info> - 2014-07-31 10:41 +0000
        Re: Getting a list of all modules Roy Smith <roy@panix.com> - 2014-07-31 07:55 -0400
          Re: Getting a list of all modules Chris Angelico <rosuav@gmail.com> - 2014-07-31 23:13 +1000
        Re: Getting a list of all modules Terry Reedy <tjreedy@udel.edu> - 2014-07-31 15:59 -0400
        Re: Getting a list of all modules Robert Kern <robert.kern@gmail.com> - 2014-08-01 14:39 +0100
          Re: Getting a list of all modules Steven D'Aprano <steve+comp.lang.python@pearwood.info> - 2014-08-01 15:41 +0000
            Re: Getting a list of all modules jonnicoll11@googlemail.com - 2014-08-02 14:13 -0700
              Re: Getting a list of all modules Mark Lawrence <breamoreboy@yahoo.co.uk> - 2014-08-02 22:22 +0100
            Re: Getting a list of all modules Mark Lawrence <breamoreboy@yahoo.co.uk> - 2014-08-03 14:38 +0100
    Re: Getting a list of all modules Chris Angelico <rosuav@gmail.com> - 2014-07-30 23:27 +1000
    Re: Getting a list of all modules wxjmfauth@gmail.com - 2014-07-30 06:42 -0700
    Re: Getting a list of all modules Ian Kelly <ian.g.kelly@gmail.com> - 2014-07-30 08:29 -0600
    Re: Getting a list of all modules Skip Montanaro <skip@pobox.com> - 2014-07-30 09:45 -0500
    Re: Getting a list of all modules Akira Li <4kir4.1i@gmail.com> - 2014-07-31 22:55 +0400
    Bug with help (was Re: Getting a list of all modules) Mark Lawrence <breamoreboy@yahoo.co.uk> - 2014-07-31 20:19 +0100
    Re: Bug with help (was Re: Getting a list of all modules) Terry Reedy <tjreedy@udel.edu> - 2014-07-31 16:15 -0400
    Re: Bug with help (was Re: Getting a list of all modules) Akira Li <4kir4.1i@gmail.com> - 2014-08-02 06:17 +0400
      Re: Bug with help (was Re: Getting a list of all modules) Heinz Schmitz <HeinzSchmitz@gmx.net> - 2014-08-02 10:33 +0200
        Re: Bug with help (was Re: Getting a list of all modules) Robert Kern <robert.kern@gmail.com> - 2014-08-02 13:13 +0100
        Re: Bug with help (was Re: Getting a list of all modules) Terry Reedy <tjreedy@udel.edu> - 2014-08-02 14:17 -0400

Page 2 of 2 — ← Prev page 1 [2]


#75442 — Re: Bug with help (was Re: Getting a list of all modules)

FromTerry Reedy <tjreedy@udel.edu>
Date2014-07-31 16:15 -0400
SubjectRe: Bug with help (was Re: Getting a list of all modules)
Message-ID<mailman.12490.1406837761.18130.python-list@python.org>
In reply to#75361
On 7/31/2014 3:19 PM, Mark Lawrence wrote:
> On 31/07/2014 19:55, Akira Li wrote:
>> Steven D'Aprano <steve@pearwood.info> writes:
>>
>>> I'm looking for a programmatic way to get a list of all Python modules
>>> and packages. Not just those already imported, but all those which
>>> *could* be imported.
>> ...
>>> Is this problem already solved? Can anyone make any suggestions?
>>
>> Look at how `help('modules')` is implemented. Though it crashes on my
>> system.
>>
>
> Have you reported this at bugs.python.org or is there already an issue
> for the problem that you see?

I strongly suspect this issue:
http://bugs.python.org/issue12902
help('modules') imports all modules, and crashes if any import crashes 
the system.

-- 
Terry Jan Reedy

[toc] | [prev] | [next] | [standalone]


#75512 — Re: Bug with help (was Re: Getting a list of all modules)

FromAkira Li <4kir4.1i@gmail.com>
Date2014-08-02 06:17 +0400
SubjectRe: Bug with help (was Re: Getting a list of all modules)
Message-ID<mailman.12532.1406945886.18130.python-list@python.org>
In reply to#75361
Mark Lawrence <breamoreboy@yahoo.co.uk> writes:

> On 31/07/2014 19:55, Akira Li wrote:
>> Steven D'Aprano <steve@pearwood.info> writes:
>>
>>> I'm looking for a programmatic way to get a list of all Python modules
>>> and packages. Not just those already imported, but all those which
>>> *could* be imported.
>> ...
>>> Is this problem already solved? Can anyone make any suggestions?
>>
>> Look at how `help('modules')` is implemented. Though it crashes on my
>> system.
>>
>
> Have you reported this at bugs.python.org or is there already an issue
> for the problem that you see?

It is this issue for python2.7:

https://bugs.launchpad.net/ubuntu/+source/python2.7/+bug/896836

python3 doesn't crash with currently installed packages.


--
Akira

[toc] | [prev] | [next] | [standalone]


#75527 — Re: Bug with help (was Re: Getting a list of all modules)

FromHeinz Schmitz <HeinzSchmitz@gmx.net>
Date2014-08-02 10:33 +0200
SubjectRe: Bug with help (was Re: Getting a list of all modules)
Message-ID<k78pt9ddlm16g3v6r44c3ei1l7k1rljt5a@4ax.com>
In reply to#75512
Akira Li wrote:

>>> Look at how `help('modules')` is implemented. Though it crashes on my
>>> system.

>> Have you reported this at bugs.python.org or is there already an issue
>> for the problem that you see?

>It is this issue for python2.7:
>https://bugs.launchpad.net/ubuntu/+source/python2.7/+bug/896836
>
>python3 doesn't crash with currently installed packages.

Python 2.7 on Windows XP Sp2 doesn't crash with this. So it seems to
be a python<->OS-problem.

Regards,
H.

[toc] | [prev] | [next] | [standalone]


#75532 — Re: Bug with help (was Re: Getting a list of all modules)

FromRobert Kern <robert.kern@gmail.com>
Date2014-08-02 13:13 +0100
SubjectRe: Bug with help (was Re: Getting a list of all modules)
Message-ID<mailman.12541.1406981622.18130.python-list@python.org>
In reply to#75527
On 2014-08-02 09:33, Heinz Schmitz wrote:
> Akira Li wrote:
>
>>>> Look at how `help('modules')` is implemented. Though it crashes on my
>>>> system.
>
>>> Have you reported this at bugs.python.org or is there already an issue
>>> for the problem that you see?
>
>> It is this issue for python2.7:
>> https://bugs.launchpad.net/ubuntu/+source/python2.7/+bug/896836
>>
>> python3 doesn't crash with currently installed packages.
>
> Python 2.7 on Windows XP Sp2 doesn't crash with this. So it seems to
> be a python<->OS-problem.

Well, it's just that `help('modules')` imports every module in the calling 
process (at least in Python 2.7; I haven't checked Python 3). Some extension 
modules conflict with each other and cause a crash when both are imported 
together. It's possible that you just don't have such modules installed. While 
the proximate cause of the crash is in the 3rd party modules, Python could (and 
maybe Python 3 does) import each module in a separate subprocess and collect the 
information that way.

-- 
Robert Kern

"I have come to believe that the whole world is an enigma, a harmless enigma
  that is made terrible by our own mad attempt to interpret it as though it had
  an underlying truth."
   -- Umberto Eco

[toc] | [prev] | [next] | [standalone]


#75543 — Re: Bug with help (was Re: Getting a list of all modules)

FromTerry Reedy <tjreedy@udel.edu>
Date2014-08-02 14:17 -0400
SubjectRe: Bug with help (was Re: Getting a list of all modules)
Message-ID<mailman.12547.1407003467.18130.python-list@python.org>
In reply to#75527
On 8/2/2014 8:13 AM, Robert Kern wrote:
> On 2014-08-02 09:33, Heinz Schmitz wrote:
>> Akira Li wrote:
>>
>>>>> Look at how `help('modules')` is implemented. Though it crashes on my
>>>>> system.
>>
>>>> Have you reported this at bugs.python.org or is there already an issue
>>>> for the problem that you see?
>>
>>> It is this issue for python2.7:
>>> https://bugs.launchpad.net/ubuntu/+source/python2.7/+bug/896836
>>>
>>> python3 doesn't crash with currently installed packages.
>>
>> Python 2.7 on Windows XP Sp2 doesn't crash with this. So it seems to
>> be a python<->OS-problem.

It is a local system problem.

> Well, it's just that `help('modules')` imports every module in the
> calling process (at least in Python 2.7; I haven't checked Python 3).
> Some extension modules conflict with each other and cause a crash when
> both are imported together. It's possible that you just don't have such
> modules installed. While the proximate cause of the crash is in the 3rd
> party modules, Python could (and maybe Python 3 does) import each module
> in a separate subprocess and collect the information that way.

That would slow down help('modules') much more.  The suggestion in
http://bugs.python.org/issue12902
"help("modules") executes module code"
is that help() should instead parse the module to get the docstring.

-- 
Terry Jan Reedy

[toc] | [prev] | [standalone]


Page 2 of 2 — ← Prev page 1 [2]

Back to top | Article view | comp.lang.python


csiph-web