Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]


Groups > comp.lang.python > #25617

reloading code and multiprocessing

Date 2012-07-19 11:15 +0100
Subject reloading code and multiprocessing
From andrea crotti <andrea.crotti.0@gmail.com>
Newsgroups comp.lang.python
Message-ID <mailman.2296.1342692914.4697.python-list@python.org> (permalink)

Show all headers | View raw


We need to be able to reload code on a live system.  This live system
has a daemon process always running but it runs many subprocesses with
multiprocessing, and the subprocesses might have a short life...

Now I found a way to reload the code successfully, as you can see from
this testcase:


def func():
    from . import a
    print(a.ret())


class TestMultiProc(unittest.TestCase):
    def setUp(self):
        open(path.join(cur_dir, 'a.py'), 'w').write(old_a)

    def tearDown(self):
        remove(path.join(cur_dir, 'a.py'))

    def test_reloading(self):
        """Starting a new process gives a different result
        """
        p1 = Process(target=func)
        p2 = Process(target=func)
        p1.start()
        res = p1.join()
        open(path.join(cur_dir, 'a.py'), 'w').write(new_a)
        remove(path.join(cur_dir, 'a.pyc'))

        p2.start()
        res = p2.join()


As long as I import the code in the function and make sure to remove the
"pyc" files everything seems to work..
Are there any possible problems which I'm not seeing in this approach or
it's safe?

Any other better ways otherwise?

Back to comp.lang.python | Previous | NextNext in thread | Find similar | Unroll thread


Thread

reloading code and multiprocessing andrea crotti <andrea.crotti.0@gmail.com> - 2012-07-19 11:15 +0100
  Re: reloading code and multiprocessing 88888 Dihedral <dihedral88888@googlemail.com> - 2012-07-19 08:08 -0700
  Re: reloading code and multiprocessing 88888 Dihedral <dihedral88888@googlemail.com> - 2012-07-19 08:08 -0700

csiph-web