Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]

Groups > comp.lang.python > #25617

reloading code and multiprocessing

Show key headers only | View raw

We need to be able to reload code on a live system.  This live system
has a daemon process always running but it runs many subprocesses with
multiprocessing, and the subprocesses might have a short life...

Now I found a way to reload the code successfully, as you can see from
this testcase:


def func():
    from . import a
    print(a.ret())


class TestMultiProc(unittest.TestCase):
    def setUp(self):
        open(path.join(cur_dir, 'a.py'), 'w').write(old_a)

    def tearDown(self):
        remove(path.join(cur_dir, 'a.py'))

    def test_reloading(self):
        """Starting a new process gives a different result
        """
        p1 = Process(target=func)
        p2 = Process(target=func)
        p1.start()
        res = p1.join()
        open(path.join(cur_dir, 'a.py'), 'w').write(new_a)
        remove(path.join(cur_dir, 'a.pyc'))

        p2.start()
        res = p2.join()


As long as I import the code in the function and make sure to remove the
"pyc" files everything seems to work..
Are there any possible problems which I'm not seeing in this approach or
it's safe?

Any other better ways otherwise?

Back to comp.lang.python | Previous | Next — Next in thread | Find similar | Unroll thread

Thread

reloading code and multiprocessing andrea crotti <andrea.crotti.0@gmail.com> - 2012-07-19 11:15 +0100
  Re: reloading code and multiprocessing 88888 Dihedral <dihedral88888@googlemail.com> - 2012-07-19 08:08 -0700
  Re: reloading code and multiprocessing 88888 Dihedral <dihedral88888@googlemail.com> - 2012-07-19 08:08 -0700

csiph-web