Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]

Groups > comp.lang.python > #102909

Re: What is heating the memory here? hashlib?

Path csiph.com!feeder.erje.net!2.eu.feeder.erje.net!newsfeed0.kamp.net!newsfeed.kamp.net!fu-berlin.de!uni-berlin.de!not-for-mail
From INADA Naoki <songofacandy@gmail.com>
Newsgroups comp.lang.python
Subject Re: What is heating the memory here? hashlib?
Date Sun, 14 Feb 2016 18:49:51 +0900
Lines 24
Message-ID <mailman.104.1455443395.22075.python-list@python.org> (permalink)
References <n9o06t$1hjo$1@gioia.aioe.org> <n9p8u3$130l$1@gioia.aioe.org>
Mime-Version 1.0
Content-Type text/plain; charset=UTF-8
Content-Transfer-Encoding quoted-printable
X-Trace news.uni-berlin.de GGqshdxq3w2DuWnHDs8dNw8wX9flIZ4iq/Mk6GkHL73w==
Return-Path <songofacandy@gmail.com>
X-Original-To python-list@python.org
Delivered-To python-list@mail.python.org
X-Spam-Status OK 0.020
X-Spam-Evidence '*H*': 0.96; '*S*': 0.00; 'received:209.85.223': 0.03; 'cc:addr:python-list': 0.09; 'posted.': 0.09; ':-)': 0.12; 'being,': 0.16; 'investigate': 0.16; 'paulo': 0.16; 'received:io': 0.16; 'received:psf.io': 0.16; 'reproduce': 0.16; 'memory': 0.17; 'pfxlen:0': 0.18; 'cc:2**0': 0.20; 'cc:addr:python.org': 0.20; 'cc:no real name:2**0': 0.22; 'header:In-Reply-To:1': 0.24; 'all.': 0.24; 'module': 0.25; 'message-id:@mail.gmail.com': 0.27; 'correct': 0.28; 'url:mailman': 0.30; 'post': 0.31; 'computing': 0.32; 'url:python': 0.33; "i'll": 0.33; 'url:listinfo': 0.34; 'received:google.com': 0.35; 'url:org': 0.36; 'received:209.85': 0.36; 'subject:?': 0.36; 'subject:: ': 0.37; 'done.': 0.37; 'received:209': 0.38; 'thank': 0.38; 'subject:the': 0.39; 'unable': 0.39; 'url:mail': 0.40; 'some': 0.40; 'here.': 0.62; 'more': 0.63; 'here': 0.66; 'results': 0.66; 'situation': 0.67; 'subject:here': 0.84; 'walking': 0.91
DKIM-Signature v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=vXHFu+mrQ9KPCOkQVFdFeenzKRcHhH7yRcUSpzdX2uQ=; b=cF4qO/TGdWrn7TwJWoHW3iOsVF1o5XqHC8yS06lABQx1xjhdankQuacNjmSqVhXlZc BrdS2QszTk2X+TWfu0qUGdDq6cs9c3Xw85KWs8ei5iYqz/vtCR4wYmRln/jaYNgDHRWi kG+DQntSCLkgyv0jfx8YLWuQdUsduMUhvPiYmKo6FpS1KB6BICcBkZjzIblkAaxSGeNb HfdVJOBhHSEchpK1B/GGvCPqd2mB99Q5TSenxSdT4qTEh7pDB7CzzSPKfGkrH8ybgsfL QihCQDm4Y6t2lCNKwvl/1M2dkwQmfNi/zWTA6aQzkoBBWBJJtjfvJHGD8RcxU/V/B7DX kNtg==
X-Google-DKIM-Signature v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:date :message-id:subject:from:to:cc:content-type; bh=vXHFu+mrQ9KPCOkQVFdFeenzKRcHhH7yRcUSpzdX2uQ=; b=l5RyCCCZPSwQY1PSroEw4XVKU+YOoCj2FZRAQCQ9hcUMc//TuZ83MDAEQBaTxQ+2e4 kWmrv/GhjBjFLhmaW4Re81U0bakPCZkVa2eAa7RDseNbbKoqIDnrifB4zQCNSHYfiUbh e8lEs/STftOFTNnPWgiRhFUIrH4U6xBJJn/UBgYU5NcGhxjEl8CKR2Onw8CDG/RJZlb0 tlKHvEc0Y01VthGZQWZ0D34iGtEWZ6546h7HJIexB+MiAtiIL3oPIUNIwELfeZQz7Cig wM/zhTiNpEdmSd6QrDhXLkNqfd5/eBBdafSHKqLgYCRZfnDeNtoEBhDUI515VZwIWqd2 mzcQ==
X-Gm-Message-State AG10YOTB9q9VcJu22nezJLiHosyF3yBfLOG9hOuhI8YoGJoFCE9qhSLOOAIkQmVervXar4QWZUzFfI6Ic+VrRg==
X-Received by 10.107.10.101 with SMTP id u98mr12209613ioi.60.1455443391887; Sun, 14 Feb 2016 01:49:51 -0800 (PST)
In-Reply-To <n9p8u3$130l$1@gioia.aioe.org>
X-Content-Filtered-By Mailman/MimeDel 2.1.21rc2
X-BeenThere python-list@python.org
X-Mailman-Version 2.1.21rc2
Precedence list
List-Id General discussion list for the Python programming language <python-list.python.org>
List-Unsubscribe <https://mail.python.org/mailman/options/python-list>, <mailto:python-list-request@python.org?subject=unsubscribe>
List-Archive <http://mail.python.org/pipermail/python-list/>
List-Post <mailto:python-list@python.org>
List-Help <mailto:python-list-request@python.org?subject=help>
List-Subscribe <https://mail.python.org/mailman/listinfo/python-list>, <mailto:python-list-request@python.org?subject=subscribe>
Xref csiph.com comp.lang.python:102909

Show key headers only | View raw

tracemalloc module may help you to investigate leaks.
2016/02/14 午後4:05 "Paulo da Silva" <p_s_d_a_s_i_l_v_a_ns@netcabo.pt>:

> I was unable to reproduce the situation using a simple program just
> walking through all files>4K, with or without the seek, and computing
> their shasums.
> Only some fluctuations of about 500MB in memory consumption.
>
> I'll look at this when I get more time, taking in consideration the
> suggestions here posted.
>
> For the time being, my work is done. With a small buffer size (16k) the
> results produced were correct and no memory was leaked!
>
> If I can find any explanation (if not embarrassing :-) ), I'll post it
> here.
>
> Thank you all.
> Paulo
>
> --
> https://mail.python.org/mailman/listinfo/python-list
>

Back to comp.lang.python | Previous | Next — Previous in thread | Next in thread | Find similar | Unroll thread

Thread

What is heating the memory here? hashlib? Paulo da Silva <p_s_d_a_s_i_l_v_a_ns@netcabo.pt> - 2016-02-13 19:29 +0000
  Re: What is heating the memory here? hashlib? Paulo da Silva <p_s_d_a_s_i_l_v_a_ns@netcabo.pt> - 2016-02-13 22:26 +0000
    Re: What is heating the memory here? hashlib? Chris Angelico <rosuav@gmail.com> - 2016-02-14 09:45 +1100
      Re: What is heating the memory here? hashlib? Paulo da Silva <p_s_d_a_s_i_l_v_a_ns@netcabo.pt> - 2016-02-14 01:44 +0000
        Re: What is heating the memory here? hashlib? Chris Angelico <rosuav@gmail.com> - 2016-02-14 13:01 +1100
  Re: What is heating the memory here? hashlib? Steven D'Aprano <steve@pearwood.info> - 2016-02-14 13:21 +1100
    Re: What is heating the memory here? hashlib? Paulo da Silva <p_s_d_a_s_i_l_v_a_ns@netcabo.pt> - 2016-02-15 08:05 +0000
  Re: What is heating the memory here? hashlib? Paulo da Silva <p_s_d_a_s_i_l_v_a_ns@netcabo.pt> - 2016-02-14 07:04 +0000
    Re: What is heating the memory here? hashlib? INADA Naoki <songofacandy@gmail.com> - 2016-02-14 18:49 +0900
      Re: What is heating the memory here? hashlib? Paulo da Silva <p_s_d_a_s_i_l_v_a_ns@netcabo.pt> - 2016-02-15 07:38 +0000
    Re: What is heating the memory here? hashlib? Paulo da Silva <p_s_d_a_s_i_l_v_a_ns@netcabo.pt> - 2016-02-15 02:21 +0000
      Re: What is heating the memory here? hashlib? Johannes Bauer <dfnsonfsduifb@gmx.de> - 2016-02-15 09:12 +0100
        Re: What is heating the memory here? hashlib? Paulo da Silva <p_s_d_a_s_i_l_v_a_ns@netcabo.pt> - 2016-02-15 17:29 +0000

csiph-web