Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]


Groups > gnu.bash.bug > #16192

Re: [PATCH] Implement rehashing for associative arrays (Re: speeding up hash_search?)

Path csiph.com!xmission!news.snarked.org!news.linkpendium.com!news.linkpendium.com!panix!usenet.stanford.edu!not-for-mail
From Chet Ramey <chet.ramey@case.edu>
Newsgroups gnu.bash.bug
Subject Re: [PATCH] Implement rehashing for associative arrays (Re: speeding up hash_search?)
Date Mon, 20 Apr 2020 11:57:20 -0400
Organization ITS, Case Western Reserve University
Lines 31
Approved bug-bash@gnu.org
Message-ID <mailman.803.1587398263.3066.bug-bash@gnu.org> (permalink)
References <CALv3B7aiTbhpyUL17Eg5prH39EgMP8uSDdD554OdND3LFETAQg@mail.gmail.com> <CAFLRLk8ydO6ev8wRcJ35kzzN3Yt2_9sjsc6L+C0CC6dCxud_NA@mail.gmail.com> <3e13ada9-01b6-da2e-26d4-2f7b5799edb1@case.edu>
Reply-To chet.ramey@case.edu
NNTP-Posting-Host lists.gnu.org
Mime-Version 1.0
Content-Type text/plain; charset=utf-8
Content-Transfer-Encoding 7bit
X-Trace usenet.stanford.edu 1587398264 6011 209.51.188.17 (20 Apr 2020 15:57:44 GMT)
X-Complaints-To action@cs.stanford.edu
Cc chet.ramey@case.edu, bug-bash@gnu.org
To Koichi Murase <myoga.murase@gmail.com>, George Jones <fooologist@gmail.com>
Envelope-to bug-bash@gnu.org
DKIM-Signature v=1; a=rsa-sha256; c=relaxed/relaxed; d=case.edu; s=smtp-primary; t=1587398245; bh=dX5lrMk7hnHcHmllXp0uU7W/iHE+1oCbrLCPvNrClrk=; h=Reply-To:Cc:Subject:To:References:From:Message-ID:Date: MIME-Version:In-Reply-To:Content-Type:Content-Transfer-Encoding; b=N6ofO9vM2AMsMRNTvJ+rBkhzJzRpbEC1R/08aItsZTUJ2HlIj8ZmYP+QX1ZDk6NU+M 0cKdMJtBbHQ1DORhPCiN3TQ8GbYx+MPrTMmYLzprCFlNy+TV6qnQ/oxdjXry2iXAMsQ kxqmqF9JYhBjtIPMIZY2s51tCIeij4gLS+LWm4h6+TAzRpvGj1sZBQstOzWZAl5XhAc o1crweFQ2qcGJlFLgvSlJrtGwTxr8UPrJYncQzKFyFg0xT41SRXTav20F/oOM37+axk PORaGLSWue03gHE94PNEgwn7UtRTsRFQw6ns9PMRrSa4vmcXb94HUOJ8G8XcYlDA3sg 4U+tiloQ==
DKIM-Signature v=1; a=rsa-sha256; c=relaxed/relaxed; d=case.edu; s=smtp-primary; t=1587398243; bh=arhXHxezZmtWUqsM+1vwBFYymRi86e9tMuFjCZJDBxQ=; h=Reply-To:Cc:Subject:To:References:From:Message-ID:Date: MIME-Version:In-Reply-To:Content-Type:Content-Transfer-Encoding; b=VpOfYDeiMwq9uPfVI5n9+KE/YAt9eyK/TENwzcjxW5gEIe0XHnkJoRJ5NHcF9guTTz rsu0wJIhAdF5Spux7H1HZn8FeAdknp349Gmbe9HEg4D6oxvHnvQSaHxxpLM7YWj6zBz Wm1LB3MKLThHE7jCZmlESIutrTqToHAtjQtebsUWlF3Z46YPFOlzJAGPNvgtlGIPcF+ h537sVvFmkaSMSRSLybnMiZOh0lLJElXzVFuE9n/AY09W0KmWG2r+MXQurCfShtAJ3/ iarp/SFJC84xMm6bf2zsCQaKsC4KOPk1pC43f5jNaT1/ymIyn7q056L8QSua1umdJep R57EAUIQ==
DKIM-Signature v=1; a=rsa-sha256; c=relaxed/relaxed; d=case.edu; s=g-case; h=reply-to:cc:subject:to:references:from:autocrypt:organization :message-id:date:user-agent:mime-version:in-reply-to :content-language:content-transfer-encoding; bh=arhXHxezZmtWUqsM+1vwBFYymRi86e9tMuFjCZJDBxQ=; b=S0Tnmn2ZBGfk2IZaZTAYWDf+QKqsFLre3gSUUamXvGeEXIu5SdGqdOjwm/6ByuKArX 2/PM3kOeUQG89esklVUJsc0wqrjxGFbm4eow6gC97uAA2NSWDmKXOvovXCTNSU4wmoSr FRTGBlNkC9iOovwuPIMpWoqA1ofXG5ZUtTckSiHWCrPZyfDQ8NVmM8+r6glsHNN/0ycJ sPv8+XIhUp5hy2Y9mlPekWhqmdg27eikiD0LRSuP0Wn/mZjp0Dux+c63Y6bwwMbWqocq TQ0Gg9Ci2eug17cMQPpv8bg6NNByvColm9vuy7IW2bu4Lrp5ZZ3Xb8SFMrdiOT2HdqMJ 3NGA==
X-Google-DKIM-Signature v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:reply-to:cc:subject:to:references:from:autocrypt :organization:message-id:date:user-agent:mime-version:in-reply-to :content-language:content-transfer-encoding; bh=arhXHxezZmtWUqsM+1vwBFYymRi86e9tMuFjCZJDBxQ=; b=nrYjF+5cSfATKBbfR8H4R3BEp/Lsun64hlMcnyHAeZyY6VBvHRcpZXF2PEDtJfHeiE k07rID4CyOAmqG+7vm4KkQBDwTihFUTkcFDK3fGJ8juuBdxJkUuQAeTSickQk/WUXSvI puR7EyDPpih6kxsTMTlJ8k/Grq9cbA1mQ79mQzKO12Kxtj8QwIQmLEH+Liid/GX18c/T 1TBD9iWQ/p7IM/565kJjvCG3zz6KJhqVxjLgvkMPxMjCwtRx5wUyusYuFKoejyCL88k+ 42gCUWcIaT6ZWZo8lZXEnj3e6xPmwFCSSwTCJsqZvz4aAmZWP+V8yyyzVKlsaIFPV9aw p8+w==
X-Gm-Message-State AGi0PuaCnvgTtO9FZgPG1euy7DrRTAagcRM1szOxJ0PR1a+2433jZGG1 f7jbFu6z2cnkfIni/syj7njMW8TvObKFieTCivAVb7Dp3pLUe4b/lyRPZ51ayRIb19wv8XtgTih mcjKQ3ajir9Q=
X-Received by 2002:a37:c4b:: with SMTP id 72mr17123397qkm.2.1587398242797; Mon, 20 Apr 2020 08:57:22 -0700 (PDT)
X-Google-Smtp-Source APiQypLHDauuRTstcKgPQz8cCjVrFBirwhUgeTkUUkRMpPThcrRR6StL49lOCktqWfskIghv+5bRhw==
X-Received by 2002:a37:c4b:: with SMTP id 72mr17123368qkm.2.1587398242502; Mon, 20 Apr 2020 08:57:22 -0700 (PDT)
Autocrypt addr=chet.ramey@case.edu; prefer-encrypt=mutual; keydata= mQGiBEEOsGwRBACFa0A1oa71HSZLWxAx0svXzhOZNQZOzqHmSuGOG92jIpQpr8DpvgRh40Yp AwdcXb8QG1J5yGAKeevNE1zCFaA725vGSdHUyypHouV0xoWwukYO6qlyyX+2BZU+okBUqoWQ koWxiYaCSfzB2Ln7pmdys1fJhcgBKf3VjWCjd2XJTwCgoFJOwyBFJdugjfwjSoRSwDOIMf0D /iQKqlWhIO1LGpMrGX0il0/x4zj0NAcSwAk7LaPZbN4UPjn5pqGEHBlf1+xDDQCkAoZ/VqES GZragl4VqJfxBr29Ag0UDvNbUbXoxQsARdero1M8GiAIRc50hj7HXFoERwenbNDJL86GPLAQ OTGOCa4W2o29nFfFjQrsrrYHzVtyA/9oyKvTeEMJ7NA3VJdWcmn7gOu0FxEmSNhSoV1T4vP2 1Wf7f5niCCRKQLNyUy0wEApQi4tSysdz+AbgAc0b/bHYVzIf2uO2lIEZQNNt+3g2bmXgloWm W5fsm/di50Gm1l1Na63d3RZ00SeFQos6WEwLUHEB0yp6KXluXLLIZitEJLQwQ2hldCBSYW1l eSAoQ2FzZSBzdGFuZGFyZCkgPGNoZXQucmFtZXlAY2FzZS5lZHU+iF8EExECAB8FAkPi19EC GwMHCwkIBwMCAQMVAgMDFgIBAh4BAheAAAoJELtYafBk6nSrelkAn31Gsuib7GcCZHbv5L5t VKYR9LklAJ4hzUHKA49Z0QXR+qCb80osIcmPSbkBDQRBDrBvEAQAkK6TAOKBEM+EC4j6V/7o /riVZqcgU5cid2qG9TXdwNtD9a3kvA/ObZBO93sX59wc6Bnwo4VJxsOmMlpGrAjJsxNwg3QH akEtf8LXRbVpj5xStdmBdQZUhIQyalo/2/TZq5OijtddUQcL5cs70hTv/FpT3wUvr2Xr8rjF 41IFEz8AAwcD/A0CZEGlzIrT5WCBnl6xBog/8vKiUCbarByat3d1mL6DbizvKNXQRTC9E/vE dENAWCQCjr75Bu55xT8n3SXGtWdDC5xmZ/P3OBYORP8yl8H8I1FIosWOFirbIeYdZPq8SPD1 HL+EXo9zSiHVrrZRJ19ooCKKbSdXHFCY+aJG+0KZiEkEGBECAAkFAkEOsG8CGwwACgkQu1hp 8GTqdKvjcACfZlkVCDwaz/NTO9cy3t69oWpVPNwAnRwe0qk/WL/gfhH346xh5B3HFbFN
User-Agent Mozilla/5.0 (Macintosh; Intel Mac OS X 10.14; rv:68.0) Gecko/20100101 Thunderbird/68.7.0
In-Reply-To <CAFLRLk8ydO6ev8wRcJ35kzzN3Yt2_9sjsc6L+C0CC6dCxud_NA@mail.gmail.com>
Content-Language en-US
X-Mirapoint-IP-Reputation reputation=Good-1, source=Queried, refid=tid=0001.0A020302.5E9DBF82.00FC, actions=tag
X-Mirapoint-IP-Reputation reputation=good-1, source=Fixed, refid=n/a, actions=tag
X-Junkmail-Status score=8/80, host=mpv3-2015.case.edu
X-Junkmail-PrAS-Raw score=8/80, refid=2.7.2:2020.4.20.143917:17:8.317, ip=, rules=__YOUTUBE_RCVD, DKIM_SIGNATURE, __X_GOOGLE_DKIM_SIGNATURE, __HAS_REPLYTO, __HAS_CC_HDR, __MULTIPLE_RCPTS_CC_X2, __SUBJ_REPLY, __BOUNCE_CHALLENGE_SUBJ, __BOUNCE_NDR_SUBJ_EXEMPT, __TO_MALFORMED_2, __MULTIPLE_RCPTS_TO_X2, __TO_NAME, __TO_NAME_DIFF_FROM_ACC, __HAS_REFERENCES, __REFERENCES, __HAS_FROM, FROM_EDU_TLD, __HAS_MSGID, __SANE_MSGID, DATE_TZ_NA, __USER_AGENT, __MOZILLA_USER_AGENT, __MIME_VERSION, __IN_REP_TO, __CT, __CT_TEXT_PLAIN, __CTE, __REPLYTO_SAMEAS_FROM_ADDY, __REPLYTO_SAMEAS_FROM_ACC, __FROM_DOMAIN_IN_ANY_CC2, __REPLYTO_SAMEAS_FROM_DOMAIN, __DKIM_ALIGNS_1, __DKIM_ALIGNS_2, __ANY_URI, __URI_MAILTO, __URI_WITH_PATH, __URI_ENDS_IN_SLASH, __FRAUD_BODY_WEBMAIL, __URI_NO_WWW, __CP_URI_IN_BODY, __SUBJ_ALPHA_NEGATE, __URI_IN_BODY, __URI_NOT_IMG, __MAIL_CHAIN, __FORWARDED_MSG, __BODY_NO_MAILTO, __NO_HTML_TAG_RAW, BODY_SIZE_1100_1199, [TRUNCATED], so=2010-03-03 19:42:08, dmn=2016-08-03-0138
Received-SPF pass client-ip=129.22.103.194; envelope-from=chet.ramey@case.edu; helo=mpv3-2015.case.edu
X-detected-operating-system by eggs1p.gnu.org: First seen = 2020/04/20 10:04:56
X-ACL-Warn Detected OS = Linux 2.4.x-2.6.x [generic] [fuzzy]
X-Received-From 129.22.103.194
X-BeenThere bug-bash@gnu.org
X-Mailman-Version 2.1.23
Precedence list
List-Id Bug reports for the GNU Bourne Again SHell <bug-bash.gnu.org>
List-Unsubscribe <https://lists.gnu.org/mailman/options/bug-bash>, <mailto:bug-bash-request@gnu.org?subject=unsubscribe>
List-Archive <https://lists.gnu.org/archive/html/bug-bash>
List-Post <mailto:bug-bash@gnu.org>
List-Help <mailto:bug-bash-request@gnu.org?subject=help>
List-Subscribe <https://lists.gnu.org/mailman/listinfo/bug-bash>, <mailto:bug-bash-request@gnu.org?subject=subscribe>
X-Mailman-Original-Message-ID <3e13ada9-01b6-da2e-26d4-2f7b5799edb1@case.edu>
X-Mailman-Original-References <CALv3B7aiTbhpyUL17Eg5prH39EgMP8uSDdD554OdND3LFETAQg@mail.gmail.com> <CAFLRLk8ydO6ev8wRcJ35kzzN3Yt2_9sjsc6L+C0CC6dCxud_NA@mail.gmail.com>
Xref csiph.com gnu.bash.bug:16192

Show key headers only | View raw


On 4/19/20 3:51 PM, Koichi Murase wrote:

> 
> The associative arrays in `hashlib.c' are implemented by hash tables
> as is clear from its name.  The main lookup of hash table algorithm is
> done by the following line
> 
>   bucket = HASH_BUCKET (string, table, hv);
> 
> but not by the subsequent linear search.  The linear search is just a
> workaround for the collision of hashes.  As far as the load factor of
> the hash table is maintained properly, the linear search is O(1)
> because the length of the list is O(1).
> 
> 2020-04-19 23:54 George Jones <fooologist@gmail.com>:
>> This slows down (order N?) new inserts when the number of entries
>> gets large.
> 
> I looked into `hashlib.c' and found that rehashing is actually not
> implemented.  I just added a function to perform rehashing, and
> the performance has been improved.

Thanks for the patch. This will be in the next devel branch push.

Chet

-- 
``The lyf so short, the craft so long to lerne.'' - Chaucer
		 ``Ars longa, vita brevis'' - Hippocrates
Chet Ramey, UTech, CWRU    chet@case.edu    http://tiswww.cwru.edu/~chet/

Back to gnu.bash.bug | Previous | Next | Find similar


Thread

Re: [PATCH] Implement rehashing for associative arrays (Re: speeding up hash_search?) Chet Ramey <chet.ramey@case.edu> - 2020-04-20 11:57 -0400

csiph-web