Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]


Groups > gnu.bash.bug > #16178

Re: speeding up hash_search?

Path csiph.com!goblin2!goblin1!goblin.stu.neva.ru!usenet.stanford.edu!not-for-mail
From Chet Ramey <chet.ramey@case.edu>
Newsgroups gnu.bash.bug
Subject Re: speeding up hash_search?
Date Sun, 19 Apr 2020 15:46:26 -0400
Organization ITS, Case Western Reserve University
Lines 16
Approved bug-bash@gnu.org
Message-ID <mailman.721.1587325593.3066.bug-bash@gnu.org> (permalink)
References <CALv3B7aiTbhpyUL17Eg5prH39EgMP8uSDdD554OdND3LFETAQg@mail.gmail.com> <ff83d50d-402f-3287-a4d5-bcfdf7300585@case.edu>
Reply-To chet.ramey@case.edu
NNTP-Posting-Host lists.gnu.org
Mime-Version 1.0
Content-Type text/plain; charset=utf-8
Content-Transfer-Encoding 7bit
X-Trace usenet.stanford.edu 1587325593 26618 209.51.188.17 (19 Apr 2020 19:46:33 GMT)
X-Complaints-To action@cs.stanford.edu
Cc chet.ramey@case.edu
To George Jones <fooologist@gmail.com>, bug-bash@gnu.org
Envelope-to bug-bash@gnu.org
DKIM-Signature v=1; a=rsa-sha256; c=relaxed/relaxed; d=case.edu; s=smtp-primary; t=1587325590; bh=o3pLcy1BDgwg4gk2rKnEOBi/HVzvd/WVotTba6QXH9E=; h=Reply-To:Cc:Subject:To:References:From:Message-ID:Date: MIME-Version:In-Reply-To:Content-Type:Content-Transfer-Encoding; b=IyP9wUCATrIZCtXfZmx7HFR25eVQkpUe4ZlrC8qu1ZRKZjVK+pBcc2vlWmwzbwMZcb V+PUOSDsE3szYJITWUVH1Y3287AYsNx0LzDHHeKJgdDFSFmx/oXU3/k3TLoSBmd98QS RtYu/v7JE8e93fZCS/YeCh4PWvmJuWmDvuUgo9MDbiQKdciHu/Ulj5sDhM2zipWhfao HO00eBokgyjoLXBDUapfEtDzeI/O4o9NEUp5WMaWvXDLLU0YsHR52ct4sMhMz44lImd jq6pMoZDznqS9Ri6edTOI5rPZJXeEk4OF/TEkCF4pSoxB60LpjNkFBWQJH0cbm0ZIh6 tiHbV/Vw==
DKIM-Signature v=1; a=rsa-sha256; c=relaxed/relaxed; d=case.edu; s=smtp-primary; t=1587325588; bh=1nPkmYL3UE6xZoYJAPTkpYDUldOmdpu5uPeeeHnRVj8=; h=Reply-To:Cc:Subject:To:References:From:Message-ID:Date: MIME-Version:In-Reply-To:Content-Type:Content-Transfer-Encoding; b=9hoUGDExdkJ575gzn63QTdUzTTrYUG1lSB9QSDn36l/rzfe1Xo94lNSwA0vOHc8j8b wdlyigx/ztcQWjF9disESnI8dSWimkEwbtDJ98bqD6g9Kk/7VzlswPwtjreICxI08g0 4dOX8/p0+iNicsFmSL2HtAiCjCmRcw245YnyLfVE3xSZYvpGr3nMSQWaycgX9NPoUTY vG5CXB3PBTRhFdLWO/6WbS9h2YP+eIS2WchvDIGq1exPLYbbupljAChx3flbunPHAo7 RVHgFohyoQp4dHvyZtMH1u0vBt8sZGbl4S344jfzBVJGgM/sjh5IIJ/rTczaDO00Axd qkNgRSzQ==
DKIM-Signature v=1; a=rsa-sha256; c=relaxed/relaxed; d=case.edu; s=g-case; h=reply-to:cc:subject:to:references:from:autocrypt:organization :message-id:date:user-agent:mime-version:in-reply-to :content-language:content-transfer-encoding; bh=1nPkmYL3UE6xZoYJAPTkpYDUldOmdpu5uPeeeHnRVj8=; b=TxyMm5T8PqnIUh2ARETm2ix8nIi24Eqa6LddU6kSUpA2kzqNVCy/q+WPcxMuMZdL8h /3oFAmy0VCu6b85NudVORsAL65eCPbKR6E8U4EuPN1qY2m1+BUz8adyOl6H+7ljIKTSl 5hRCpQZAaBfhuSmPeLA0PmA08qDwwmWAvUbeUcrKGuyb2cw7eMXcdSi0pJHx9Ak88gxb uwuMOORsw2XrZBX2rJsRA4sekIxIPmhJYldVEKBorCthT1gGMQXFbDinn4NB2+gmV94T wD1GtID1OsEG0EjOUfgpjXRIiNyj49PqHwohLlvUAx4rPMOLy6ikOLVZaSHI6R0l2tDi WKcQ==
X-Google-DKIM-Signature v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:reply-to:cc:subject:to:references:from:autocrypt :organization:message-id:date:user-agent:mime-version:in-reply-to :content-language:content-transfer-encoding; bh=1nPkmYL3UE6xZoYJAPTkpYDUldOmdpu5uPeeeHnRVj8=; b=pXL1RwYU6o+bh3f8CPLi8fa9FkeFitqJYkZRk0wPfKrr4RGx0bF5iW/mYmVbFNLWBD /nO061BFBMerV1iXr6AMPBD4hHz8YatJzcQhKnQYYAx2uXZuQrj8DOEW9+693y3tK3Vh wGaVIGVhY7QjsvUGloS/Dn2y++KHD2xajINP1asmBYBeeWvHtAUYfGDZFlo2IVhTJ6fA 4rIGTZ0GfT/r98kDrHhcVVR6KVrlGGqnJneGCQYYPgyzZ5ZhUbuyD6stTnKjhRWz/e31 SaTkhCo/JqClX7Sz72HtSlPOOiSkFPiT+BAfmubXUYzZ54J2j6GnjyoxfYlcX3v2r+LA N7og==
X-Gm-Message-State AGi0PuZWBefri60124Dp2PP8O2vot/hWYtqpcKzF9AGUNFTtz4amngxn 0phz75EIgcoSGH1LOGSpo38S3pVt4pSfKy6cPmDplxjWPI+iwpmZWmVwKG7gYwN8bxaqWY0Fmr0 3vl5CY2f/LYo=
X-Received by 2002:a37:54e:: with SMTP id 75mr13033079qkf.257.1587325588171; Sun, 19 Apr 2020 12:46:28 -0700 (PDT)
X-Google-Smtp-Source APiQypJvvTFrhjabZBn2fIhW9N3hh2SXPTWEmzdmwkGAEEvO5WULxFido0NEqQKrPPDkwc63OQdqCA==
X-Received by 2002:a37:54e:: with SMTP id 75mr13033066qkf.257.1587325587952; Sun, 19 Apr 2020 12:46:27 -0700 (PDT)
Autocrypt addr=chet.ramey@case.edu; prefer-encrypt=mutual; keydata= mQGiBEEOsGwRBACFa0A1oa71HSZLWxAx0svXzhOZNQZOzqHmSuGOG92jIpQpr8DpvgRh40Yp AwdcXb8QG1J5yGAKeevNE1zCFaA725vGSdHUyypHouV0xoWwukYO6qlyyX+2BZU+okBUqoWQ koWxiYaCSfzB2Ln7pmdys1fJhcgBKf3VjWCjd2XJTwCgoFJOwyBFJdugjfwjSoRSwDOIMf0D /iQKqlWhIO1LGpMrGX0il0/x4zj0NAcSwAk7LaPZbN4UPjn5pqGEHBlf1+xDDQCkAoZ/VqES GZragl4VqJfxBr29Ag0UDvNbUbXoxQsARdero1M8GiAIRc50hj7HXFoERwenbNDJL86GPLAQ OTGOCa4W2o29nFfFjQrsrrYHzVtyA/9oyKvTeEMJ7NA3VJdWcmn7gOu0FxEmSNhSoV1T4vP2 1Wf7f5niCCRKQLNyUy0wEApQi4tSysdz+AbgAc0b/bHYVzIf2uO2lIEZQNNt+3g2bmXgloWm W5fsm/di50Gm1l1Na63d3RZ00SeFQos6WEwLUHEB0yp6KXluXLLIZitEJLQwQ2hldCBSYW1l eSAoQ2FzZSBzdGFuZGFyZCkgPGNoZXQucmFtZXlAY2FzZS5lZHU+iF8EExECAB8FAkPi19EC GwMHCwkIBwMCAQMVAgMDFgIBAh4BAheAAAoJELtYafBk6nSrelkAn31Gsuib7GcCZHbv5L5t VKYR9LklAJ4hzUHKA49Z0QXR+qCb80osIcmPSbkBDQRBDrBvEAQAkK6TAOKBEM+EC4j6V/7o /riVZqcgU5cid2qG9TXdwNtD9a3kvA/ObZBO93sX59wc6Bnwo4VJxsOmMlpGrAjJsxNwg3QH akEtf8LXRbVpj5xStdmBdQZUhIQyalo/2/TZq5OijtddUQcL5cs70hTv/FpT3wUvr2Xr8rjF 41IFEz8AAwcD/A0CZEGlzIrT5WCBnl6xBog/8vKiUCbarByat3d1mL6DbizvKNXQRTC9E/vE dENAWCQCjr75Bu55xT8n3SXGtWdDC5xmZ/P3OBYORP8yl8H8I1FIosWOFirbIeYdZPq8SPD1 HL+EXo9zSiHVrrZRJ19ooCKKbSdXHFCY+aJG+0KZiEkEGBECAAkFAkEOsG8CGwwACgkQu1hp 8GTqdKvjcACfZlkVCDwaz/NTO9cy3t69oWpVPNwAnRwe0qk/WL/gfhH346xh5B3HFbFN
User-Agent Mozilla/5.0 (Macintosh; Intel Mac OS X 10.14; rv:68.0) Gecko/20100101 Thunderbird/68.7.0
In-Reply-To <CALv3B7aiTbhpyUL17Eg5prH39EgMP8uSDdD554OdND3LFETAQg@mail.gmail.com>
Content-Language en-US
X-Mirapoint-IP-Reputation reputation=Good-1, source=Queried, refid=tid=0001.0A020303.5E9CA745.0058, actions=tag
X-Mirapoint-IP-Reputation reputation=good-1, source=Fixed, refid=n/a, actions=tag
X-Junkmail-Status score=7/80, host=mpv1-2015.case.edu
X-Junkmail-PrAS-Raw score=7/80, refid=2.7.2:2020.4.19.184817:17:7.944, ip=, rules=__YOUTUBE_RCVD, DKIM_SIGNATURE, __X_GOOGLE_DKIM_SIGNATURE, __HAS_REPLYTO, __HAS_CC_HDR, __SUBJ_REPLY, __BOUNCE_CHALLENGE_SUBJ, __BOUNCE_NDR_SUBJ_EXEMPT, __TO_MALFORMED_2, __MULTIPLE_RCPTS_TO_X2, __TO_NAME, __TO_NAME_DIFF_FROM_ACC, __HAS_REFERENCES, __REFERENCES, __HAS_FROM, FROM_EDU_TLD, __HAS_MSGID, __SANE_MSGID, DATE_TZ_NA, __USER_AGENT, __MOZILLA_USER_AGENT, __MIME_VERSION, __IN_REP_TO, __CT, __CT_TEXT_PLAIN, __CTE, __REPLYTO_SAMEAS_FROM_ADDY, __REPLYTO_SAMEAS_FROM_ACC, __FROM_DOMAIN_IN_ANY_CC1, __FROM_DOMAIN_IN_ANY_CC2, __REPLYTO_SAMEAS_FROM_DOMAIN, __DKIM_ALIGNS_1, __DKIM_ALIGNS_2, __ANY_URI, __URI_MAILTO, __URI_WITH_PATH, __URI_ENDS_IN_SLASH, __URI_NO_WWW, __CP_URI_IN_BODY, __SUBJ_ALPHA_NEGATE, __URI_IN_BODY, __URI_NOT_IMG, __MAIL_CHAIN, __BODY_NO_MAILTO, __NO_HTML_TAG_RAW, BODY_SIZE_600_699, BODYTEXTP_SIZE_3000_LESS, __MIME_TEXT_P1, [TRUNCATED], so=2010-03-03 19:42:08, dmn=2016-08-03-0138
Received-SPF pass client-ip=129.22.103.226; envelope-from=chet.ramey@case.edu; helo=mpv1-2015.case.edu
X-detected-operating-system by eggs1p.gnu.org: Linux 2.4.x-2.6.x [generic] [fuzzy]
X-Received-From 129.22.103.226
X-BeenThere bug-bash@gnu.org
X-Mailman-Version 2.1.23
Precedence list
List-Id Bug reports for the GNU Bourne Again SHell <bug-bash.gnu.org>
List-Unsubscribe <https://lists.gnu.org/mailman/options/bug-bash>, <mailto:bug-bash-request@gnu.org?subject=unsubscribe>
List-Archive <https://lists.gnu.org/archive/html/bug-bash>
List-Post <mailto:bug-bash@gnu.org>
List-Help <mailto:bug-bash-request@gnu.org?subject=help>
List-Subscribe <https://lists.gnu.org/mailman/listinfo/bug-bash>, <mailto:bug-bash-request@gnu.org?subject=subscribe>
X-Mailman-Original-Message-ID <ff83d50d-402f-3287-a4d5-bcfdf7300585@case.edu>
X-Mailman-Original-References <CALv3B7aiTbhpyUL17Eg5prH39EgMP8uSDdD554OdND3LFETAQg@mail.gmail.com>
Xref csiph.com gnu.bash.bug:16178

Show key headers only | View raw


On 4/19/20 10:53 AM, George Jones wrote:
> It looks like hash_search just does a linear walk if array entries to find
> elements in a list.   This slows down (order N?) new inserts when the
> number of entries gets large.

Well, that's the collision handling mechanism. You have to have one. If the
hash table is sized right -- and it's entirely possible that the default
size of the hash table for associative arrays is too small for your use
case -- it's not much overhead.

Chet
-- 
``The lyf so short, the craft so long to lerne.'' - Chaucer
		 ``Ars longa, vita brevis'' - Hippocrates
Chet Ramey, UTech, CWRU    chet@case.edu    http://tiswww.cwru.edu/~chet/

Back to gnu.bash.bug | Previous | Next | Find similar


Thread

Re: speeding up hash_search? Chet Ramey <chet.ramey@case.edu> - 2020-04-19 15:46 -0400

csiph-web