Re: Minor utf32-to-utf8 bug

Path	csiph.com!xmission!news.snarked.org!news.linkpendium.com!news.linkpendium.com!panix!usenet.stanford.edu!not-for-mail
From	Chet Ramey <chet.ramey@case.edu>
Newsgroups	gnu.bash.bug
Subject	Re: Minor utf32-to-utf8 bug
Date	Mon, 11 Nov 2019 10:03:22 -0500
Organization	ITS, Case Western Reserve University
Lines	16
Approved	bug-bash@gnu.org
Message-ID	<mailman.1246.1573484636.13325.bug-bash@gnu.org> (permalink)
References	<CAFg+f+oDHn-5fyQGR4u3AWVTzwwXzDxv8y_kM8hb5_MAdZmurw@mail.gmail.com> <c725a382-b12e-896a-bfaa-fc6e16c2c33c@case.edu>
Reply-To	chet.ramey@case.edu
NNTP-Posting-Host	lists.gnu.org
Mime-Version	1.0
Content-Type	text/plain; charset=utf-8
Content-Transfer-Encoding	8bit
X-Trace	usenet.stanford.edu 1573484636 30330 209.51.188.17 (11 Nov 2019 15:03:56 GMT)
X-Complaints-To	action@cs.stanford.edu
Cc	chet.ramey@case.edu
To	István Pásztor <pasztorpisti@gmail.com>, bug-bash@gnu.org
Envelope-to	bug-bash@gnu.org
DKIM-Signature	v=1; a=rsa-sha256; c=relaxed/relaxed; d=case.edu; s=smtp-primary; t=1573484631; bh=8ryIRheyjiCSx9arYw7JFprDQ8shJT2MkcOJv4z7sXw=; h=Reply-To:Cc:Subject:To:References:From:Message-ID:Date: MIME-Version:In-Reply-To:Content-Type:Content-Transfer-Encoding; b=HZlcaczGQbDxNw7UST9QtlEYwKHltfheJd4p81nvD4ZUMPanQJCd+CnEYrGaESM+sq DdGhOogE9zpBbrq521yC33qh0YiKSCAdGPy21VEFzv9iIuRLvOkGB0iNxxgspfuAr7u Dagx0Aebrv5rNhFLuxzXAz1Nb8Tgur765bsvF7TOb2B+Ulz2iSnQea8DVp1cPZShQqp y39kDnJLCaBSCGEtMECwN+SRV57rOaBh2CqbvrbwH8q6BrGTvqO3k1hpyl3qTAPf0j3 L3/hSBuTRUyMLy+KgOgUESEBMckN8B149LgjptMNdS1aRPONYBymcV0RAhYFVtO/zNo naBW52Qw==
DKIM-Signature	v=1; a=rsa-sha256; c=relaxed/relaxed; d=case.edu; s=smtp-primary; t=1573484630; bh=+z2evFyEhE+2H0sX2RGvsiMsFnXg3+4k83lBm34VWg0=; h=Reply-To:Cc:Subject:To:References:From:Message-ID:Date: MIME-Version:In-Reply-To:Content-Type:Content-Transfer-Encoding; b=gC+ewl+yGtV3OBaw0uBTu3r8tapPK1auM4YUvE4Ck6fym0a2VSNIVkT5Q3eCfayxYs jP5TUxAsN2b0K/2pAUGOXnsRD73wRFhP647MeumXM2Uo7ID4Z6xMv8KFKGPykgGdglv YX73ud3fTDHIQvQRwmKmGF8zYZuvVPFdpwEAI/xd6fNKLYTAeLnF9Uv98yfT8cz1qjw +rKXp3PsKJITI7ti4/QFHsNeRKF07M5G4YL41QAB7ZTWtABISlv7v0oadJkNzwWY1Ea /WYeaooUgf5AsALuv+Fsd9rdlkDIsEyUUCAYPRL/wGxJqGsBO8nekjJ96pFaJfxFUh3 a1DGdM/g==
DKIM-Signature	v=1; a=rsa-sha256; c=relaxed/relaxed; d=case.edu; s=g-case; h=reply-to:cc:subject:to:references:from:openpgp:autocrypt :organization:message-id:date:user-agent:mime-version:in-reply-to :content-language:content-transfer-encoding; bh=+z2evFyEhE+2H0sX2RGvsiMsFnXg3+4k83lBm34VWg0=; b=Nbj7iiyV/jdT67YW5nWSlNmdy0D7j2HauzJKUyZLiDSteGW5A88iSlK43gAfWVEJTW CyUoNfZzm2gSwzGciXjBUZ+E8CeKQHq23n7FG3dgYfGDjNUcyGjNaEdyxzDn6IDK4aSA o0swDi83yrVa67atTjIO+Yxx1jTtFtpRlxgSV1iHdnEDmUdNp80GrbzoB+oqxx8V5HNp zigCj+CDxiFl1RCDHXS7IojeJ5AV+I6FHE2fSE6qrdeXbYFoy3M5Q/TNiGwOyLx7sbKY kuICQ6EJhVIyhnm9vaqB/04r5p3680rLCmkndwHHVJ3P1Ku0AuAUz/+NqnH+HnJ+zARS 9Rxw==
X-Google-DKIM-Signature	v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:reply-to:cc:subject:to:references:from:openpgp :autocrypt:organization:message-id:date:user-agent:mime-version :in-reply-to:content-language:content-transfer-encoding; bh=+z2evFyEhE+2H0sX2RGvsiMsFnXg3+4k83lBm34VWg0=; b=JFemHZflS+FBJ39K+K2LCLc++iBG/YbLFaKzQ0P1bmedtLWfMvPk4keev4/1nXqJFF UYkGsAdXgfUaHOoUV/qRueo4fAtqT2350x3tiQ9fqDb/NJj8uWIwztFHG9GtiQCrFoyl PTWxMHUECjXMk806KcYqxeTpAVcIuts1PWO98nkFgR7pa3aHmHuhJLoHHVMQLHPWMVqU hgK8FOS1glyyNRsd8NuwH+lzMgWQMqq+QO/KydpC+ewy/Om+ziLJ5P1uowHaytSYKUTo XkubooZ35MXH/acBqfo4EoNeYwtQPrMR5hMnz7m6D81vBiPRwKaL+0o5fSGglqY/2Fot Q2NQ==
X-Gm-Message-State	APjAAAXQ+aM7G6Pqto943w1JmJRQqz9GaeGeTqh1nB+yRhGxl7a1G34x 3Pw4LvDLGQte8OxJSrcaGotS3Kgk+POHJPeSRNUA4QXlXuWKjqgd/V3CWrh4+kgcjf1I0flUvgR lOvvvWX54voc=
X-Received	by 2002:a05:6830:1e7b:: with SMTP id m27mr21670859otr.8.1573484628189; Mon, 11 Nov 2019 07:03:48 -0800 (PST)
X-Google-Smtp-Source	APXvYqwOQ2myOlapqvsTASHNrKfza8hsJRcaHnO1miJj2JR/CpzxJvHJXMjT3cFNrKgqUdhbq94DIA==
X-Received	by 2002:a05:6830:1e7b:: with SMTP id m27mr21670834otr.8.1573484627763; Mon, 11 Nov 2019 07:03:47 -0800 (PST)
Openpgp	preference=signencrypt
Autocrypt	addr=chet.ramey@case.edu; prefer-encrypt=mutual; keydata= mQGiBEEOsGwRBACFa0A1oa71HSZLWxAx0svXzhOZNQZOzqHmSuGOG92jIpQpr8DpvgRh40Yp AwdcXb8QG1J5yGAKeevNE1zCFaA725vGSdHUyypHouV0xoWwukYO6qlyyX+2BZU+okBUqoWQ koWxiYaCSfzB2Ln7pmdys1fJhcgBKf3VjWCjd2XJTwCgoFJOwyBFJdugjfwjSoRSwDOIMf0D /iQKqlWhIO1LGpMrGX0il0/x4zj0NAcSwAk7LaPZbN4UPjn5pqGEHBlf1+xDDQCkAoZ/VqES GZragl4VqJfxBr29Ag0UDvNbUbXoxQsARdero1M8GiAIRc50hj7HXFoERwenbNDJL86GPLAQ OTGOCa4W2o29nFfFjQrsrrYHzVtyA/9oyKvTeEMJ7NA3VJdWcmn7gOu0FxEmSNhSoV1T4vP2 1Wf7f5niCCRKQLNyUy0wEApQi4tSysdz+AbgAc0b/bHYVzIf2uO2lIEZQNNt+3g2bmXgloWm W5fsm/di50Gm1l1Na63d3RZ00SeFQos6WEwLUHEB0yp6KXluXLLIZitEJLQwQ2hldCBSYW1l eSAoQ2FzZSBzdGFuZGFyZCkgPGNoZXQucmFtZXlAY2FzZS5lZHU+iF8EExECAB8FAkPi19EC GwMHCwkIBwMCAQMVAgMDFgIBAh4BAheAAAoJELtYafBk6nSrelkAn31Gsuib7GcCZHbv5L5t VKYR9LklAJ4hzUHKA49Z0QXR+qCb80osIcmPSbkBDQRBDrBvEAQAkK6TAOKBEM+EC4j6V/7o /riVZqcgU5cid2qG9TXdwNtD9a3kvA/ObZBO93sX59wc6Bnwo4VJxsOmMlpGrAjJsxNwg3QH akEtf8LXRbVpj5xStdmBdQZUhIQyalo/2/TZq5OijtddUQcL5cs70hTv/FpT3wUvr2Xr8rjF 41IFEz8AAwcD/A0CZEGlzIrT5WCBnl6xBog/8vKiUCbarByat3d1mL6DbizvKNXQRTC9E/vE dENAWCQCjr75Bu55xT8n3SXGtWdDC5xmZ/P3OBYORP8yl8H8I1FIosWOFirbIeYdZPq8SPD1 HL+EXo9zSiHVrrZRJ19ooCKKbSdXHFCY+aJG+0KZiEkEGBECAAkFAkEOsG8CGwwACgkQu1hp 8GTqdKvjcACfZlkVCDwaz/NTO9cy3t69oWpVPNwAnRwe0qk/WL/gfhH346xh5B3HFbFN
User-Agent	Mozilla/5.0 (Macintosh; Intel Mac OS X 10.14; rv:60.0) Gecko/20100101 Thunderbird/60.9.1
In-Reply-To	<CAFg+f+oDHn-5fyQGR4u3AWVTzwwXzDxv8y_kM8hb5_MAdZmurw@mail.gmail.com>
Content-Language	en-US
X-Junkmail-Status	score=7/90, host=mpv2-2015.case.edu
X-Junkmail-PrAS-Raw	score=7/90, refid=2.7.2:2019.11.11.140017:17:7.944, ip=, rules=__YOUTUBE_RCVD, DKIM_SIGNATURE, __X_GOOGLE_DKIM_SIGNATURE, __HAS_REPLYTO, __HAS_CC_HDR, __SUBJ_REPLY, __BOUNCE_CHALLENGE_SUBJ, __BOUNCE_NDR_SUBJ_EXEMPT, __SUBJ_ALPHA_END, __TO_MALFORMED_2, __TO_NAME, __TO_NAME_DIFF_FROM_ACC, __HAS_REFERENCES, __REFERENCES, __HAS_FROM, FROM_EDU_TLD, __HAS_MSGID, __SANE_MSGID, DATE_TZ_NA, __USER_AGENT, __MOZILLA_USER_AGENT, __MIME_VERSION, __IN_REP_TO, __CT, __CT_TEXT_PLAIN, __CTE, __REPLYTO_SAMEAS_FROM_ADDY, __REPLYTO_SAMEAS_FROM_ACC, __FROM_DOMAIN_IN_ANY_CC1, __FROM_DOMAIN_IN_ANY_CC2, __REPLYTO_SAMEAS_FROM_DOMAIN, __DKIM_ALIGNS_1, __DKIM_ALIGNS_2, __ANY_URI, __URI_WITH_PATH, __URI_NO_WWW, __CP_URI_IN_BODY, __SUBJ_ALPHA_NEGATE, __URI_IN_BODY, __URI_NOT_IMG, __FORWARDED_MSG, __BODY_NO_MAILTO, __NO_HTML_TAG_RAW, BODYTEXTP_SIZE_3000_LESS, BODY_SIZE_400_499, __MIME_TEXT_P1, __MIME_TEXT_ONLY, __URI_NS, [TRUNCATED], so=2010-03-03 19:42:08, dmn=2016-08-03-0138
X-detected-operating-system	by eggs.gnu.org: GNU/Linux 2.4.x-2.6.x [generic] [fuzzy]
X-Received-From	129.22.103.227
X-BeenThere	bug-bash@gnu.org
X-Mailman-Version	2.1.23
Precedence	list
List-Id	Bug reports for the GNU Bourne Again SHell <bug-bash.gnu.org>
List-Unsubscribe	<https://lists.gnu.org/mailman/options/bug-bash>, <mailto:bug-bash-request@gnu.org?subject=unsubscribe>
List-Archive	<https://lists.gnu.org/archive/html/bug-bash>
List-Post	<mailto:bug-bash@gnu.org>
List-Help	<mailto:bug-bash-request@gnu.org?subject=help>
List-Subscribe	<https://lists.gnu.org/mailman/listinfo/bug-bash>, <mailto:bug-bash-request@gnu.org?subject=subscribe>
X-Mailman-Original-Message-ID	<c725a382-b12e-896a-bfaa-fc6e16c2c33c@case.edu>
X-Mailman-Original-References	<CAFg+f+oDHn-5fyQGR4u3AWVTzwwXzDxv8y_kM8hb5_MAdZmurw@mail.gmail.com>
Xref	csiph.com gnu.bash.bug:15593

Show key headers only | View raw

On 11/10/19 9:07 AM, István Pásztor wrote:
> Hi
> 
> The encoding of six bytes long utf-8 sequences is buggy. Today unicode
> requires at most 4 bytes long utf-8 sequences but if we handle 5 and 6 too
> then let's do it the right way.

Thanks for the report and fix.

Chet

-- 
``The lyf so short, the craft so long to lerne.'' - Chaucer
		 ``Ars longa, vita brevis'' - Hippocrates
Chet Ramey, UTech, CWRU    chet@case.edu    http://tiswww.cwru.edu/~chet/

Back to gnu.bash.bug | Previous | Next | Find similar | Unroll thread

Thread

Re: Minor utf32-to-utf8 bug Chet Ramey <chet.ramey@case.edu> - 2019-11-11 10:03 -0500

csiph-web