Path: csiph.com!xmission!news.snarked.org!news.linkpendium.com!news.linkpendium.com!panix!usenet.stanford.edu!not-for-mail
From: =?UTF-8?B?SXN0dsOhbiBQw6FzenRvcg==?= <pasztorpisti@gmail.com>
Newsgroups: gnu.bash.bug
Subject: Minor utf32-to-utf8 bug
Date: Sun, 10 Nov 2019 14:07:49 +0000
Lines: 39
Approved: bug-bash@gnu.org
Message-ID: <mailman.1182.1573396992.13325.bug-bash@gnu.org>
References: <CAFg+f+oDHn-5fyQGR4u3AWVTzwwXzDxv8y_kM8hb5_MAdZmurw@mail.gmail.com>
NNTP-Posting-Host: lists.gnu.org
Mime-Version: 1.0
Content-Type: multipart/mixed; boundary="000000000000fb714a0596fe8a10"
To: bug-bash@gnu.org
Envelope-to: bug-bash@gnu.org
Precedence: list
Xref: csiph.com gnu.bash.bug:15591

--000000000000fb714a0596fe8a10
Content-Type: text/plain; charset="UTF-8"

Hi

The encoding of six bytes long utf-8 sequences is buggy. Today unicode
requires at most 4 bytes long utf-8 sequences but if we handle 5 and 6 too
then let's do it the right way.

The attached patch was created using a fresh master clone
(d894cfd104086ddf68c286e67a5fb2e02eb43b7b).

I'm writing a tool (pxargs, an xargs variant) that can accept input strings
in shell-quoted format and used the bash manual and source code as
references. I haven't compiled the latest bash sources to check the bug but
it is likely to affect ANSI-C quoted strings like $'\U7fffffff'.

Best Regards,
Istvan Pasztor

--000000000000fb714a0596fe8a10
Content-Type: application/octet-stream; 
	name="six_bytes_long_utf8_sequences_d894cfd104086ddf68c286e67a5fb2e02eb43b7b.patch"
Content-Disposition: attachment; 
	filename="six_bytes_long_utf8_sequences_d894cfd104086ddf68c286e67a5fb2e02eb43b7b.patch"
Content-Transfer-Encoding: base64
Content-ID: <f_k2t1zper0>
X-Attachment-Id: f_k2t1zper0

ZGlmZiAtLWdpdCBhL2xpYi9zaC91bmljb2RlLmMgYi9saWIvc2gvdW5pY29kZS5jCmluZGV4IGZl
MTNjNGEwLi4xMjk4MGM0MyAxMDA2NDQKLS0tIGEvbGliL3NoL3VuaWNvZGUuYworKysgYi9saWIv
c2gvdW5pY29kZS5jCkBAIC0xOTYsNyArMTk2LDcgQEAgdTMydG91dGY4ICh3YywgcykKICAgICB9
CiAgIGVsc2UgaWYgKHdjIDwgMHgwODAwMDAwMDApCiAgICAgewotICAgICAgc1swXSA9ICh3YyA+
PiAzMCkgfCAweGY4OworICAgICAgc1swXSA9ICh3YyA+PiAzMCkgfCAweGZjOwogICAgICAgc1sx
XSA9ICgod2MgPj4gMjQpICYgMHgzZikgfCAweDgwOwogICAgICAgc1syXSA9ICgod2MgPj4gMTgp
ICYgMHgzZikgfCAweDgwOwogICAgICAgc1szXSA9ICgod2MgPj4gMTIpICYgMHgzZikgfCAweDgw
Owo=
--000000000000fb714a0596fe8a10--