Path: csiph.com!weretis.net!feeder6.news.weretis.net!4.us.feeder.erje.net!feeder.erje.net!goblin1!goblin.stu.neva.ru!usenet.stanford.edu!not-for-mail
From: Chet Ramey <chet.ramey@case.edu>
Newsgroups: gnu.bash.bug
Subject: Re: Locale not Obeyed by Parameter Expansion with Pattern Substitution
Date: Wed, 20 Nov 2019 09:11:59 -0500
Lines: 42
Approved: bug-bash@gnu.org
Message-ID: <mailman.2087.1574259130.13325.bug-bash@gnu.org>
References: <0acc4767-e87f-f163-b39e-f137effdfea2.ref@sbcglobal.net> <0acc4767-e87f-f163-b39e-f137effdfea2@sbcglobal.net> <b1deb903-fe72-e8e1-5357-d2d500a1da83@case.edu>
Reply-To: chet.ramey@case.edu
NNTP-Posting-Host: lists.gnu.org
Mime-Version: 1.0
Content-Type: text/plain; charset=utf-8; format=flowed
Content-Transfer-Encoding: 8bit
Cc: chet.ramey@case.edu
To: Chris Carlen <crobc@sbcglobal.net>, bug-bash@gnu.org
Envelope-to: bug-bash@gnu.org
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.14; rv:68.0) Gecko/20100101 Thunderbird/68.2.2
In-Reply-To: <0acc4767-e87f-f163-b39e-f137effdfea2@sbcglobal.net>
Content-Language: en-US
Precedence: list
Xref: csiph.com gnu.bash.bug:15618

On 11/17/19 4:25 AM, Chris Carlen wrote:

> Bash Version: 5.0
> Patch Level: 0
> Release Status: release
> 
> Description:
>    UTF-8 multibyte char string split into bytes rather than characters.
> 
> Repeat-By:
> 
> #!/bin/bash
> 
> shopt -s extglob
> LC_ALL="en_US.UTF-8"
> 
> # E.g., normal/expected behavior:
> 
> # Create a string:
> A=abc
> 
> # Replace left virtual empty strings with spaces, putting separated
> # chars into positional parameters, then print them quoted:
> set -- ${A//?()/ }
> echo "${@@Q}"       #-> 'a' 'b' 'c'
> 
> # E.g., abnormal behavior:
> 
> # write 'REVERSE PILCROW SIGN' to B, then repeat as above:
> printf -v B '\u204B'
> set -- ${B//?()/ }
> echo "${@@Q}"       #-> $'\342' $'\201' $'\213'

Yes, this is a problem. The null match requires advancing through the
string by one character, instead of one byte. I'll fix it.

Chet
-- 
``The lyf so short, the craft so long to lerne.'' - Chaucer
		 ``Ars longa, vita brevis'' - Hippocrates
Chet Ramey, UTech, CWRU    chet@case.edu    http://tiswww.cwru.edu/~chet/