Path: csiph.com!xmission!news.snarked.org!news.linkpendium.com!news.linkpendium.com!panix!usenet.stanford.edu!not-for-mail
From: Bize Ma <binaryzebra@gmail.com>
Newsgroups: gnu.bash.bug
Subject: Bash removes unrequested characters in bracket expressions (not a range).
Date: Fri, 23 Nov 2018 19:09:09 -0400
Lines: 47
Approved: bug-bash@gnu.org
Message-ID: <mailman.4515.1543014568.1284.bug-bash@gnu.org>
NNTP-Posting-Host: lists.gnu.org
Mime-Version: 1.0
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable
To: bug-bash <bug-bash@gnu.org>, bash@packages.debian.org
Envelope-to: bug-bash@gnu.org
Precedence: list
Xref: csiph.com gnu.bash.bug:14847

Configuration Information [Automatically generated, do not change]:
Machine: x86_64
OS: Linux-gnu
Compiler: gcc
Compilation CFLAGS:  -DPROGRAM=3D'bash' -DCONF_HOSTTYPE=3D'x86_64'
-DCONF_OSTYPE=3D'linux-gnu' -DCONF_MACHTYPE=3D'x86_64-pc-linux-gnu'
-DCONF_VENDOR=3D'pc' -DLOCALEDIR=3D'/usr/share/locale' -DPACKAGE=3D'bash'
-DSHELL -DHAVE_CONFIG_H   -I.  -I../. -I.././include -I.././lib
-Wdate-time -D_FORTIFY_SOURCE=3D2 -g -O2
-fdebug-prefix-map=3D/build/bash-7fckc0/bash-4.4=3D.
-fstack-protector-strong -Wformat -Werror=3Dformat-security -Wall
-no-pie -Wno-parentheses -Wno-format-security
uname output: Linux io 4.9.0-8-amd64 #1 SMP Debian 4.9.130-2
(2018-10-27) x86_64 GNU/Linux
Machine Type: x86_64-pc-linux-gnu

Bash Version: 4.4
Patch Level: 12
Release Status: release



Description:

Bash is removing characters not explicitly listed in a bracket
expression (character range).
In this example, it is removing digits from other languages.

Also tested (and it fails) in bash 3.{0,1,3} 4.{1,2,3} and 5.0
Not a problem in bash 2.{0,1}



Repeat-By:

If the characters are a problem: please visit:
https://unix.stackexchange.com/q/483743/265604

    $ a=3D'0123456789 =D9=A0=D9=A1=D9=A2=D9=A3=D9=A4=D9=A5=D9=A6=D9=A7=D9=
=A8=D9=A9 =DB=B0=DB=B1=DB=B2=DB=B3=DB=B4=DB=B5=DB=B6=DB=B7=DB=B8=DB=B9 =DF=
=80=DF=81=DF=82=DF=83=DF=84=DF=85=DF=86=DF=87=DF=88=DF=89 =E0=A5=A6=E0=A5=
=A7=E0=A5=A8=E0=A5=A9=E0=A5=AA=E0=A5=AB=E0=A5=AC=E0=A5=AD=E0=A5=AE=E0=A5=AF=
'
    $ echo "${a//[0123456789]}"
      =DB=B0=DB=B1=DB=B2=DB=B3=DB=B4=DB=B5=DB=B6=DB=B7=DB=B8=DB=B9 =DF=80=
=DF=81=DF=82=DF=83=DF=84=DF=85=DF=86=DF=87=DF=88=DF=89 =E0=A5=A6=E0=A5=A7=
=E0=A5=A8=E0=A5=A9=E0=A5=AA=E0=A5=AB=E0=A5=AC=E0=A5=AD=E0=A5=AE=E0=A5=AF