Path: csiph.com!xmission!news.snarked.org!border2.nntp.dca1.giganews.com!nntp.giganews.com!news.iecc.com!.POSTED.news.iecc.com!nerds-end
From: Ben Hanson <jamin.hanson@googlemail.com>
Newsgroups: comp.compilers
Subject: Re: Fragments
Date: Sun, 22 Dec 2019 11:08:32 -0800 (PST)
Organization: Compilers Central
Lines: 10
Sender: news@iecc.com
Approved: comp.compilers@iecc.com
Message-ID: <19-12-017@comp.compilers>
References: <19-12-013@comp.compilers>
Mime-Version: 1.0
Content-Type: text/plain; charset="UTF-8"
Injection-Info: gal.iecc.com; posting-host="news.iecc.com:2001:470:1f07:1126:0:676f:7373:6970"; logging-data="225"; mail-complaints-to="abuse@iecc.com"
Keywords: lex
Posted-Date: 22 Dec 2019 14:22:47 EST
X-submission-address: compilers@iecc.com
X-moderator-address: compilers-request@iecc.com
X-FAQ-and-archives: http://compilers.iecc.com
In-Reply-To: <19-12-013@comp.compilers>
Xref: csiph.com comp.compilers:2398

Have a string token type that auto normalises character ranges.

See https://github.com/BenHanson/lexertl14/blob/master/include/lexertl/string_token.hpp
Regards,

Ben

On Saturday, 21 December 2019 18:10:26 UTC, Andy  wrote:
> We can use "fragments" [A-Za-z], [0-9] instead of alone letters.
> Problem that fragments not always are disjoint: digits and all chars, letters and letter 'a', etc.