Path: csiph.com!weretis.net!feeder6.news.weretis.net!news.misty.com!news.iecc.com!.POSTED.news.iecc.com!nerds-end
From: "Ev. Drikos" <drikosev@gmail.com>
Newsgroups: comp.compilers
Subject: Re: Scannerless parsing was: Why does the lexer convert text integer lexemes ...?
Date: Fri, 22 Jul 2022 12:29:40 +0300
Organization: Aioe.org NNTP Server
Lines: 34
Sender: news@iecc.com
Approved: comp.compilers@iecc.com
Message-ID: <22-07-045@comp.compilers>
References: <22-07-011@comp.compilers> <22-07-030@comp.compilers> <22-07-036@comp.compilers> <22-07-042@comp.compilers>
Mime-Version: 1.0
Content-Type: text/plain; charset=utf-8; format=flowed
Content-Transfer-Encoding: 8bit
Injection-Info: gal.iecc.com; posting-host="news.iecc.com:2001:470:1f07:1126:0:676f:7373:6970"; logging-data="78604"; mail-complaints-to="abuse@iecc.com"
Keywords: lex, design
Posted-Date: 22 Jul 2022 13:01:47 EDT
X-submission-address: compilers@iecc.com
X-moderator-address: compilers-request@iecc.com
X-FAQ-and-archives: http://compilers.iecc.com
Content-Language: en-US
Xref: csiph.com comp.compilers:3134

On 21/07/2022 13:41, Ev. Drikos wrote:
> ...
>
> [I don't see how this grammar will allow a comment before the statement.
> -John]


The where-used list of the separator contains four regular rules. Which
means I've added them explicitly, as shown at the end of the message.

What I suspect may be restrictive is that the lookahead operator accepts
only the next token, simply one letter in a scannerless grammar. Yet, in
SQL the (Unicode) delimited identifier doesn't end ie with a repeated
symbol as the identifier body of a regular identifier.

Here is the grammar for further inspection and error report:
https://gist.github.com/drikosev/3104c3cb79b0b4d8f41da6162f4c65d3


Regards,
Ev. Drikos


-----------------------------------------------------------------------
<direct SQL statement> ::=
            [ <separator> ] <directly executable statement> <semicolon>

<binary string literal>::= X<quote>[{<hexit><hexit>}...]<quote>
                [{<separator><quote>[{<hexit><hexit>}...]<quote>}...]


<national character string literal> ::= (too long) ...

<Unicode character string literal>  ::= (too long) ...