Re: Parallel scanning, was How can the speed of a scanner be independent of the number of rules?

Path	csiph.com!weretis.net!feeder6.news.weretis.net!news.misty.com!news.iecc.com!.POSTED.news.iecc.com!nerds-end
From	Jan Ziak <0xe2.0x9a.0x9b@gmail.com>
Newsgroups	comp.compilers
Subject	Re: Parallel scanning, was How can the speed of a scanner be independent of the number of rules?
Date	Thu, 24 Mar 2022 11:18:41 -0700 (PDT)
Organization	Compilers Central
Lines	16
Sender	news@iecc.com
Approved	comp.compilers@iecc.com
Message-ID	<22-03-058@comp.compilers> (permalink)
References	<22-03-047@comp.compilers> <22-03-052@comp.compilers>
Mime-Version	1.0
Content-Type	text/plain; charset="UTF-8"
Injection-Info	gal.iecc.com; posting-host="news.iecc.com:2001:470:1f07:1126:0:676f:7373:6970"; logging-data="91980"; mail-complaints-to="abuse@iecc.com"
Keywords	lex, parallel
Posted-Date	24 Mar 2022 15:19:18 EDT
X-submission-address	compilers@iecc.com
X-moderator-address	compilers-request@iecc.com
X-FAQ-and-archives	http://compilers.iecc.com
In-Reply-To	<22-03-052@comp.compilers>
Xref	csiph.com comp.compilers:2955

Show key headers only | View raw

On Thursday, March 24, 2022 at 6:26:21 PM UTC+1, Jan Ziak wrote:
> [Is there anything published about parallel scanning? I'd think it'd be
> inherently sequential since you don't know the state for a character
> until you've processed all the previous characters. -John]

The belief that "scanning is inherently sequential since you don't
know the state for a character until you've processed all the previous
characters" is false for most programming languages (BASIC, Go, XML,
etc) for most real-world source codes.

-atom
[Well, OK, if I'm scanning XML and break it up into chunks to scan in parallel, how
do I know whether I'm inside a CDATA block?  Or are you just saying you can do
clumps of a few characters at a time?  Again, some sort of reference rather than
just claiming it's possible would be a help. -John]

Back to comp.compilers | Previous | Next — Previous in thread | Next in thread | Find similar

Thread

How can the speed of a scanner be independent of the number of rules? Roger L Costello <costello@mitre.org> - 2022-03-23 18:49 +0000
  Re: How can the speed of a scanner be independent of the number of rules? Kaz Kylheku <480-992-1380@kylheku.com> - 2022-03-23 21:27 +0000
    Re: How can the speed of a scanner be independent of the number of rules? gah4 <gah4@u.washington.edu> - 2022-03-23 19:57 -0700
    Re: How can the speed of a scanner be independent of the number of rules? Christopher F Clark <christopher.f.clark@compiler-resources.com> - 2022-03-24 13:12 +0200
    Re: How can the speed of a scanner be independent of the number of rules? Roger L Costello <costello@mitre.org> - 2022-03-24 11:53 +0000
      Re: How can the speed of a scanner be independent of the number of rules? Jan Ziak <0xe2.0x9a.0x9b@gmail.com> - 2022-03-24 11:56 -0700
        Re: How can the speed of a scanner be independent of the number of rules? gah4 <gah4@u.washington.edu> - 2022-03-24 13:08 -0700
  Re: How can the speed of a scanner be independent of the number of rules? Jan Ziak <0xe2.0x9a.0x9b@gmail.com> - 2022-03-24 02:01 -0700
    Re: Parallel scanning, was How can the speed of a scanner be independent of the number of rules? Jan Ziak <0xe2.0x9a.0x9b@gmail.com> - 2022-03-24 11:18 -0700
      Parallel lexers by chunking the input Christopher F Clark <christopher.f.clark@compiler-resources.com> - 2022-03-24 22:32 +0200
        Re: Parallel lexers by chunking the input anton@mips.complang.tuwien.ac.at (Anton Ertl) - 2022-03-25 08:04 +0000
          Re: Parallel lexers by chunking the input gah4 <gah4@u.washington.edu> - 2022-03-25 07:58 -0700
          Re: Parallel lexers by chunking the input anton@mips.complang.tuwien.ac.at (Anton Ertl) - 2022-03-25 17:47 +0000
            Parallel lexers by chunking the input. Christopher F Clark <christopher.f.clark@compiler-resources.com> - 2022-03-26 00:36 +0200
            Parallel lexers by chunking the input Christopher F Clark <christopher.f.clark@compiler-resources.com> - 2022-03-26 01:00 +0200
            Re: Parallel lexers by chunking the input anton@mips.complang.tuwien.ac.at (Anton Ertl) - 2022-03-26 09:27 +0000

csiph-web