Path: csiph.com!xmission!news.snarked.org!border2.nntp.dca1.giganews.com!nntp.giganews.com!news.iecc.com!.POSTED.news.iecc.com!nerds-end From: awanderin Newsgroups: comp.compilers Subject: Re: Applesoft tokenization phases? Date: Mon, 16 Mar 2020 00:07:19 -0600 Organization: A noiseless patient Spider Lines: 38 Sender: news@iecc.com Approved: comp.compilers@iecc.com Message-ID: <20-03-016@comp.compilers> References: <20-03-013@comp.compilers> Mime-Version: 1.0 Content-Type: text/plain Injection-Info: gal.iecc.com; posting-host="news.iecc.com:2001:470:1f07:1126:0:676f:7373:6970"; logging-data="56247"; mail-complaints-to="abuse@iecc.com" Keywords: Basic, history Posted-Date: 16 Mar 2020 20:51:08 EDT X-submission-address: compilers@iecc.com X-moderator-address: compilers-request@iecc.com X-FAQ-and-archives: http://compilers.iecc.com Xref: csiph.com comp.compilers:2487 "Ev. Drikos" writes: > This question relates to thread "Languages with Optional Spaces". > > In an Applesoft II manual I've found at "classiccmp.org" [1], page 7, > we read that in a variable name any alphanumeric characters after the > first two are ignored, unless they contain a reserved world. FEND ie > would be illegal as it contains END. > > To implement such a rule one could first recognize keywords and then > recognize any names. We see in p123 that stmt I is tokenized as II: > I. stmt: 100 FOR A = LOFT OR CAT To 15 > II. tokens: 100 FOR A = LOF TO RC AT To 15 > > Yet, I've found ie a program at "hoist-point.com" [2] that contains: > 110 DIFF = ABS(A(I)-N) If you type that into Applesoft BASIC, it parses it as: 110 D IF F = ABS (A(I) - N) The spaces are how Applesoft lists it (it puts spaces around each token; variables are not parsed as tokens at entry time, they are only parsed at run-time). > Also, an online AppleSoft simulator at calormen.com [3] accepts ie both > DIFF and FEND as valid variable names. It is doing things differently than actual Applesoft. > As it seems, this issue can affect a design choice for the tokenization > phases of an Applesoft front-end. Is the manual just informative or the > online simulator does not accept (precisely) the particular dialect? The latter; the simulator accepts a different dialect. -- Jerry awanderin at gmail dot com