Path: csiph.com!x330-a1.tempe.blueboxinc.net!usenet.pasdenom.info!aioe.org!feeder.news-service.com!xlned.com!feeder7.xlned.com!news2.euro.net!newsgate.cistron.nl!newsgate.news.xs4all.nl!post.news.xs4all.nl!not-for-mail Return-Path: X-Original-To: python-list@python.org Delivered-To: python-list@mail.python.org X-Spam-Status: OK 0.000 X-Spam-Evidence: '*H*': 1.00; '*S*': 0.00; 'python,': 0.01; '(except': 0.05; 'parser': 0.05; 'char': 0.07; 'terry': 0.07; 'python': 0.08; 'cool.': 0.09; 'higher-level': 0.09; 'received:80.91': 0.09; 'received:80.91.229': 0.09; 'received:80.91.229.12': 0.09; 'received:gmane.org': 0.09; 'received:list': 0.09; 'received:lo.gmane.org': 0.09; 'similarly,': 0.09; 'subject:parameters': 0.09; 'tends': 0.09; 'output': 0.11; 'syntax': 0.11; '>>>': 0.12; 'def': 0.12; 'am,': 0.14; 'wrote:': 0.14; 'automata.': 0.16; 'bit.': 0.16; 'outline': 0.16; 'parser,': 0.16; 'rationale': 0.16; 'reedy': 0.16; 'subject:function': 0.16; '\xe9crit': 0.16; 'algorithm': 0.16; 'float': 0.16; 'language': 0.18; 'yield': 0.19; 'convert': 0.19; 'jan': 0.20; 'header:In- Reply-To:1': 0.21; 'appropriate': 0.21; 'breaks': 0.23; 'code': 0.24; 'typically': 0.28; 'depends': 0.29; 'fact': 0.30; 'signals': 0.30; 'words,': 0.32; 'header:X-Complaints-To:1': 0.32; 'does': 0.33; 'to:addr:python-list': 0.33; 'generally': 0.33; 'handling': 0.33; 'list': 0.33; 'error': 0.33; 'regular': 0.34; 'file': 0.34; 'thinking': 0.34; 'characters': 0.34; 'there': 0.35; 'header:User- Agent:1': 0.35; '"",': 0.35; 'breaking': 0.35; 'like:': 0.35; 'symbol': 0.35; 'languages': 0.35; 'takes': 0.37; 'something': 0.37; 'bigger': 0.37; 'case': 0.37; 'two': 0.37; 'received:org': 0.38; 'run': 0.38; 'but': 0.38; 'implemented': 0.38; 'subject:: ': 0.38; 'some': 0.38; 'easier': 0.39; 'header:Mime-Version:1': 0.39; 'add': 0.39; 'to:addr:python.org': 0.39; 'current': 0.40; 'ready': 0.63; 'believe': 0.66; 'here': 0.66; 'natural': 0.68; 'skip:5 10': 0.72; 'stream': 0.77; 'decades,': 0.84; 'lookup,': 0.84; 'punctuation.': 0.84 X-Injected-Via-Gmane: http://gmane.org/ To: python-list@python.org From: Terry Reedy Subject: Re: scope of function parameters Date: Mon, 30 May 2011 12:49:26 -0400 References: <94fdk7FihlU1@mid.individual.net> <87tycd89qc.fsf@benfinney.id.au> <4DE3495D.9080309@gmail.com> <4DE35E87.8060208@gmail.com> Mime-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: quoted-printable X-Gmane-NNTP-Posting-Host: rain.gmane.org User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.2.17) Gecko/20110414 Lightning/1.0b2 Thunderbird/3.1.10 In-Reply-To: <4DE35E87.8060208@gmail.com> X-BeenThere: python-list@python.org X-Mailman-Version: 2.1.12 Precedence: list List-Id: General discussion list for the Python programming language List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Newsgroups: comp.lang.python Message-ID: Lines: 64 NNTP-Posting-Host: 82.94.164.166 X-Trace: 1306774185 news.xs4all.nl 49184 [::ffff:82.94.164.166]:48156 X-Complaints-To: abuse@xs4all.nl Xref: x330-a1.tempe.blueboxinc.net comp.lang.python:6667 On 5/30/2011 5:08 AM, Laurent Claessens wrote: > Le 30/05/2011 11:02, Terry Reedy a =E9crit : >> On 5/30/2011 3:38 AM, Laurent wrote: >> >>> Cool. I was thinking that "5" was the name, but >>> >>> 5.__add__(6) >>> File "", line 1 >>> 5.__add__(6) >> >> >> Try 5 .__add__(6) > > What is the rationale behind the fact to add a space between "5" and > ".__add__" ? > Why does it work ? Others have given you specific answers, here is the bigger picture. For decades, text interpreter/compilers have generally run in two phases:= 1. a lexer/tokenizer that breaks the stream of characters into tokens; 2. a parser that recognizes higher-level syntax and takes appropriate=20 action. Lexers are typically based on regular grammars and implemented as very=20 simple and fast deterministic finite-state automata. In outline (leaving = out error handling and end-of-stream handling), something like: def lexer(stream, lookup, initial_state): state =3D initial_state buffer =3D [] for char in stream: state,out =3D lookup[state,char] if out: yield output(buffer) # convert list of chars to token expected by parser, clear buffer buffer +=3D char There is no backup and no lookahead (except for the fact that output=20 excludes the current char). For python, lookup[start,'5'] =3D=3D=20 in_number,False, and lookup[in_number,'.'] =3D=3D in_float,False. >>> 5..__add__(6) 11.0 works because lookup[in_float,'.'] =3D=3D start,True, because buffer now = contains a completed float ready to output and '.' signals the start of=20 a new token. I believe we read natural language text similarly, breaking it into=20 words and punctuation. I believe the ability to read programs depends on = being able to adjust the internal lexer a bit. Python is easier to read=20 than some other algorithm languages because it tends to have at most one = punctuation-like symbol unit between words, as is the case in the code=20 above. --=20 Terry Jan Reedy