Path: csiph.com!newsfeed.hal-mli.net!feeder3.hal-mli.net!newsfeed.hal-mli.net!feeder1.hal-mli.net!newsfeed.xs4all.nl!newsfeed2.news.xs4all.nl!xs4all!post.news.xs4all.nl!not-for-mail Return-Path: X-Original-To: python-list@python.org Delivered-To: python-list@mail.python.org X-Spam-Status: OK 0.062 X-Spam-Evidence: '*H*': 0.88; '*S*': 0.00; 'matches': 0.07; 'subject:trying': 0.09; 'cc:addr:python-list': 0.11; '-tkc': 0.16; 'distinct': 0.16; 'from:addr:python.list': 0.16; 'from:addr:tim.thechases.com': 0.16; 'from:name:tim chase': 0.16; 'ignoring': 0.16; 'subject:non': 0.16; 'sure.': 0.16; 'wrote:': 0.18; 'slightly': 0.19; 'cc:addr:python.org': 0.22; 'cc:2**0': 0.24; 'cc:no real name:2**0': 0.24; 'right.': 0.26; 'header:In- Reply-To:1': 0.27; 'words': 0.29; 'characters': 0.30; 'searches': 0.31; 'figure': 0.32; 'skip:c 30': 0.32; "i'd": 0.34; 'but': 0.35; 'add': 0.35; 'possible': 0.36; 'example,': 0.37; 'hat': 0.38; 'rather': 0.38; 'ability': 0.39; 'unable': 0.39; 'how': 0.40; 'even': 0.60; 'easy': 0.60; 'french': 0.61; 'simply': 0.61; 'email addr:gmail.com': 0.63; 'more': 0.64; 'to:addr:gmail.com': 0.65; 'containing': 0.69; 'examples.': 0.84; 'received:50.22': 0.84; 'results,': 0.84; 'subject:.. ': 0.84 Date: Mon, 28 Oct 2013 09:23:41 -0500 From: Tim Chase To: wxjmfauth@gmail.com Subject: Re: trying to strip out non ascii.. or rather convert non ascii In-Reply-To: References: <526c412a$0$29972$c3e8da3$5496439d@news.astraweb.com> X-Mailer: Claws Mail 3.8.1 (GTK+ 2.24.10; x86_64-pc-linux-gnu) Mime-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-AntiAbuse: This header was added to track abuse, please include it with any abuse report X-AntiAbuse: Primary Hostname - boston.accountservergroup.com X-AntiAbuse: Original Domain - python.org X-AntiAbuse: Originator/Caller UID/GID - [47 12] / [47 12] X-AntiAbuse: Sender Address Domain - tim.thechases.com X-Get-Message-Sender-Via: boston.accountservergroup.com: authenticated_id: tim@thechases.com Cc: python-list@python.org X-BeenThere: python-list@python.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: General discussion list for the Python programming language List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Newsgroups: comp.lang.python Message-ID: Lines: 22 NNTP-Posting-Host: 2001:888:2000:d::a6 X-Trace: 1382970129 news.xs4all.nl 15916 [2001:888:2000:d::a6]:40000 X-Complaints-To: abuse@xs4all.nl Xref: csiph.com comp.lang.python:57826 On 2013-10-28 07:01, wxjmfauth@gmail.com wrote: >> Simply ignoring diactrics won't get you very far. >=20 > Right. As an example, these four French words : > cote, c=C3=B4te, cot=C3=A9, c=C3=B4t=C3=A9 . Distinct words with distinct meanings, sure. But when a na=C3=AFve (naive? =E2=98=BA) person or one without the easy abi= lity to enter characters with diacritics searches for "cote", I want to return possible matches containing any of your 4 examples. It's slightly fuzzier if they search for "cot=C3=A9", in which case they may mean "cot=C3=A9" or they might mean be unable to figure out how to add a hat and want to type "c=C3=B4t=C3=A9". Though I'd rather get more results, even if it has some that only match fuzzily. Circumflexually-circumspectly-yers, -tkc