Path: csiph.com!usenet.pasdenom.info!goblin2!goblin.stu.neva.ru!cyclone01.ams2.highwinds-media.com!news.highwinds-media.com!voer-me.highwinds-media.com!lightspeed.eweka.nl!lightspeed.eweka.nl!newsfeed.xs4all.nl!newsfeed2.news.xs4all.nl!xs4all!post.news.xs4all.nl!not-for-mail Return-Path: X-Original-To: python-list@python.org Delivered-To: python-list@mail.python.org X-Spam-Status: OK 0.124 X-Spam-Level: * X-Spam-Evidence: '*H*': 0.76; '*S*': 0.01; 'filename:fname piece:py': 0.07; 'skip:u 30': 0.07; 'subject:code': 0.07; '#print': 0.09; 'skip:f 70': 0.09; 'sfxlen:2': 0.11; 'codecs': 0.16; 'compute': 0.16; 'iteration': 0.16; 'subject:python': 0.16; 'import': 0.22; 'separate': 0.22; 'print': 0.22; 'train': 0.26; 'to:2**1': 0.27; 'to:no real name:2**1': 0.29; 'skip:b 30': 0.33; 'skip:t 40': 0.33; 'problem': 0.35; 'skip:s 30': 0.35; 'accuracy': 0.36; 'charset:us-ascii': 0.36; 'thank': 0.38; 'to:addr:python-list': 0.38; 'skip:b 40': 0.39; 'to:addr:python.org': 0.39; 'how': 0.40; 'skip:u 10': 0.60; 'read': 0.60; 'received:bf1.yahoo.com': 0.60; 'received:mail.bf1.yahoo.com': 0.60; 'skip:c 50': 0.60; 'skip:n 30': 0.60; 'skip:a 30': 0.61; 'skip:t 30': 0.61; 'received:79': 0.64; 'received:98.139.212': 0.68; 'skip:w 30': 0.69; 'received:bullet.mail.bf1.yahoo.com': 0.74; 'training': 0.77; 'skip:n 40': 0.81; 'to:addr:python-list-request': 0.84; 'pfxlen:2': 0.91; 'received:98.139.213': 0.91 X-Yahoo-Newman-Property: ymail-3 X-Yahoo-Newman-Id: 311734.38100.bm@omp1067.mail.bf1.yahoo.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s1024; t=1419030364; bh=VXBBr1U1nWU1J3bodXiIl1ejkiK1GBKAO7bjN51DAVM=; h=Message-ID:Date:From:Subject:To:MIME-Version:Content-Type; b=Efd0mkggVUmXMzClNca61pHi/0LcFdT5FS4jfOjOhJyal9FYK/Her4pvO+rMLUKKAKQF0pYeazPt8ISLV2uqup9iMld6qoFV93xlCeovGnJC6457qUzGOYurqcS/XhCTxzmzO9qfvQPI38oGkHIjZ5zj0jarV2rvt4Os01AoUlc= X-YMail-OSG: ooV93UYVM1lZMkqHW5MKltHTqdFGQ1r_.IsXBu5Nrq0JHEk rOPnNy3l4hMQI2Fk.lKFNDvK_V2y9IBPDBgLroZcVRhAg4SucKlOt1QdKtQy 21oy2dEMtMQAHEmV933gwyCowjwe9DXjxQMkmsMePxfRGC03fv.pzYp3FWA_ QB9BLYEkGmEXqDa5KKqdjBwu7jUsM.mEd_UVjRL2U0KCZJk4P0Slw7NZN4Qb LIi6n9merhGgsDAFsrOUciTu3u418m3N2hkZL9g99WHxHpzEMrPQd29tajY4 lurfXmT_QkMsLJNqh0LpPRVLLmswwU0pHx3RlifJasoUEguzM7VbfPMOvGQC 0M_cCgGIweSSJrqKNHUUo9GBT2MRODji7EAfUA0nYFYq20ROx_R0lKbDCbpp hq9wfn6RNgQzAuGv.XmCy.P_lf9.Ps6ZXtM1GGV8FcmbA_N8gqH8bZZWG6xh nCyWlwpkNFt4Ly9oj8JQ7NM0jZCt13GG_UEr9ljGZwtpzLIUqBZnM5VCNTAF q6X9hDByFNZLBHt5R9zGaerpfH9FaVNCvWwOZXIw- X-Rocket-MIMEInfo: 002.001, SGVsbG8gYWxsDQpJIEhhdmUgcHJvYmxlbSBhYm91dCAsIEhvdyBpIGNhbiBjb21wdXRlIGFjY3VyYWN5IHRvIHVuaWdyYW0sYmlncmFtIGFuZCB0cmlncmFtDQphbmQgaG93IGkgY2FuIGNoYW5nZSB0aGUgc2l6ZSB0byBpdGVyYXRpb24gc2VwYXJhdGUgZnJvbSAxIHRvIDEwIGluIGVhY2ggc3RhZ2UgZnJvbSBpdGVyYXRpb24gdHJhaW4gdGFrZSA5MCUgYW5kIHRyYWluaW5nIDEwJS4NCnRoYW5rIHlvdSB0byByZWFkIG15IG1lc3NhZ2UBMAEBAQE- X-Mailer: YahooMailClassic/903 YahooMailWebService/0.8.203.740 Date: Fri, 19 Dec 2014 15:06:04 -0800 From: Khetam Yassen Subject: code python To: python-list@python.org, python-list-request@python.org MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="1439723771-1947545414-1419030364=:84260" X-BeenThere: python-list@python.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: General discussion list for the Python programming language List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Newsgroups: comp.lang.python Message-ID: Lines: 70 NNTP-Posting-Host: 2001:888:2000:d::a6 X-Trace: 1419040705 news.xs4all.nl 2879 [2001:888:2000:d::a6]:42279 X-Complaints-To: abuse@xs4all.nl X-Received-Body-CRC: 2831125466 X-Received-Bytes: 8053 Xref: csiph.com comp.lang.python:82680 --1439723771-1947545414-1419030364=:84260 Content-Type: text/plain; charset=us-ascii Hello all I Have problem about , How i can compute accuracy to unigram,bigram and trigram and how i can change the size to iteration separate from 1 to 10 in each stage from iteration train take 90% and training 10%. thank you to read my message --1439723771-1947545414-1419030364=:84260 Content-Type: text/plain; name="tokenize_quran_corpus.py" Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="tokenize_quran_corpus.py" DQppbXBvcnQgY29kZWNzDQppbXBvcnQgbmx0aw0KZnJvbSBubHRrIGltcG9y dCoNCg0Kb3V0ZmlsZSA9IGNvZGVjcy5vcGVuKCd1bmlncmFtX3RhZ2dlZF9z ZW50c19vdXQudHh0JywndycsJ3V0Zi04JykNCm91dGZpbGUyID0gY29kZWNz Lm9wZW4oJ2JpZ3JhbV90YWdnZWRfc2VudHNfb3V0LnR4dCcsJ3cnLCd1dGYt OCcpDQpvdXRmaWxlMyA9IGNvZGVjcy5vcGVuKCd0cmlncmFtX3RhZ2dlZF9z ZW50c19vdXQudHh0JywndycsJ3V0Zi04JykNCkZpbGUxPWNvZGVjcy5vcGVu KCdDOlxwcm9qZWN0XENvcnB1c193b3JkLnR4dCcsJ3InLCd1dGZfOCcpLnJl YWRsaW5lcygpDQp3b3JkX3Bvc19saXN0ID0gW10NCnRva2Vucz1bXQ0KdHJh aW5fc2VudHM9W10NCnRlc3RfdGFnZ2VkX3NlbnRzPVtdDQphbGxfdGVzdF9z ZW50cyA9IFtdDQpuPTEwDQoNCg0KZm9yIGxpbmUgaW4gRmlsZTE6DQogICAg ICAgIHRva2VucyA9IGxpbmUuc3BsaXQoJ1x0JykNCiAgICAgICAgI3ByaW50 ICclc1x0JXNcdCVzJyAlICh0b2tlbnNbMF0sIHRva2Vuc1sxXSwgdG9rZW5z WzJdKQ0KICAgICAgICB3b3JkX3Bvc19saXN0LmFwcGVuZCgodG9rZW5zWzBd LCB0b2tlbnNbMV0pKQ0KICAgICAgICBhbGxfdGVzdF9zZW50cy5hcHBlbmQo dG9rZW5zWzBdKQ0KDQpmb3IgdCBpbiByYW5nZSgxMCk6ICAgICAgDQogICAg ICAgIHNpemU9aW50KGxlbih3b3JkX3Bvc19saXN0KSooMC45KSkNCiNwcmlu dCBzaXplDQogICAgICAgIHRyYWluX3NlbnRzLmFwcGVuZCh3b3JkX3Bvc19s aXN0WzpzaXplXSkNCiAgICAgICAgdGVzdF90YWdnZWRfc2VudHMuYXBwZW5k KHdvcmRfcG9zX2xpc3Rbc2l6ZTpdKQ0KICAgICAgICB0ZXN0X3NlbnRzPWFs bF90ZXN0X3NlbnRzW3NpemU6XQ0KDQogICAgICAgIHByaW50ICJ1bmlncmFt IHRhZ2dlciINCiNVbmlncmFtIHRhZ2dlcg0KDQogICAgICAgIHVuaWdyYW1f dGFnZ2VyID0gbmx0ay5VbmlncmFtVGFnZ2VyKHRyYWluX3NlbnRzKQ0KICAg ICAgICB0YWdnZWRfdW5pZ3JhbV9zZW50cyA9IHVuaWdyYW1fdGFnZ2VyLnRh Zyh0ZXN0X3NlbnRzKQ0KICAgICAgICBwcmludCB1bmlncmFtX3RhZ2dlci5l dmFsdWF0ZSh0ZXN0X3RhZ2dlZF9zZW50cykNCiAgICAgICAgZm9yICh3b3Jk LCB0YWcpIGluIHRhZ2dlZF91bmlncmFtX3NlbnRzOg0KICAgICAgICAgICAg IHByaW50Pj5vdXRmaWxlLCAnJXNcdCVzJyAlICh3b3JkLCB0YWcpDQogICAg ICAgIHByaW50IG5sdGsuYWNjdXJhY3kodGFnZ2VkX3VuaWdyYW1fc2VudHMs dGVzdF9zZW50cykgICAgIA0KDQoNCiNiaWdyYW0gdGFnZ2VyDQogICAgICAg IHByaW50ICJCaWdyYW0gVGFnZ2VyIg0KICAgICAgICBiaWdyYW1fdGFnZ2Vy ID0gbmx0ay5CaWdyYW1UYWdnZXIodHJhaW5fc2VudHMsYmFja29mZj0gdW5p Z3JhbV90YWdnZXIpDQogICAgICAgIHRhZ2dlZF9iaWdyYW1fc2VudHM9Ymln cmFtX3RhZ2dlci50YWcodGVzdF9zZW50cykNCiAgICAgICAgcHJpbnQgYmln cmFtX3RhZ2dlci5ldmFsdWF0ZSh0ZXN0X3RhZ2dlZF9zZW50cykNCiAgICAg ICAgZm9yICh3b3JkLCB0YWcpIGluIHRhZ2dlZF9iaWdyYW1fc2VudHM6DQog ICAgICAgICAgICAgcHJpbnQ+Pm91dGZpbGUyLCAnJXNcdCVzJyAlICh3b3Jk LCB0YWcpDQogICAgICAgDQoNCiNUcmlncmFtIHRhZ2dlcg0KICAgICAgICBw cmludCAiVHJpZ3JhbSBUYWdnZXIiDQoNCiAgICAgICAgdHJpZ3JhbV90YWdn ZXI9bmx0ay5UcmlncmFtVGFnZ2VyKHRyYWluX3NlbnRzLGJhY2tvZmY9IGJp Z3JhbV90YWdnZXIpDQogICAgICAgIHRhZ2dlZF90cmlncmFtX3NlbnRzPXRy aWdyYW1fdGFnZ2VyLnRhZyh0ZXN0X3NlbnRzKQ0KICAgICAgICBwcmludCB0 cmlncmFtX3RhZ2dlci5ldmFsdWF0ZSh0ZXN0X3RhZ2dlZF9zZW50cykNCiAg ICAgICAgZm9yICh3b3JkLCB0YWcpIGluIHRhZ2dlZF90cmlncmFtX3NlbnRz Og0KICAgICAgICAgICAgcHJpbnQ+Pm91dGZpbGUzLCAnJXNcdCVzJyAlICh3 b3JkLCB0YWcpDQpvdXRmaWxlLmNsb3NlKCkNCm91dGZpbGUyLmNsb3NlKCkN Cm91dGZpbGUzLmNsb3NlKCkNCg0KcHJpbnQgJ0RvbmUhJw0KI2FjY3VyYWN5 ID0gdW5pZ3JhbV90YWdnZXIuZXZhbHVhdGUodGFnZ2VkX3Rlc3Rfc2VudHMp DQojcHJpbnQgJ2FjY3VyYWN5ID0gJywgYWNjdXJhY3kNCiN0cmFpbl9zZW50 cy5hcHBlbmQoKHdvcmRfcG9zX2xpc3RbOnNpemVdKSkNCiNwcmludCB0cmFp bl9zZW50cw0KI3Rlc3Rfc2VudHMuYXBwZW5kKHdvcmRfcG9zX2xpc3Rbc2l6 ZTpdKQ0KI3ByaW50IHRlc3Rfc2VudHMNCiNiaWdyYW1fdGFnZ2VyPW5sdGsu QmlncmFtVGFnZ2VyKHRyYWluX3NlbnRzKQ0KI3ByaW50IGJpZ3JhbV90YWdn ZXIudGFnKHRva2Vuc1s6c2l6ZV0pDQojcHJpbnQgYmlncmFtX3RhZ2dlci5f dHJhaW4odHJhaW5fc2VudHMsY3V0b2ZmPXNpemUpDQoNCiNwcmludCBiaWdy YW1fdGFnZ2VyLmV2YWx1YXRlKHRlc3Rfc2VudHMpDQoNCiAgICAgICAgIA0K --1439723771-1947545414-1419030364=:84260--