Path: csiph.com!v102.xanadu-bbs.net!xanadu-bbs.net!feeder.erje.net!eu.feeder.erje.net!newsfeed.xs4all.nl!newsfeed2.news.xs4all.nl!xs4all!newsgate.cistron.nl!newsgate.news.xs4all.nl!post.news.xs4all.nl!not-for-mail Return-Path: X-Original-To: python-list@python.org Delivered-To: python-list@mail.python.org X-Spam-Status: OK 0.001 X-Spam-Evidence: '*H*': 1.00; '*S*': 0.00; 'binary': 0.07; 'utf-8': 0.07; 'differently.': 0.09; 'received:internal': 0.09; 'subject:files': 0.09; 'windows,': 0.09; 'python': 0.11; '"\\r\\n"': 0.16; "'r'": 0.16; "'rb')": 0.16; 'file).': 0.16; 'message-id:@webmail.messagingengine.com': 0.16; 'newlines': 0.16; 'received:10.202': 0.16; 'received:10.202.2': 0.16; 'received:66.111': 0.16; 'received:66.111.4': 0.16; 'received:66.111.4.27': 0.16; 'received:messagingengine.com': 0.16; 'received:out3-smtp.messagingengine.com': 0.16; 'subject:program': 0.16; 'files.': 0.16; 'wrote:': 0.18; 'thu,': 0.19; 'not,': 0.20; 'seems': 0.21; 'platforms': 0.22; 'specify': 0.24; 'header:In-Reply-To:1': 0.27; 'chris': 0.29; 'mode': 0.30; 'sep': 0.31; 'universal': 0.31; 'file': 0.32; 'text': 0.33; 'sense': 0.34; 'received:66': 0.35; "can't": 0.35; 'convert': 0.35; 'subject:data': 0.36; 'received:10': 0.37; 'to:addr:python- list': 0.38; 'files': 0.38; 'does': 0.39; 'bad': 0.39; 'to:addr:python.org': 0.39; 'skip:p 20': 0.39; 'ensure': 0.60; 'even': 0.60; 'from:no real name:2**0': 0.61; 'header:Message- Id:1': 0.63; 'results': 0.69; 'therefore': 0.72; '2014,': 0.84 DKIM-Signature: v=1; a=rsa-sha1; c=relaxed/relaxed; d=fastmail.us; h= message-id:from:to:mime-version:content-transfer-encoding :content-type:in-reply-to:references:subject:date; s=mesmtp; bh= ipOa8PlaihO8xXs4AhHEjTXj7Aw=; b=H/DxYQqHvgBY+Eecpteq9DROpeHBqwyK 0ZKakVATr1RgF57E3oTrK5GTlPqB/2v80u+yJFW+MDr6dk9kYLlzI0+xJF2MMA19 N/OVsNixfDC76h3OFh8oeFjWBKJnrSirZbe7GjIxU/KUZag1DfOT62Yksx0xgKNi rBWWFWv3lLc= DKIM-Signature: v=1; a=rsa-sha1; c=relaxed/relaxed; d= messagingengine.com; h=message-id:from:to:mime-version :content-transfer-encoding:content-type:in-reply-to:references :subject:date; s=smtpout; bh=ipOa8PlaihO8xXs4AhHEjTXj7Aw=; b=u9X g70aniUz/fnTWb9Er5xs4IqYlwOFO286v1SsViwdhYK6ViXDZSKlIklDz814odx1 v2SNa/CSzGCwIOY9+MH9rTJJOYNTsAnskQEeA49MALYb9pdRHlKNy+yG5TjK8UMA 8LfIhviy1xpGQacY8RSIA/zidGdc2seccYd5BWgU= X-Sasl-Enc: jtHZjs+6k3NuH3EZDdDOKAhUbiQ38fPexer5PewlozL4 1411414443 From: random832@fastmail.us To: python-list@python.org MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Type: text/plain X-Mailer: MessagingEngine.com Webmail Interface - ajax-b5aef30d In-Reply-To: References: Subject: Re: program to generate data helpful in finding duplicate large files Date: Mon, 22 Sep 2014 15:34:03 -0400 X-BeenThere: python-list@python.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: General discussion list for the Python programming language List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Newsgroups: comp.lang.python Message-ID: Lines: 12 NNTP-Posting-Host: 2001:888:2000:d::a6 X-Trace: 1411414446 news.xs4all.nl 2830 [2001:888:2000:d::a6]:46647 X-Complaints-To: abuse@xs4all.nl Xref: csiph.com comp.lang.python:78181 On Thu, Sep 18, 2014, at 14:45, Chris Kaynor wrote: > Additionally, you may want to specify binary mode by using > open(file_path, > 'rb') to ensure platform-independence ('r' uses Universal newlines, which > means on Windows, Python will convert "\r\n" to "\n" while reading the > file). Additionally, some platforms will treat binary files differently. Does 'r' not use universal newlines on unix? If not, why not? The only purpose seems to be to allow people to write bad programs and have them work on unix. It makes even less sense in python 3 where opening a file in text mode results in a TextIOWrapper with utf-8 encoding, and therefore can't be used on arbitrary binary files.