Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]

Groups > comp.lang.python > #57994

RE: Using "with open(filename, 'ab'):" and calling code only if the file is new?

Show key headers only | View raw

On 29/10/2013 21:42, Joseph L. Casale wrote:

You forgot the attribution line:  "Victor says"
>>     with open(self.full_path, 'r') as input, open(self.output_csv, 'ab') as
>> output:
>>         fieldnames = (...)
>>         csv_writer = DictWriter(output, filednames)
>>         # Call csv_writer.writeheader() if file is new.
>>         csv_writer.writerows(my_dict)
>> 
>> I'm wondering what's the best way of calling writeheader() only if the file is
>> new?
>> 
>> My understanding is that I don't want to use os.path.exist(), since that opens
>> me up to race conditions.
>
> What stops you from checking before and setting a flag?

Like Victor says, that opens him up to race conditions.

Victor:

You need to more completely specify your environment.  Are there
multiple instances of this or similar program running simultaneously? 
If so, you've got lots more problems than a missing or duplicated header
line.  You could get partial lines intermixing between the two outputs.

Chances are if you really need to support more than one program at the
same time, you'll need to use a lower-level open, perhaps from the os
module.  Some form of locking is called for.  And if the data SHOULD be
interleaved, you'll have to arrange it so it gets done in whole number
increments.

-- 
DaveA

Back to comp.lang.python | Previous | Next — Previous in thread | Next in thread | Find similar | Unroll thread

Thread

Using "with open(filename, 'ab'):" and calling code only if the file is new? Victor Hooi <victorhooi@gmail.com> - 2013-10-29 18:02 -0700
  RE: Using "with open(filename, 'ab'):" and calling code only if the file is new? "Joseph L. Casale" <jcasale@activenetwerx.com> - 2013-10-30 01:42 +0000
  RE: Using "with open(filename, 'ab'):" and calling code only if the file is new? Dave Angel <davea@davea.name> - 2013-10-30 02:13 +0000
  RE: Using "with open(filename, 'ab'):" and calling code only if the file is new? "Joseph L. Casale" <jcasale@activenetwerx.com> - 2013-10-30 02:55 +0000
    Re: Using "with open(filename, 'ab'):" and calling code only if the file is new? Victor Hooi <victorhooi@gmail.com> - 2013-10-29 20:22 -0700
  Fwd: Using "with open(filename, 'ab'):" and calling code only if the file is new? Zachary Ware <zachary.ware+pylist@gmail.com> - 2013-10-29 22:28 -0500
  Re: Using "with open(filename, 'ab'):" and calling code only if the file is new? Antoon Pardon <antoon.pardon@rece.vub.ac.be> - 2013-10-30 08:53 +0100
  Re: Using "with open(filename, 'ab'):" and calling code only if the file is new? Neil Cerutti <neilc@norwich.edu> - 2013-10-30 13:23 +0000

csiph-web