Best approach to create humongous amount of files

Path	csiph.com!v102.xanadu-bbs.net!xanadu-bbs.net!feeder.erje.net!1.eu.feeder.erje.net!bcyclone04.am1.xlned.com!bcyclone04.am1.xlned.com!newsfeed.xs4all.nl!newsfeed2a.news.xs4all.nl!xs4all!newsgate.cistron.nl!newsgate.news.xs4all.nl!post.news.xs4all.nl!not-for-mail
Return-Path	<scoria.799@gmail.com>
X-Original-To	python-list@python.org
Delivered-To	python-list@mail.python.org
X-Spam-Status	OK 0.140
X-Spam-Level	*
X-Spam-Evidence	'H': 0.79; 'S': 0.07; 'hour.': 0.09; 'subject:create': 0.09; 'subject:files': 0.09; 'template': 0.14; '(say': 0.16; 'folder': 0.16; 'everyone,': 0.19; 'possibly': 0.26; 'message-id:@mail.gmail.com': 0.30; 'file': 0.32; 'received:google.com': 0.35; 'thanks': 0.36; 'possible': 0.36; 'to:addr:python-list': 0.38; 'files': 0.38; 'to:addr:python.org': 0.39; 'strategy': 0.64; 'within': 0.65; 'million': 0.74; 'stamp': 0.91; 'subject:Best': 0.91; 'task,': 0.91
DKIM-Signature	v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:date:message-id:subject:from:to:content-type; bh=8il77aXPdTIn9jMRTw6bbUEUsMNWc82GkIWyYpuEw2c=; b=PD0NbK39G6GKUhkdKuTJfmJXfHDjIFHk2kNRFBf5FiJAzbGprgqPb3hLg2vRt+t6oZ yo12E4+woNAZ55W6ctNIXTiViZzJVXeHIljW1SkCajGLIEjXY/bd9quZd2mr8h5Zt2Cv Unytu+JnOtBjgiNt4QdWrb11Bq7oRSWoPOL4EVg05PHWOzq6FlcknEKcFCO4bDnBznlJ CyQLM9+ZQMAotwggh0JfAkANCTxW7/6RWhILKQSVIOlnrY2fXMNTkWz+IXZFEfL9Kg3M FTRMrF27aff5ns5LLTxFffKUMOCRl3CYfMjBK4jDajuzGuIQ9ri2lqi/wXAxkVnAnA6s hDQA==
MIME-Version	1.0
X-Received	by 10.42.197.65 with SMTP id ej1mr37011975icb.13.1432122255164; Wed, 20 May 2015 04:44:15 -0700 (PDT)
Date	Wed, 20 May 2015 17:14:15 +0530
Subject	Best approach to create humongous amount of files
From	Parul Mogra <scoria.799@gmail.com>
To	python-list@python.org
Content-Type	multipart/alternative; boundary=20cf303ea6804b5b3b051681f2b5
X-Mailman-Approved-At	Wed, 20 May 2015 14:12:24 +0200
X-BeenThere	python-list@python.org
X-Mailman-Version	2.1.20+
Precedence	list
List-Id	General discussion list for the Python programming language <python-list.python.org>
List-Unsubscribe	<https://mail.python.org/mailman/options/python-list>, <mailto:python-list-request@python.org?subject=unsubscribe>
List-Archive	<http://mail.python.org/pipermail/python-list/>
List-Post	<mailto:python-list@python.org>
List-Help	<mailto:python-list-request@python.org?subject=help>
List-Subscribe	<https://mail.python.org/mailman/listinfo/python-list>, <mailto:python-list-request@python.org?subject=subscribe>
Newsgroups	comp.lang.python
Message-ID	<mailman.166.1432123945.17265.python-list@python.org> (permalink)
Lines	27
NNTP-Posting-Host	2001:888:2000:d::a6
X-Trace	1432123945 news.xs4all.nl 2879 [2001:888:2000:d::a6]:59948
X-Complaints-To	abuse@xs4all.nl
X-Received-Bytes	3921
X-Received-Body-CRC	3086797551
Xref	csiph.com comp.lang.python:90950

Show key headers only | View raw

[Multipart message — attachments visible in raw view] - view raw

Hello everyone,
My objective is to create large amount of data files (say a million *.json
files), using a pre-existing template file (*.json). Each file would have a
unique name, possibly by incorporating time stamp information. The files
have to be generated in a folder specified.

What is the best strategy to achieve this task, so that the files will be
generated in the shortest possible time? Say within an hour.

Thanks

Back to comp.lang.python | Previous | Next — Next in thread | Find similar | Unroll thread

Thread

Best approach to create humongous amount of files Parul Mogra <scoria.799@gmail.com> - 2015-05-20 17:14 +0530
  Re: Best approach to create humongous amount of files Denis McMahon <denismfmcmahon@gmail.com> - 2015-05-20 18:08 +0000
    Re: Best approach to create humongous amount of files "Mario R. Osorio" <nimbiotics@gmail.com> - 2015-05-21 08:54 -0700
      Re: Best approach to create humongous amount of files Peter Otten <__peter__@web.de> - 2015-05-21 18:28 +0200

csiph-web