Path: csiph.com!v102.xanadu-bbs.net!xanadu-bbs.net!feeder.erje.net!1.eu.feeder.erje.net!bcyclone04.am1.xlned.com!bcyclone04.am1.xlned.com!newsfeed.xs4all.nl!newsfeed2a.news.xs4all.nl!xs4all!newsgate.cistron.nl!newsgate.news.xs4all.nl!post.news.xs4all.nl!not-for-mail Return-Path: X-Original-To: python-list@python.org Delivered-To: python-list@mail.python.org X-Spam-Status: OK 0.140 X-Spam-Level: * X-Spam-Evidence: '*H*': 0.79; '*S*': 0.07; 'hour.': 0.09; 'subject:create': 0.09; 'subject:files': 0.09; 'template': 0.14; '(say': 0.16; 'folder': 0.16; 'everyone,': 0.19; 'possibly': 0.26; 'message-id:@mail.gmail.com': 0.30; 'file': 0.32; 'received:google.com': 0.35; 'thanks': 0.36; 'possible': 0.36; 'to:addr:python-list': 0.38; 'files': 0.38; 'to:addr:python.org': 0.39; 'strategy': 0.64; 'within': 0.65; 'million': 0.74; 'stamp': 0.91; 'subject:Best': 0.91; 'task,': 0.91 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:date:message-id:subject:from:to:content-type; bh=8il77aXPdTIn9jMRTw6bbUEUsMNWc82GkIWyYpuEw2c=; b=PD0NbK39G6GKUhkdKuTJfmJXfHDjIFHk2kNRFBf5FiJAzbGprgqPb3hLg2vRt+t6oZ yo12E4+woNAZ55W6ctNIXTiViZzJVXeHIljW1SkCajGLIEjXY/bd9quZd2mr8h5Zt2Cv Unytu+JnOtBjgiNt4QdWrb11Bq7oRSWoPOL4EVg05PHWOzq6FlcknEKcFCO4bDnBznlJ CyQLM9+ZQMAotwggh0JfAkANCTxW7/6RWhILKQSVIOlnrY2fXMNTkWz+IXZFEfL9Kg3M FTRMrF27aff5ns5LLTxFffKUMOCRl3CYfMjBK4jDajuzGuIQ9ri2lqi/wXAxkVnAnA6s hDQA== MIME-Version: 1.0 X-Received: by 10.42.197.65 with SMTP id ej1mr37011975icb.13.1432122255164; Wed, 20 May 2015 04:44:15 -0700 (PDT) Date: Wed, 20 May 2015 17:14:15 +0530 Subject: Best approach to create humongous amount of files From: Parul Mogra To: python-list@python.org Content-Type: multipart/alternative; boundary=20cf303ea6804b5b3b051681f2b5 X-Mailman-Approved-At: Wed, 20 May 2015 14:12:24 +0200 X-BeenThere: python-list@python.org X-Mailman-Version: 2.1.20+ Precedence: list List-Id: General discussion list for the Python programming language List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Newsgroups: comp.lang.python Message-ID: Lines: 27 NNTP-Posting-Host: 2001:888:2000:d::a6 X-Trace: 1432123945 news.xs4all.nl 2879 [2001:888:2000:d::a6]:59948 X-Complaints-To: abuse@xs4all.nl X-Received-Bytes: 3921 X-Received-Body-CRC: 3086797551 Xref: csiph.com comp.lang.python:90950 --20cf303ea6804b5b3b051681f2b5 Content-Type: text/plain; charset=UTF-8 Hello everyone, My objective is to create large amount of data files (say a million *.json files), using a pre-existing template file (*.json). Each file would have a unique name, possibly by incorporating time stamp information. The files have to be generated in a folder specified. What is the best strategy to achieve this task, so that the files will be generated in the shortest possible time? Say within an hour. Thanks --20cf303ea6804b5b3b051681f2b5 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
Hello everyone,
My objective is to crea= te large amount of data files (say a million *.json files), using a pre-exi= sting template file (*.json). Each file would have a unique name, possibly = by incorporating time stamp information. The files have to be generated in = a folder specified.

What is the best strategy to achieve = this task, so that the files will be generated in the shortest possible tim= e? Say within an hour.

Thanks
--20cf303ea6804b5b3b051681f2b5--