Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]


Groups > comp.lang.java.programmer > #38705

Re: Massiv creating and copying of files

X-Received by 2002:a37:5904:: with SMTP id n4mr8913586qkb.28.1547753069110; Thu, 17 Jan 2019 11:24:29 -0800 (PST)
X-Received by 2002:a81:450:: with SMTP id 77mr173188ywe.6.1547753068770; Thu, 17 Jan 2019 11:24:28 -0800 (PST)
Path csiph.com!weretis.net!feeder6.news.weretis.net!feeder.usenetexpress.com!feeder-in1.iad1.usenetexpress.com!border1.nntp.dca1.giganews.com!nntp.giganews.com!v55no3824273qtk.0!news-out.google.com!h3ni2247qtk.1!nntp.google.com!v55no3824262qtk.0!postnews.google.com!glegroupsg2000goo.googlegroups.com!not-for-mail
Newsgroups comp.lang.java.programmer
Date Thu, 17 Jan 2019 11:24:28 -0800 (PST)
In-Reply-To <2382d05b-5eeb-48d2-8a13-448650eeafe8@googlegroups.com>
Complaints-To groups-abuse@google.com
Injection-Info glegroupsg2000goo.googlegroups.com; posting-host=50.78.95.177; posting-account=2czF5goAAAD4GBMPIGV4KcD2K4PhoB_H
NNTP-Posting-Host 50.78.95.177
References <7e871fd2-1583-4d9c-a5e6-d72c7bfb3f8c@googlegroups.com> <q1qaim$72q$1@dont-email.me> <2382d05b-5eeb-48d2-8a13-448650eeafe8@googlegroups.com>
User-Agent G2/1.0
MIME-Version 1.0
Message-ID <0c5852a5-cce3-47e8-b264-ea5ef6301060@googlegroups.com> (permalink)
Subject Re: Massiv creating and copying of files
From Eric Douglas <e.d.programmer@gmail.com>
Injection-Date Thu, 17 Jan 2019 19:24:29 +0000
Content-Type text/plain; charset="UTF-8"
Content-Transfer-Encoding quoted-printable
Lines 18
Xref csiph.com comp.lang.java.programmer:38705

Show key headers only | View raw


On Thursday, January 17, 2019 at 2:11:54 PM UTC-5, Sandro Leinzinger wrote:
> 
> Thanks for your help ... i could boost the process by creating the files in a ram disk (4 at the same time) and then write it to disk. But you are right ... IO takes time and you have to wait :)

The simple answer, while we have multiple threads which can simultaneously access memory, as far as I know we still cannot access a hard disk simultaneously, so file writing is only much faster with multi-threading, with each thread accessing a different physical disk.  If you need all your output to be on a single disk, but you have other physical disks available you could write to multiple disks then kick off a post-processor to merge the outputs if you need to finish the work faster without completing the final output fast.

Only other answer is get a faster disk.  Unless you're storing many copies of this output, 3GB is relatively small, so if purchasing disk is an option this could be a relatively cheap solution.  I'm looking to get an EVO 970 myself to speed up my personal PC.

Back to comp.lang.java.programmer | Previous | NextPrevious in thread | Next in thread | Find similar | Unroll thread


Thread

Massiv creating and copying of files Sandro Leinzinger <leinzinger.sandro@googlemail.com> - 2019-01-17 06:19 -0800
  Re: Massiv creating and copying of files Arne Vajhøj <arne@vajhoej.dk> - 2019-01-17 09:30 -0500
  Re: Massiv creating and copying of files Eric Sosman <esosman@comcast-dot-net.invalid> - 2019-01-17 11:30 -0500
    Re: Massiv creating and copying of files Sandro Leinzinger <leinzinger.sandro@googlemail.com> - 2019-01-17 11:11 -0800
      Re: Massiv creating and copying of files Eric Douglas <e.d.programmer@gmail.com> - 2019-01-17 11:24 -0800
        Re: Massiv creating and copying of files Eric Sosman <esosman@comcast-dot-net.invalid> - 2019-01-17 17:16 -0500
          Re: Massiv creating and copying of files Martin Gregorie <martin@mydomain.invalid> - 2019-01-17 23:33 +0000
  Re: Massiv creating and copying of files Marcel Mueller <news.5.maazl@spamgourmet.org> - 2019-01-18 07:57 +0100

csiph-web