Path: csiph.com!newsfeed.hal-mli.net!feeder3.hal-mli.net!newsfeed.hal-mli.net!feeder1.hal-mli.net!border3.nntp.dca.giganews.com!Xl.tags.giganews.com!border1.nntp.dca.giganews.com!nntp.giganews.com!local2.nntp.dca.giganews.com!nntp.earthlink.com!news.earthlink.com.POSTED!not-for-mail NNTP-Posting-Date: Wed, 01 Aug 2012 00:07:37 -0500 Date: Tue, 31 Jul 2012 22:07:30 -0700 From: Patricia Shanahan User-Agent: Mozilla/5.0 (Windows NT 5.2; WOW64; rv:13.0) Gecko/20120614 Thunderbird/13.0.1 MIME-Version: 1.0 Newsgroups: comp.lang.java.programmer Subject: Re: How can you make idle processors pick up java work? References: <50182C83.55859.calajapr@time.synchro.net> In-Reply-To: <50182C83.55859.calajapr@time.synchro.net> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Message-ID: Lines: 16 X-Usenet-Provider: http://www.giganews.com NNTP-Posting-Host: 70.230.192.108 X-Trace: sv3-eoYw0W2lOnfrtiUnFYhnTWaSv9MwdonBnNg5lilAR4+M7T6VdIPwX/OkChjvKqhsZRCgywh/g7HZ9V9!NbxthNkfwFQ83YTdmBPKvsb2NYzZi/POgQD4b4z39yX28xCceIJZ1PWqQo2Ywc+vKd9LOOEAXKk+!DQEm6rsE+8YX9X6sOZNsKDCz03hOgnmdJMeN9x3dJ7eTic0= X-Abuse-and-DMCA-Info: Please be sure to forward a copy of ALL headers X-Abuse-and-DMCA-Info: Otherwise we will be unable to process your complaint properly X-Postfilter: 1.3.40 X-Original-Bytes: 1853 Xref: csiph.com comp.lang.java.programmer:16900 On 7/31/2012 1:07 PM, qwertmonkey wrote: ... > Please, let me know if you have a better idea of how to read very large text > files in a faster way (while using a regular/sub-optimal box) ~ ... It sounds as though your throughput is limited by disk read head time - splitting across physical disks increases that resource. You *may* be able to improve the efficiency of one drive by using NIO non-blocking reads to keep more disk prefetch reads going at once. Given a pool of reads, the drive can optimize their order to reduce total head movement, and therefore time the read head wastes not actually doing a transfer. Patricia