Path: csiph.com!v102.xanadu-bbs.net!xanadu-bbs.net!news.glorb.com!news-out.readnews.com!transit3.readnews.com!news-out.news.tds.net!newsreading01.news.tds.net!53ab2750!not-for-mail From: "Patricia Shanahan" Subject: Re: How can you make idle processors pick up java work? Message-ID: <50197006.55898.calajapr@time.synchro.net> X-Comment-To: All Newsgroups: comp.lang.java.programmer X-FTN-AREA: COMP.LANG.JAVA.PROGRAMMER X-FTN-MSGID: 1:261/38 6d811a08 Content-Type: text/plain; charset=IBM437 Content-Transfer-Encoding: 8bit X-Gateway: time.synchro.net [Synchronet 3.16a-Win32 NewsLink 1.98] Lines: 22 Date: Wed, 01 Aug 2012 18:09:35 GMT NNTP-Posting-Host: 69.21.70.65 X-Complaints-To: news@tds.net X-Trace: newsreading01.news.tds.net 1343844575 69.21.70.65 (Wed, 01 Aug 2012 13:09:35 CDT) NNTP-Posting-Date: Wed, 01 Aug 2012 13:09:35 CDT Organization: tds.net Xref: csiph.com comp.lang.java.programmer:16930 From: Patricia Shanahan On 7/31/2012 1:07 PM, qwertmonkey wrote: ... > Please, let me know if you have a better idea of how to read very large text > files in a faster way (while using a regular/sub-optimal box) ~ ... It sounds as though your throughput is limited by disk read head time - splitting across physical disks increases that resource. You *may* be able to improve the efficiency of one drive by using NIO non-blocking reads to keep more disk prefetch reads going at once. Given a pool of reads, the drive can optimize their order to reduce total head movement, and therefore time the read head wastes not actually doing a transfer. Patricia --- BBBS/Li6 v4.10 Dada-1 * Origin: Prism bbs (1:261/38) --- Synchronet 3.16a-Win32 NewsLink 1.98 Time Warp of the Future BBS - telnet://time.synchro.net:24