Path: csiph.com!usenet.pasdenom.info!aioe.org!.POSTED!not-for-mail
From: qwertmonkey@syberianoutpost.ru
Newsgroups: comp.lang.java.programmer
Subject: How can you make idle processors pick up java work?
Date: Tue, 31 Jul 2012 17:30:47 +0000 (UTC)
Organization: Aioe.org NNTP Server
Lines: 32
Message-ID: <jv94o6$ae3$1@speranza.aioe.org>
NNTP-Posting-Host: z9Rq+Ge+SLJPEkk9TGcnaw.user.speranza.aioe.org
X-Complaints-To: abuse@aioe.org
X-Notice: Filtered by postfilter v. 0.8.2
X-Newsreader: NetComponents
Xref: csiph.com comp.lang.java.programmer:16707

~ 
 Well, yes. I am not sure if I am right (or the extent to which ...),
but it seems I am dealing here with a physical barrier, that may not be
friendly to "logical" ways. Unless the original file is split into and placed
in 8 different physical disks, the data transfer does not find bottlenecks
through the memory subsystem, ...
~ 
 While reading the characters by means of a (NIO 2 Files.new)BufferedReader
(which uses non-blocking I/O, right?) and parsing the sentences myself, I can
read the whole file on a laptop based on an AMD Turion 64X2 Dual Core and 4Gb
in less than 10 seconds
~ 
    BufferedReader BfR = Files.newBufferedReader(IFlPth, Charset.forName("UTF-8"));
    char[] cBfr = new char[iBL];
// __ 
    int iRdByts = BfR.read(cBfr, iBfr00, iBfr02);
    while(iRdByts > -1){
     for(int i = iBfr00; (i < iRdByts); ++i){
      if(cBfr[i] == cLF){ ++lLns; }
     }
     iRdByts = BfR.read(cBfr, iBfr00, iBfr02);
    }// (iRdByts > -1)
// __ 
    BfR.close();
~ 
 I still have to code the logic on top of it, but that is much, much better
than it was taking before
~ 
 Please, let me know if you have a better idea of how to read very large text
files in a faster way (while using a regular/sub-optimal box)
~ 
 lbrtchx