Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]
Groups > comp.lang.java.programmer > #13556
| From | Lew <noone@lewscanon.com> |
|---|---|
| Newsgroups | comp.lang.java.programmer |
| Subject | Re: Pattern suggestion |
| Date | 2012-04-15 08:15 -0700 |
| Organization | albasani.net |
| Message-ID | <jmeolq$bo7$1@news.albasani.net> (permalink) |
| References | <jmel0t$jrh$1@news2.carnet.hr> <jmeo1d$mg4$1@speranza.aioe.org> |
On 04/15/2012 08:04 AM, Rui Maciel wrote: > FrenKy wrote: > >> Hi *, >> I have a huge file (~10GB) which I'm reading line by line. Each line has >> to be analyzed by many number of different analyzers. The problem I have >> is that to make it at least a bit performance optimized due to sometimes >> time consuming processing (usually because of delays due to external >> interfaces) i would need to make it heavily multithreaded. >> File should be read only once to reduce IO on disks. >> >> So I need "1 driver to many workers" pattern where workers are >> multithreaded. >> >> I have a solution now based on Observable/Observer that I use (and it >> works) but I'm not sure if it is the best way. Well, we aren't either. "Best" is a very loose term, and it encompasses multiple often mutually-exclusive metrics. What is your metric for "best"? How do you measure it? Even after you answer that, we don't know. We haven't seen your code. You might have a simply brilliant implementation of what you call "Observable/Observer" that simply blows any other approach out of the water. Conversely, your "Observable/Observer" label may be wildly inapplicable, and the code utter crap, and even were that the correct pattern the execution thereof might have barely crawled out of the crapper. We simply don't know. You maybe have the best, worst or somewhere between of all possible implementations. I hope it's nearer the first than the second. Would you go to a nutritionist and say, "I'm on a high-carb diet, is that the best way?" It might be, if the carbs are starchy like pasta and you're at the shore running marathons. It might not be, if you're eating only Twinkies and beer and watching your fourth straight /Jersey Shore/ marathon. Tell you what. How about you share what you've done and then, based on information, we provide feedback? http://sscce.org/ -- Lew
Back to comp.lang.java.programmer | Previous | Next — Previous in thread | Next in thread | Find similar | Unroll thread
Pattern suggestion FrenKy <frenky__nn@gmail.com> - 2012-04-15 16:11 +0200
Re: Pattern suggestion Rui Maciel <rui.maciel@gmail.com> - 2012-04-15 16:04 +0100
Re: Pattern suggestion Lew <noone@lewscanon.com> - 2012-04-15 08:15 -0700
Re: Pattern suggestion markspace <-@.> - 2012-04-15 08:17 -0700
Re: Pattern suggestion Arne Vajhøj <arne@vajhoej.dk> - 2012-04-15 22:01 -0400
Re: Pattern suggestion Jan Burse <janburse@fastmail.fm> - 2012-04-15 17:41 +0200
Re: Pattern suggestion Jan Burse <janburse@fastmail.fm> - 2012-04-16 00:37 +0200
Re: Pattern suggestion Patricia Shanahan <pats@acm.org> - 2012-04-15 09:17 -0700
Re: Pattern suggestion Arved Sandstrom <asandstrom3minus1@eastlink.ca> - 2012-04-15 13:57 -0300
Re: Pattern suggestion Martin Gregorie <martin@address-in-sig.invalid> - 2012-04-15 19:56 +0000
Re: Pattern suggestion Robert Klemme <shortcutter@googlemail.com> - 2012-04-16 09:55 +0200
Re: Pattern suggestion Arne Vajhøj <arne@vajhoej.dk> - 2012-04-15 21:58 -0400
csiph-web