Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]

Groups > comp.os.linux.advocacy > #467565

Re: a little bit closer

Subject Re: a little bit closer
Newsgroups comp.os.linux.advocacy
References (4 earlier) <V0wnD.58326$LK2.45842@fx36.iad> <pnmf2d01om5@news4.newsguy.com> <fzznD.295720$0L2.283214@fx04.am4> <26fff7dd-7edf-4afd-a6eb-578f795a18cd@googlegroups.com> <64ccc1bb-8890-4cbc-9329-ac5e79f6d627@googlegroups.com>
From DFS <nospam@nospam.com>
Message-ID <R7RnD.146192$Vl2.43630@fx46.iad> (permalink)
Organization blocknews - www.blocknews.net
Date 2018-09-17 13:01 -0400

Show all headers | View raw

On 9/17/2018 12:09 PM, fr314159@gmail.com wrote:
> On Monday, September 17, 2018 at 11:55:58 AM UTC-4, Steve Carroll wrote:
> 
>>>
>>> That is memory of his usenet server. 14Gib is nothing to be impressed
>>> of...
>>
>> For playing around with data like this it's nothing to sneeze at.
>>
> 
> Since this is exclusively TEXT data, a compressed database
> would be a LOT smaller than 14Gib, maybe only 1-2Gib.
> 
> But that junk SQLite doesn't support compression.
> 
> Of course DB access is slower with compression but that
> junk python is slower than molasses regardless.


I use python for loading the data and for some reports, and it's plenty 
fast:

* 3.5 seconds to count daily posts for 3 years
* 3 seconds to count the Top 1000 words for 3 years


All display is Access via ODBC to SQLite.  0.18sec to load 800 posts to 
screen.

https://imgur.com/a/V5r59nD

Back to comp.os.linux.advocacy | Previous | Next — Previous in thread | Next in thread | Find similar | Unroll thread

Thread

a little bit closer owl <owl@rooftop.invalid> - 2018-09-15 16:12 +0000
  Re: a little bit closer Steve Carroll <frelwizzen@gmail.com> - 2018-09-15 12:04 -0700
  Re: a little bit closer DFS <nospam@nospam.com> - 2018-09-15 18:02 -0400
    Re: a little bit closer DFS <nospam@nospam.com> - 2018-09-15 18:11 -0400
      Re: a little bit closer Steve Carroll <frelwizzen@gmail.com> - 2018-09-15 19:22 -0700
      Re: a little bit closer owl <owl@rooftop.invalid> - 2018-09-16 11:24 +0000
        Re: a little bit closer DFS <nospam@nospam.com> - 2018-09-16 13:00 -0400
          Re: a little bit closer "F. Russell" <fr@random.info> - 2018-09-16 20:39 +0000
            Re: a little bit closer Melzzzzz <Melzzzzz@zzzzz.com> - 2018-09-16 21:04 +0000
              Re: a little bit closer Steve Carroll <frelwizzen@gmail.com> - 2018-09-16 14:33 -0700
              Re: a little bit closer Steve Carroll <fretwizzer@gmail.com> - 2018-09-17 08:55 -0700
                Re: a little bit closer fr314159@gmail.com - 2018-09-17 09:09 -0700
                Re: a little bit closer Steve Carroll <fretwizzer@gmail.com> - 2018-09-17 10:03 -0700
                Re: a little bit closer DFS <nospam@nospam.com> - 2018-09-17 13:01 -0400
                Re: a little bit closer Steve Carroll <frelwizzen@gmail.com> - 2018-09-17 10:20 -0700
              Re: a little bit closer DFS <nospam@nospam.com> - 2018-09-17 13:55 -0400
                Re: a little bit closer Steve Carroll <fretwizzer@gmail.com> - 2018-09-17 11:02 -0700
                Re: a little bit closer Snit <usenet@gallopinginsanity.com> - 2018-09-17 11:48 -0700
                Re: a little bit closer DFS <nospam@nospam.com> - 2018-09-17 16:29 -0400
                Re: a little bit closer Steve Carroll <fretwizzer@gmail.com> - 2018-09-17 13:49 -0700
                Re: a little bit closer Steve Carroll <frelwizzen@gmail.com> - 2018-09-17 14:15 -0700
                Re: a little bit closer DFS <nospam@nospam.com> - 2018-09-17 17:14 -0400
                Re: a little bit closer Steve Carroll <fretwizzer@gmail.com> - 2018-09-17 14:28 -0700
                Re: a little bit closer DFS <nospam@nospam.com> - 2018-09-17 19:26 -0400
                Re: a little bit closer Steve Carroll <fretwizzer@gmail.com> - 2018-09-17 16:46 -0700
                Re: a little bit closer DFS <nospam@nospam.com> - 2018-09-17 21:43 -0400
                Re: a little bit closer DFS <nospam@nospam.com> - 2018-09-17 22:03 -0400
                Re: a little bit closer Steve Carroll <frelwizzen@gmail.com> - 2018-09-17 19:11 -0700
                (Sub)Threads drift, big time. Jeff-Relf.Me  @. - 2018-09-17 20:23 -0700
                (Sub)Threads are ReConstructed using _ parents (!GrandParents). Jeff-Relf.Me  @. - 2018-09-17 19:29 -0700
                Re: (Sub)Threads are ReConstructed using _ parents (!GrandParents). DFS <nospam@nospam.com> - 2018-09-17 23:12 -0400
                Re: (Sub)Threads are ReConstructed using _ parents (!GrandParents). Steve Carroll <frelwizzen@gmail.com> - 2018-09-17 20:29 -0700
                20 years hard labor, sans food. Jeff-Relf.Me  @. - 2018-09-17 21:58 -0700
                Re: a little bit closer Steve Carroll <frelwizzen@gmail.com> - 2018-09-17 14:46 -0700
                Re: a little bit closer Snit <usenet@gallopinginsanity.com> - 2018-09-17 19:45 -0700
                Re: a little bit closer Snit <usenet@gallopinginsanity.com> - 2018-09-17 19:46 -0700
                Re: a little bit closer Snit <usenet@gallopinginsanity.com> - 2018-09-17 11:48 -0700
                Re: a little bit closer SilverSlimer <silver@slim.er> - 2018-09-17 21:47 +0000
                Re: a little bit closer "F. Russell" <fr@random.info> - 2018-09-17 22:53 +0000
                Re: a little bit closer Steve Carroll <fretwizzer@gmail.com> - 2018-09-17 15:57 -0700
                Re: a little bit closer DFS <nospam@nospam.com> - 2018-09-19 09:47 -0400
            Re: a little bit closer Peter Köhlmann <peter-koehlmann@t-online.de> - 2018-09-16 23:19 +0200
              Re: a little bit closer Steve Carroll <frelwizzen@gmail.com> - 2018-09-16 14:48 -0700
            Re: a little bit closer chrisv <chrisv@nospam.invalid> - 2018-09-17 11:42 -0500
              Re: a little bit closer DFS <nospam@nospam.com> - 2018-09-17 16:37 -0400
                Re: a little bit closer SilverSlimer <silver@slim.er> - 2018-09-17 23:37 +0000
                Re: a little bit closer DFS <nospam@nospam.com> - 2018-09-17 21:24 -0400
                Re: a little bit closer Steve Carroll <frelwizzen@gmail.com> - 2018-09-17 18:55 -0700
            Re: a little bit closer DFS <nospam@nospam.com> - 2018-09-17 13:19 -0400
              Re: a little bit closer fr314159@gmail.com - 2018-09-17 10:35 -0700
                Re: a little bit closer DFS <nospam@nospam.com> - 2018-09-17 16:31 -0400
                Re: a little bit closer Steve Carroll <frelwizzen@gmail.com> - 2018-09-17 13:59 -0700
              Re: a little bit closer Steve Carroll <frelwizzen@gmail.com> - 2018-09-17 10:52 -0700
              Re: a little bit closer fr314159@gmail.com - 2018-09-17 12:03 -0700
              Re: a little bit closer fr314159@gmail.com - 2018-09-17 12:26 -0700
                Re: a little bit closer DFS <nospam@nospam.com> - 2018-09-17 16:20 -0400
                Re: a little bit closer Steve Carroll <fretwizzer@gmail.com> - 2018-09-17 13:42 -0700
                Re: a little bit closer DFS <nospam@nospam.com> - 2018-09-17 22:10 -0400
                Re: a little bit closer Steve Carroll <frelwizzen@gmail.com> - 2018-09-17 19:26 -0700
          Re: a little bit closer fr314159@gmail.com - 2018-09-17 06:58 -0700
            Re: a little bit closer Steve Carroll <frelwizzen@gmail.com> - 2018-09-17 07:28 -0700
            Re: a little bit closer DFS <nospam@nospam.com> - 2018-09-18 22:11 -0400
              Re: a little bit closer Steve Carroll <frelwizzen@gmail.com> - 2018-09-18 19:33 -0700
              Re: a little bit closer fr314159@gmail.com - 2018-09-19 05:53 -0700
                Re: a little bit closer DFS <nospam@nospam.com> - 2018-09-19 09:33 -0400
                Re: a little bit closer fr314159@gmail.com - 2018-09-19 06:52 -0700
                Re: a little bit closer DFS <nospam@nospam.com> - 2018-09-19 11:19 -0400
                Re: a little bit closer Steve Carroll <frelwizzen@gmail.com> - 2018-09-19 08:36 -0700
                Re: a little bit closer Steve Carroll <frelwizzen@gmail.com> - 2018-09-19 12:29 -0700
                Re: a little bit closer fr314159@gmail.com - 2018-09-19 08:39 -0700
                Re: a little bit closer Steve Carroll <frelwizzen@gmail.com> - 2018-09-19 09:08 -0700
                Re: a little bit closer Steve Carroll <frelwizzen@gmail.com> - 2018-09-19 13:32 -0700
                Re: a little bit closer DFS <nospam@nospam.com> - 2018-09-22 09:27 -0400
                Re: a little bit closer owl <owl@rooftop.invalid> - 2018-09-22 15:01 +0000
                Re: a little bit closer DFS <nospam@nospam.com> - 2018-09-22 20:47 -0400
                Re: a little bit closer Steve Carroll <fretwizzer@gmail.com> - 2018-09-22 11:01 -0700
                Re: a little bit closer Steve Carroll <fretwizzer@gmail.com> - 2018-09-22 11:18 -0700
                Re: a little bit closer Steve Carroll <frelwizzen@gmail.com> - 2018-09-22 11:41 -0700
                Re: a little bit closer Steve Carroll <fretwizzer@gmail.com> - 2018-09-22 11:47 -0700
                Re: a little bit closer Steve Carroll <frelwizzen@gmail.com> - 2018-09-22 12:12 -0700
                Re: a little bit closer DFS <nospam@nospam.com> - 2018-09-23 00:21 -0400
                Re: a little bit closer Steve Carroll <fretwizzer@gmail.com> - 2018-09-23 10:02 -0700
                Re: a little bit closer Steve Carroll <fretwizzer@gmail.com> - 2018-09-23 10:59 -0700
                Re: a little bit closer Steve Carroll <frelwizzen@gmail.com> - 2018-09-23 11:21 -0700
                Re: a little bit closer DFS <nospam@nospam.com> - 2018-09-23 14:43 -0400
                Re: a little bit closer Steve Carroll <fretwizzer@gmail.com> - 2018-09-23 12:28 -0700
                Re: a little bit closer Steve Carroll <frelwizzen@gmail.com> - 2018-09-23 12:56 -0700
                Re: a little bit closer Steve Carroll <frelwizzen@gmail.com> - 2018-09-23 16:04 -0700
                Re: a little bit closer Steve Carroll <frelwizzen@gmail.com> - 2018-09-23 17:07 -0700
                Re: a little bit closer DFS <nospam@nospam.com> - 2018-09-24 09:20 -0400
                Re: a little bit closer Steve Carroll <frelwizzen@gmail.com> - 2018-09-24 06:43 -0700
                Re: a little bit closer Steve Carroll <fretwizzer@gmail.com> - 2018-09-23 14:18 -0700
                Re: a little bit closer DFS <nospam@nospam.com> - 2018-09-23 19:30 -0400
                Re: a little bit closer Steve Carroll <frelwizzen@gmail.com> - 2018-09-23 16:51 -0700
                Re: a little bit closer Steve Carroll <frelwizzen@gmail.com> - 2018-09-23 20:15 -0700
                Re: a little bit closer Steve Carroll <fretwizzer@gmail.com> - 2018-09-23 17:04 -0700
                Re: a little bit closer DFS <nospam@nospam.com> - 2018-09-24 09:26 -0400
                Re: a little bit closer Steve Carroll <frelwizzen@gmail.com> - 2018-09-24 06:58 -0700
                Re: a little bit closer Steve Carroll <fretwizzer@gmail.com> - 2018-09-24 08:56 -0700
                Re: a little bit closer DFS <nospam@nospam.com> - 2018-09-24 12:33 -0400
                Re: a little bit closer DFS <nospam@nospam.com> - 2018-09-24 12:44 -0400
                Re: a little bit closer Steve Carroll <fretwizzer@gmail.com> - 2018-09-24 10:54 -0700
                Re: a little bit closer Steve Carroll <frelwizzen@gmail.com> - 2018-09-24 11:39 -0700
                Re: a little bit closer DFS <nospam@nospam.com> - 2018-09-25 13:13 -0400
                Re: a little bit closer DFS <nospam@nospam.com> - 2018-09-25 14:26 -0400
                Re: a little bit closer Steve Carroll <fretwizzer@gmail.com> - 2018-09-26 09:00 -0700
                Re: a little bit closer DFS <nospam@nospam.com> - 2018-09-26 19:40 -0400
                Re: a little bit closer Steve Carroll <fretwizzer@gmail.com> - 2018-09-28 16:40 -0700
                Re: a little bit closer Steve Carroll <fretwizzer@gmail.com> - 2018-09-24 11:13 -0700
                Re: a little bit closer DFS <nospam@nospam.com> - 2018-09-25 13:11 -0400
                Re: a little bit closer fr314159@gmail.com - 2018-09-24 07:53 -0700
                Re: a little bit closer Steve Carroll <fretwizzer@gmail.com> - 2018-09-24 09:03 -0700
                Re: a little bit closer "F. Russell" <fr@random.info> - 2018-09-24 22:32 +0000
                Re: a little bit closer DFS <nospam@nospam.com> - 2018-09-25 12:04 -0400
                Re: a little bit closer Steve Carroll <frelwizzen@gmail.com> - 2018-09-22 11:25 -0700
                Re: a little bit closer DFS <nospam@nospam.com> - 2018-09-22 21:05 -0400
                Re: a little bit closer Steve Carroll <fretwizzer@gmail.com> - 2018-09-23 10:00 -0700
                Re: a little bit closer Steve Carroll <frelwizzen@gmail.com> - 2018-09-23 10:34 -0700
                Re: a little bit closer owl <owl@rooftop.invalid> - 2018-09-19 22:04 +0000
                Re: a little bit closer Steve Carroll <frelwizzen@gmail.com> - 2018-09-19 15:22 -0700
                Re: a little bit closer DFS <nospam@nospam.com> - 2018-09-20 23:55 -0400
                Re: a little bit closer Melzzzzz <Melzzzzz@zzzzz.com> - 2018-09-21 04:02 +0000
                Re: a little bit closer Chris Ahlstrom <OFeem1987@teleworm.us> - 2018-09-21 06:54 -0400
                Re: a little bit closer Mel <mel@zzzzz.com> - 2018-09-21 13:31 +0200
                Re: a little bit closer Steve Carroll <frelwizzen@gmail.com> - 2018-09-21 04:52 -0700
                Re: a little bit closer owl <owl@rooftop.invalid> - 2018-09-21 16:07 +0000
                Re: a little bit closer Steve Carroll <frelwizzen@gmail.com> - 2018-09-21 10:53 -0700
                Re: a little bit closer Steve Carroll <frelwizzen@gmail.com> - 2018-09-21 04:37 -0700
                Re: a little bit closer chrisv <chrisv@nospam.invalid> - 2018-09-21 07:24 -0500
                Re: a little bit closer SilverSlimer <silver@slim.er> - 2018-09-21 12:45 +0000
                Re: a little bit closer Snit <usenet@gallopinginsanity.com> - 2018-09-21 07:47 -0700
                Re: a little bit closer Snit <usenet@gallopinginsanity.com> - 2018-09-21 07:51 -0700
                Re: a little bit closer RonB <ronb02NOSPAM@gmail.com> - 2018-09-22 16:47 +0000
                Re: a little bit closer SilverSlimer <silver@slim.er> - 2018-09-22 20:13 +0000
                Re: a little bit closer Steve Carroll <frelwizzen@gmail.com> - 2018-09-22 13:30 -0700
                Re: a little bit closer Steve Carroll <frelwizzen@gmail.com> - 2018-09-22 16:06 -0700
                Re: a little bit closer Snit <usenet@gallopinginsanity.com> - 2018-09-22 17:02 -0700
                Re: a little bit closer Snit <usenet@gallopinginsanity.com> - 2018-09-22 17:01 -0700
                Re: a little bit closer chrisv <chrisv@nospam.invalid> - 2018-09-24 07:33 -0500
                Re: a little bit closer Steve Carroll <frelwizzen@gmail.com> - 2018-09-24 06:11 -0700
                Re: a little bit closer Snit <usenet@gallopinginsanity.com> - 2018-09-24 07:54 -0700
                Re: a little bit closer SilverSlimer <silver@slim.er> - 2018-09-21 12:41 +0000
                Re: a little bit closer Snit <usenet@gallopinginsanity.com> - 2018-09-21 07:48 -0700
                Re: a little bit closer Chris Ahlstrom <OFeem1987@teleworm.us> - 2018-09-22 07:08 -0400
                Re: a little bit closer SilverSlimer <silver@slim.er> - 2018-09-22 14:36 +0000
                Re: a little bit closer Chris Ahlstrom <OFeem1987@teleworm.us> - 2018-09-23 08:35 -0400
                Re: a little bit closer SilverSlimer <silver@slim.er> - 2018-09-23 13:58 +0000
                Re: a little bit closer Steve Carroll <frelwizzen@gmail.com> - 2018-09-23 07:41 -0700
                Re: a little bit closer Snit <usenet@gallopinginsanity.com> - 2018-09-23 07:47 -0700
                Re: a little bit closer DFS <nospam@nospam.com> - 2018-09-23 10:34 -0400
                Re: a little bit closer Snit <usenet@gallopinginsanity.com> - 2018-09-23 07:44 -0700
                Re: a little bit closer Steve Carroll <frelwizzen@gmail.com> - 2018-09-23 08:13 -0700
                Re: a little bit closer owl <owl@rooftop.invalid> - 2018-09-22 14:51 +0000
                Re: a little bit closer Chris Ahlstrom <OFeem1987@teleworm.us> - 2018-09-23 08:39 -0400
                Re: a little bit closer Snit <usenet@gallopinginsanity.com> - 2018-09-22 13:43 -0700
                Re: a little bit closer Steve Carroll <frelwizzen@gmail.com> - 2018-09-22 14:01 -0700
                Re: a little bit closer RonB <ronb02NOSPAM@gmail.com> - 2018-09-22 16:51 +0000
                Re: a little bit closer SilverSlimer <silver@slim.er> - 2018-09-22 20:13 +0000
                Re: a little bit closer chrisv <chrisv@nospam.invalid> - 2018-09-24 07:45 -0500
                Re: a little bit closer SilverSlimer <silver@slim.er> - 2018-09-24 20:51 +0000
                Re: a little bit closer Snit <usenet@gallopinginsanity.com> - 2018-09-24 13:55 -0700
                Re: a little bit closer Steve Carroll <frelwizzen@gmail.com> - 2018-09-24 14:16 -0700
                Re: a little bit closer SilverSlimer <silver@slim.er> - 2018-09-21 12:31 +0000
                Re: a little bit closer Steve Carroll <frelwizzen@gmail.com> - 2018-09-21 06:41 -0700
                Re: a little bit closer Snit <usenet@gallopinginsanity.com> - 2018-09-21 07:50 -0700
                Re: a little bit closer owl <owl@rooftop.invalid> - 2018-09-21 16:01 +0000
                Re: a little bit closer Snit <usenet@gallopinginsanity.com> - 2018-09-21 10:45 -0700
                Re: a little bit closer Steve Carroll <frelwizzen@gmail.com> - 2018-09-21 11:09 -0700
                Re: a little bit closer Steve Carroll <frelwizzen@gmail.com> - 2018-09-21 22:56 -0700
                Re: a little bit closer DFS <nospam@nospam.com> - 2018-09-22 08:55 -0400
                Re: a little bit closer owl <owl@rooftop.invalid> - 2018-09-22 14:51 +0000
                Re: a little bit closer Chris Ahlstrom <OFeem1987@teleworm.us> - 2018-09-23 08:42 -0400
                Re: a little bit closer owl <owl@rooftop.invalid> - 2018-09-21 14:03 +0000
                Re: a little bit closer Snit <usenet@gallopinginsanity.com> - 2018-09-21 07:38 -0700
                Re: a little bit closer Steve Carroll <frelwizzen@gmail.com> - 2018-09-21 07:44 -0700
                Re: a little bit closer owl <owl@rooftop.invalid> - 2018-09-22 03:04 +0000
                Re: a little bit closer Steve Carroll <frelwizzen@gmail.com> - 2018-09-21 20:20 -0700
                Re: a little bit closer Steve Carroll <frelwizzen@gmail.com> - 2018-09-22 01:01 -0700
                Re: a little bit closer DFS <nospam@nospam.com> - 2018-09-22 09:54 -0400
                Re: a little bit closer Chris Ahlstrom <OFeem1987@teleworm.us> - 2018-09-20 14:58 -0400
                Re: a little bit closer Steve Carroll <frelwizzen@gmail.com> - 2018-09-20 12:41 -0700
            Re: a little bit closer chrisv <chrisv@nospam.invalid> - 2018-09-19 07:09 -0500
              Re: a little bit closer fr314159@gmail.com - 2018-09-19 05:58 -0700
                Re: a little bit closer Steve Carroll <frelwizzen@gmail.com> - 2018-09-19 06:14 -0700
          Re: a little bit closer owl <owl@rooftop.invalid> - 2018-09-18 05:31 +0000
            Re: a little bit closer owl <owl@rooftop.invalid> - 2018-09-18 17:12 +0000
              Re: a little bit closer Steve Carroll <frelwizzen@gmail.com> - 2018-09-18 10:44 -0700
              Re: a little bit closer Steve Carroll <frelwizzen@gmail.com> - 2018-09-18 14:06 -0700
              Re: a little bit closer DFS <nospam@nospam.com> - 2018-09-18 23:05 -0400
                Re: a little bit closer owl <owl@rooftop.invalid> - 2018-09-19 04:17 +0000
                Re: a little bit closer Steve Carroll <frelwizzen@gmail.com> - 2018-09-18 21:54 -0700
                Re: a little bit closer DFS <nospam@nospam.com> - 2018-09-19 09:02 -0400
                Re: a little bit closer Steve Carroll <frelwizzen@gmail.com> - 2018-09-19 06:30 -0700
                Re: a little bit closer owl <owl@rooftop.invalid> - 2018-09-19 22:08 +0000
                Re: a little bit closer Steve Carroll <frelwizzen@gmail.com> - 2018-09-19 15:37 -0700
                Re: a little bit closer DFS <nospam@nospam.com> - 2018-09-20 23:59 -0400
                Re: a little bit closer Melzzzzz <Melzzzzz@zzzzz.com> - 2018-09-21 04:03 +0000
                Re: a little bit closer DFS <nospam@nospam.com> - 2018-09-21 00:50 -0400
                Re: a little bit closer Steve Carroll <frelwizzen@gmail.com> - 2018-09-20 22:03 -0700
                Re: a little bit closer Steve Carroll <frelwizzen@gmail.com> - 2018-09-20 22:19 -0700
                Re: a little bit closer Steve Carroll <frelwizzen@gmail.com> - 2018-09-18 22:42 -0700
            Re: a little bit closer Steve Carroll <frelwizzen@gmail.com> - 2018-09-18 12:34 -0700
    Re: a little bit closer Steve Carroll <frelwizzen@gmail.com> - 2018-09-15 15:28 -0700
    Re: a little bit closer DFS <nospam@nospam.com> - 2018-09-15 19:24 -0400
      Re: a little bit closer Steve Carroll <frelwizzen@gmail.com> - 2018-09-15 16:32 -0700
      Re: a little bit closer Special Edd <shortbus1963me@mail.com> - 2018-09-15 19:48 -0400
      Re: a little bit closer Steve Carroll <frelwizzen@gmail.com> - 2018-09-15 18:36 -0700

csiph-web