Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]

Groups > comp.lang.forth > #32973

Re: FORTH BLOCKS and scale-able DASD File system for full-text searches

Show all headers | View raw

mfanyikazi@gmail.com wrote:
> I was wondering if anyone has attempted to create a scale-able file
 > system using FORTH blocks.
>
> I am aware of the many short comings of direct access protocols but
 > I desire to apply the block file system for fixed-length data. I
 > wish to create a simple indexed DASD file system that has full-text
 > search capabilities and that scales well into trillions of mega bytes.
>
> I am designing an application that aims to work much like a search
 > engine but only crawls regional-data , it's my simple attempt at
> organizing the web , seeing that Google is not doing a very good job
> where I am right now.
>
> I believe that It's more relevant to have people find resources on a
> regional-based policy than a global one, since fine-grained searches
> always tend to be more helpful than generalized results that most
 > searches return.
>
> I have been looking for methods to organize crawled data and I found
> mainframe data-sets to be quite useful for my small application. If
 > anyone knows of someone with a similar project which does not depend
 > on a database , please share. Oh and don't state the obvious , (GFS ,
 > HADOOP etc) I need to know how I can use a DASD to organize the data
 > with a full-text search solution.
>
> Thanks.
>

The language I've used for most of my career, MUMPS, uses a b-tree for 
organizing data.  Very good for searching.  I started years ago to code 
such in Forth and for a competent Forth programmer, I don't think it 
would take much time to do it.


Steve

Back to comp.lang.forth | Previous | Next — Previous in thread | Find similar | Unroll thread

Thread

FORTH BLOCKS and scale-able DASD File system for full-text searches mfanyikazi@gmail.com - 2014-08-02 04:24 -0700
  Re: FORTH BLOCKS and scale-able DASD File system for full-text searches "Rod Pemberton" <dont_use_email@xnothavet.cqm> - 2014-08-02 16:27 -0400
  Re: FORTH BLOCKS and scale-able DASD File system for full-text searches albert@spenarnc.xs4all.nl (Albert van der Horst) - 2014-08-19 12:19 +0000
  Re: FORTH BLOCKS and scale-able DASD File system for full-text searches Steve Graham <jsgrahamus@yahoo.com> - 2014-08-19 09:25 -0700

csiph-web