starting to look at indexing...

[Scott Wheeler]

On Sunday 07 November 2004 4:39, Zack Rusin wrote:
> On Saturday 06 November 2004 22:15, Scott Wheeler wrote:
> > Right now I'm thinking about how to build up indexes.  In my first
> > demos I'll probably just do word based indexing building up a reverse
> > map from a dictionary to nodes.
>
> Define dictionary for me. Since I can't really comment on other things
> unless I know what exactly the dictionary is.

A collection of all of the words encountered.  Actually I think that in 
Information Retrieval texts that this is actually called a thesaurus, but the 
idea is the same.

By building up a collection of all of the words that you encounter, and 
assuming that said number is less than 2^64, you can then represent them 
other places in your structure just by their ID rather than by content.

-Scott

-- 
Peace and humptiness forever.
--Digital Underground