Uses of Package
com.wcohen.ss.tokens

Packages that use com.wcohen.ss.tokens

Package	Description
com.wcohen.ss.tokens

Classes in com.wcohen.ss.tokens used by com.wcohen.ss.tokens

Class and Description
BasicToken An interned version of a string.
CharacterTokenizer Character tokenizer implementation.
NGramTokenizer Wraps another tokenizer, and adds all computes all ngrams of characters from a single token produced by the inner tokenizer.
SimpleSourcedTokenizer Simple implementation of a Tokenizer.
SimpleTokenizer Simple implementation of a Tokenizer.