Uses of Class
net.java.sen.dictionary.Token

Packages that use Token

net.java.sen
net.java.sen.dictionary
net.java.sen.filter
net.java.sen.filter.reading
net.java.sen.filter.stream
org.apache.lucene.analysis.ja

Uses of Token in net.java.sen

Methods in net.java.sen that return Token

Token

StreamTagger.next() Returns the next available token

Methods in net.java.sen that return types with arguments of type Token

List<Token>	StringTagger.analyze(char[] surface) Deprecated. use StringTagger.analyze(char[], List) instead.
List<Token>	StringTagger.analyze(char[] surface, List<Token> reuse) Decompose a string into its most likely constituent morphemes
List<Token>	StringTagger.analyze(String surface) Deprecated. use StringTagger.analyze(String, List) instead.
List<Token>	StringTagger.analyze(String surface, List<Token> reuse) Decompose a string into its most likely constituent morphemes
List<Token>	ReadingProcessor.ReadingResult.getPossibleTokens(int position) Searches for possible tokens starting at the given position within the result's text
List<Token>	ReadingProcessor.ReadingResult.getTokens() Gets the tokens resulting from analysis of the result's text.

Method parameters in net.java.sen with type arguments of type Token

List<Token>	StringTagger.analyze(char[] surface, List<Token> reuse) Decompose a string into its most likely constituent morphemes
List<Token>	StringTagger.analyze(String surface, List<Token> reuse) Decompose a string into its most likely constituent morphemes

Uses of Token in net.java.sen.dictionary

Methods in net.java.sen.dictionary that return types with arguments of type Token

List<Token>	Viterbi.getBestTokens(Sentence sentence) Deprecated. use Viterbi.getBestTokens(Sentence, List) instead
List<Token>	Viterbi.getBestTokens(Sentence sentence, List<Token> reuse) Analyses a sentence to find the most likely sequence of morphemes
List<Token>	Viterbi.getPossibleTokens(Sentence sentence, int position) Gets the possible tokens from a Sentence at a given position.

Method parameters in net.java.sen.dictionary with type arguments of type Token

List<Token>

Viterbi.getBestTokens(Sentence sentence, List<Token> reuse) Analyses a sentence to find the most likely sequence of morphemes

Uses of Token in net.java.sen.filter

Methods in net.java.sen.filter that return types with arguments of type Token

List<Token>

StreamFilter.postProcess(List<Token> tokens) Post-processes analysed tokens

Method parameters in net.java.sen.filter with type arguments of type Token

void	ReadingFilter.filterReadings(List<Token> tokens, ReadingNode readingNode) Filters readings
List<Token>	StreamFilter.postProcess(List<Token> tokens) Post-processes analysed tokens

Uses of Token in net.java.sen.filter.reading

Method parameters in net.java.sen.filter.reading with type arguments of type Token

void	OverrideFilter.filterReadings(List<Token> tokens, ReadingNode readingNode)
void	NumberFilter.filterReadings(List<Token> tokens, ReadingNode readingNode)

Uses of Token in net.java.sen.filter.stream

Methods in net.java.sen.filter.stream that return types with arguments of type Token

List<Token>	CompoundWordFilter.postProcess(List<Token> tokens)
List<Token>	CompositeTokenFilter.postProcess(List<Token> tokens)
List<Token>	CommentFilter.postProcess(List<Token> tokens)

Method parameters in net.java.sen.filter.stream with type arguments of type Token

List<Token>	CompoundWordFilter.postProcess(List<Token> tokens)
List<Token>	CompositeTokenFilter.postProcess(List<Token> tokens)
List<Token>	CommentFilter.postProcess(List<Token> tokens)

Uses of Token in org.apache.lucene.analysis.ja

Methods in org.apache.lucene.analysis.ja that return Token

Token

StreamTagger2.next()