Verwendungen von Package
opennlp.tools.tokenize

Packages, die opennlp.tools.tokenize verwenden

Package	Beschreibung
opennlp.tools.cmdline.parser
opennlp.tools.cmdline.tokenizer
opennlp.tools.formats	Experimental package related to converting various corpora to OpenNLP Format.
opennlp.tools.formats.ad	Experimental package related to the Arvores Deitadas corpus format.
opennlp.tools.formats.brat	Experimental package related to the corpus format used by the "brat rapid annotation tool" (brat).
opennlp.tools.formats.conllu	Experimental package related to the CoNNL-U format.
opennlp.tools.formats.convert
opennlp.tools.formats.irishsentencebank	Experimental package related to the Irish Sentence Bank format.
opennlp.tools.formats.letsmt	Experimental package related to the letsmt corpus format.
opennlp.tools.formats.masc	Experimental package related to the MASC corpus format.
opennlp.tools.formats.muc	Experimental package related to the MUC corpus format.
opennlp.tools.sentdetect	Package related to identifying sentence boundaries.
opennlp.tools.tokenize	Contains classes related to finding token or words in a string.
opennlp.tools.tokenize.lang
opennlp.tools.tokenize.lang.en
opennlp.tools.util.featuregen	This package contains classes for generating sequence features.

Von opennlp.tools.cmdline.parser verwendete Klassen in opennlp.tools.tokenize

Klasse	Beschreibung
Tokenizer	The interface for tokenizers, which segment a string into its tokens.

Von opennlp.tools.cmdline.tokenizer verwendete Klassen in opennlp.tools.tokenize

Klasse	Beschreibung
TokenizerEvaluationMonitor	A marker interface for evaluating tokenizers.
TokenizerModel	The TokenizerModel is the model used by a learnable Tokenizer.
TokenSample	A TokenSample is text with token spans.

Von opennlp.tools.formats verwendete Klassen in opennlp.tools.tokenize

Klasse	Beschreibung
Detokenizer	A Detokenizer merges tokens back to their detokenized representation.
TokenSample	A TokenSample is text with token spans.

Von opennlp.tools.formats.ad verwendete Klassen in opennlp.tools.tokenize

Klasse	Beschreibung
TokenSample	A TokenSample is text with token spans.

Von opennlp.tools.formats.brat verwendete Klassen in opennlp.tools.tokenize

Klasse	Beschreibung
Tokenizer	The interface for tokenizers, which segment a string into its tokens.
TokenizerModel	The TokenizerModel is the model used by a learnable Tokenizer.

Von opennlp.tools.formats.conllu verwendete Klassen in opennlp.tools.tokenize

Klasse	Beschreibung
TokenSample	A TokenSample is text with token spans.

Von opennlp.tools.formats.convert verwendete Klassen in opennlp.tools.tokenize

Klasse	Beschreibung
Detokenizer	A Detokenizer merges tokens back to their detokenized representation.
TokenSample	A TokenSample is text with token spans.

Von opennlp.tools.formats.irishsentencebank verwendete Klassen in opennlp.tools.tokenize

Klasse	Beschreibung
TokenSample	A TokenSample is text with token spans.

Von opennlp.tools.formats.letsmt verwendete Klassen in opennlp.tools.tokenize

Klasse	Beschreibung
Detokenizer	A Detokenizer merges tokens back to their detokenized representation.

Von opennlp.tools.formats.masc verwendete Klassen in opennlp.tools.tokenize

Klasse	Beschreibung
TokenSample	A TokenSample is text with token spans.

Von opennlp.tools.formats.muc verwendete Klassen in opennlp.tools.tokenize

Klasse	Beschreibung
Tokenizer	The interface for tokenizers, which segment a string into its tokens.

Von opennlp.tools.sentdetect verwendete Klassen in opennlp.tools.tokenize

Klasse	Beschreibung
Detokenizer	A Detokenizer merges tokens back to their detokenized representation.

Von opennlp.tools.tokenize verwendete Klassen in opennlp.tools.tokenize

Klasse	Beschreibung
DetokenizationDictionary
DetokenizationDictionary.Operation
Detokenizer	A Detokenizer merges tokens back to their detokenized representation.
Detokenizer.DetokenizationOperation	This enum contains an operation for every token to merge the tokens together to their detokenized form.
SimpleTokenizer	A basic Tokenizer implementation which performs tokenization using character classes.
TokenContextGenerator	Interface for context generators required for TokenizerME.
Tokenizer	The interface for tokenizers, which segment a string into its tokens.
TokenizerEvaluationMonitor	A marker interface for evaluating tokenizers.
TokenizerFactory	The factory that provides Tokenizer default implementation and resources.
TokenizerModel	The TokenizerModel is the model used by a learnable Tokenizer.
TokenSample	A TokenSample is text with token spans.
WhitespaceTokenizer	A basic Tokenizer implementation which performs tokenization using white spaces.

Von opennlp.tools.tokenize.lang verwendete Klassen in opennlp.tools.tokenize

Klasse	Beschreibung
TokenContextGenerator	Interface for context generators required for TokenizerME.

Von opennlp.tools.tokenize.lang.en verwendete Klassen in opennlp.tools.tokenize

Klasse	Beschreibung
TokenSample	A TokenSample is text with token spans.

Von opennlp.tools.util.featuregen verwendete Klassen in opennlp.tools.tokenize

Klasse	Beschreibung
Tokenizer	The interface for tokenizers, which segment a string into its tokens.