Uses of Interface
org.languagetool.tokenizers.Tokenizer

Packages that use Tokenizer

Package	Description
org.languagetool
org.languagetool.tokenizers

Uses of Tokenizer in org.languagetool

Methods in org.languagetool that return Tokenizer

Modifier and Type	Method and Description
Tokenizer	Language.getWordTokenizer() Get this language's word tokenizer implementation.

Uses of Tokenizer in org.languagetool.tokenizers

Subinterfaces of Tokenizer in org.languagetool.tokenizers

Modifier and Type	Interface and Description
interface	CompoundWordTokenizer Interface for components that take compound words and split them into their parts.
interface	SentenceTokenizer Tokenizes text into sentences.

Classes in org.languagetool.tokenizers that implement Tokenizer

Modifier and Type	Class and Description
class	LocalSRXSentenceTokenizer Class to tokenize sentences using an SRX file.
class	SimpleSentenceTokenizer A very simple sentence tokenizer that splits on {@code [.!?
class	SRXSentenceTokenizer Class to tokenize sentences using LanguageTool's global SRX file for all languages.
class	WordTokenizer Tokenizes a sentence into words.