org.languagetool.tokenizers

Class SimpleSentenceTokenizer

java.lang.Object

org.languagetool.tokenizers.LocalSRXSentenceTokenizer

org.languagetool.tokenizers.SimpleSentenceTokenizer

All Implemented Interfaces:

SentenceTokenizer, Tokenizer

public class SimpleSentenceTokenizer
extends LocalSRXSentenceTokenizer

A very simple sentence tokenizer that splits on [.!?…] followed by whitespace or an uppercase letter. You probably want to use an adapted LocalSRXSentenceTokenizer instead.

Since:

2.6

Constructor Summary

Constructors

Constructor and Description
SimpleSentenceTokenizer()

Method Summary

Methods inherited from class org.languagetool.tokenizers.LocalSRXSentenceTokenizer

setSingleLineBreaksMarksParagraph, singleLineBreaksMarksPara, tokenize

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

SimpleSentenceTokenizer

public SimpleSentenceTokenizer()