org.languagetool.tokenizers

Class LocalSRXSentenceTokenizer

java.lang.Object

org.languagetool.tokenizers.LocalSRXSentenceTokenizer

All Implemented Interfaces:

SentenceTokenizer, Tokenizer

Direct Known Subclasses:

SimpleSentenceTokenizer

public class LocalSRXSentenceTokenizer
extends Object
implements SentenceTokenizer

Class to tokenize sentences using an SRX file. See our wiki for a description of how we use SRX.

Since:

2.6

See Also:

SRXSentenceTokenizer

Constructor Summary

Constructors

Constructor and Description
LocalSRXSentenceTokenizer(Language language, String srxInClassPath)

Method Summary

Methods

Modifier and Type	Method and Description
void	setSingleLineBreaksMarksParagraph(boolean lineBreakParagraphs)
boolean	singleLineBreaksMarksPara()
List<String>	tokenize(String text) Tokenize the given string to sentences.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

LocalSRXSentenceTokenizer

public LocalSRXSentenceTokenizer(Language language,
                         String srxInClassPath)

Parameters:

srxInClassPath - the path to an SRX file in the classpath

Method Detail

tokenize

public final List<String> tokenize(String text)

Description copied from interface: SentenceTokenizer

Tokenize the given string to sentences.

Specified by:

tokenize in interface SentenceTokenizer

Specified by:

tokenize in interface Tokenizer

singleLineBreaksMarksPara

public final boolean singleLineBreaksMarksPara()

Specified by:

singleLineBreaksMarksPara in interface SentenceTokenizer

setSingleLineBreaksMarksParagraph

public final void setSingleLineBreaksMarksParagraph(boolean lineBreakParagraphs)

Specified by:

setSingleLineBreaksMarksParagraph in interface SentenceTokenizer

Parameters:

lineBreakParagraphs - if true, single lines breaks are assumed to end a paragraph; if false, only two ore more consecutive line breaks end a paragraph