ch.epfl.bbp.uima.ae

Class RegexTokenizerAnnotator

java.lang.Object

org.apache.uima.analysis_component.AnalysisComponent_ImplBase

org.apache.uima.analysis_component.Annotator_ImplBase

org.apache.uima.analysis_component.JCasAnnotator_ImplBase

org.apache.uima.fit.component.JCasAnnotator_ImplBase

ch.epfl.bbp.uima.ae.RegexTokenizerAnnotator

All Implemented Interfaces:

org.apache.uima.analysis_component.AnalysisComponent

public class RegexTokenizerAnnotator
extends org.apache.uima.fit.component.JCasAnnotator_ImplBase

Tokenizer that can be configured with a regex Pattern. Mostly useful for tests.

Author:

renaud.richardet@epfl.ch

Field Summary

Fields

Modifier and Type	Field and Description
static String	PARAM_TOKENIZATION_PATTERN
static String	patterPunctDigitsCamelcase Splits on any punctuation character, digits and case change.
static String	patterPunctuation Splits on any punctuation character, @see tests
static String	patterPunctuationNoDash Splits on any punctuation character, except dashes, @see tests

Constructor Summary

Constructors

Constructor and Description
RegexTokenizerAnnotator()

Method Summary

Methods

Modifier and Type	Method and Description
void	initialize(org.apache.uima.UimaContext context)
void	process(org.apache.uima.jcas.JCas jcas)

Methods inherited from class org.apache.uima.fit.component.JCasAnnotator_ImplBase

getLogger

Methods inherited from class org.apache.uima.analysis_component.JCasAnnotator_ImplBase

getRequiredCasInterface, process

Methods inherited from class org.apache.uima.analysis_component.Annotator_ImplBase

getCasInstancesRequired, hasNext, next

Methods inherited from class org.apache.uima.analysis_component.AnalysisComponent_ImplBase

batchProcessComplete, collectionProcessComplete, destroy, getContext, getResultSpecification, reconfigure, setResultSpecification

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

patterPunctDigitsCamelcase

public static final String patterPunctDigitsCamelcase

Splits on any punctuation character, digits and case change. @see tests

See Also:

Constant Field Values

patterPunctuation

public static final String patterPunctuation

Splits on any punctuation character, @see tests

See Also:

Constant Field Values

patterPunctuationNoDash

public static final String patterPunctuationNoDash

Splits on any punctuation character, except dashes, @see tests

See Also:

Constant Field Values

PARAM_TOKENIZATION_PATTERN

public static final String PARAM_TOKENIZATION_PATTERN

See Also:

Constant Field Values

Constructor Detail

RegexTokenizerAnnotator

public RegexTokenizerAnnotator()

Method Detail

initialize

public void initialize(org.apache.uima.UimaContext context)
                throws org.apache.uima.resource.ResourceInitializationException

Specified by:

initialize in interface org.apache.uima.analysis_component.AnalysisComponent

Overrides:

initialize in class org.apache.uima.fit.component.JCasAnnotator_ImplBase

Throws:

org.apache.uima.resource.ResourceInitializationException

process

public void process(org.apache.uima.jcas.JCas jcas)
             throws org.apache.uima.analysis_engine.AnalysisEngineProcessException

Specified by:

process in class org.apache.uima.analysis_component.JCasAnnotator_ImplBase

Throws:

org.apache.uima.analysis_engine.AnalysisEngineProcessException