co.cask.cdap.examples.wordcount

Class WordCounter

java.lang.Object

co.cask.cdap.internal.api.AbstractProgramDatasetConfigurable<FlowConfigurer>

co.cask.cdap.api.flow.AbstractFlow

co.cask.cdap.examples.wordcount.WordCounter

All Implemented Interfaces:

Flow, Processor

public class WordCounter
extends AbstractFlow

Flow that takes any arbitrary string of input and performs word statistics.

Flow parses input string into individual words, then performs per-word counts and other calculations like total number of words seen, average length of words seen, unique words seen, and also tracks the words most often associated with each other word.

The first Flowlet is the WordSplitter, which splits the sentence into individual words, cleans up non-alpha characters, and then sends the sentences to the WordAssociater and the words on to the WordCounter.

The next Flowlet is the WordAssociater that will track word associations between all of the words within the input string.

The next Flowlet is the Counter, which performs the necessary data operations to do the word count and count other word statistics.

The last Flowlet is the UniqueCounter, which calculates and updates the unique number of words seen.

Constructor Summary

Constructors

Constructor and Description
WordCounter(WordCount.WordCountConfig config)

Method Summary

Methods

Modifier and Type	Method and Description
protected void	configure()

Methods inherited from class co.cask.cdap.api.flow.AbstractFlow

addFlowlet, addFlowlet, addFlowlet, addFlowlet, configure, configureFlow, connect, connect, connect, connect, connectStream, connectStream, getConfigurer, setDescription, setName

Methods inherited from class co.cask.cdap.internal.api.AbstractProgramDatasetConfigurable

addDatasetModule, addDatasetType, addStream, addStream, createDataset, createDataset, createDataset, createDataset

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

WordCounter

public WordCounter(WordCount.WordCountConfig config)

Method Detail

configure

protected void configure()

Overrides:

configure in class AbstractFlow