co.cask.cdap.examples.wordcount

Class AssociationTable

java.lang.Object

co.cask.cdap.api.dataset.lib.AbstractDataset

co.cask.cdap.examples.wordcount.AssociationTable

All Implemented Interfaces:

Dataset, MeteredDataset, co.cask.tephra.TransactionAware, Closeable, AutoCloseable

public class AssociationTable
extends AbstractDataset

Constructor Summary

Constructors

Constructor and Description
AssociationTable(DatasetSpecification spec, Table table)

Method Summary

Methods

Modifier and Type	Method and Description
long	getAssoc(String word1, String word2) Returns how many times two words occured together.
Map<String,Long>	readWordAssocs(String word, int limit) Returns the top words associated with the specified word and the number of times the words have appeared together.
void	writeWordAssocs(Set<String> words) Stores associations between the specified set of words.

Methods inherited from class co.cask.cdap.api.dataset.lib.AbstractDataset

close, commitTx, getName, getTransactionAwareName, getTxChanges, postTxCommit, rollbackTx, setMetricsCollector, startTx, toString, updateTx

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Constructor Detail

AssociationTable

public AssociationTable(DatasetSpecification spec,
                Table table)

Method Detail

writeWordAssocs

public void writeWordAssocs(Set<String> words)

Stores associations between the specified set of words. That is, for every word in the set, an association will be stored for each of the other words in the set.

Parameters:

words - words to store associations between

readWordAssocs

public Map<String,Long> readWordAssocs(String word,
                              int limit)

Returns the top words associated with the specified word and the number of times the words have appeared together.

Parameters:

word - the word of interest

limit - the number of associations to return, at most

Returns:

a map of the top associated words to their co-occurrence count

getAssoc

public long getAssoc(String word1,
            String word2)

Returns how many times two words occured together.

Parameters:

word1 - the first word

word2 - the other word

Returns:

how many times word1 and word2 occurred together