co.cask.cdap.etl.mock.batch.aggregator

Class FieldCountAggregator

java.lang.Object

co.cask.cdap.etl.api.batch.BatchConfigurable<BatchAggregatorContext>

co.cask.cdap.etl.api.batch.BatchAggregator<Object,co.cask.cdap.api.data.format.StructuredRecord,co.cask.cdap.api.data.format.StructuredRecord>

co.cask.cdap.etl.mock.batch.aggregator.FieldCountAggregator

All Implemented Interfaces:

Aggregator<Object,co.cask.cdap.api.data.format.StructuredRecord,co.cask.cdap.api.data.format.StructuredRecord>, Destroyable, PipelineConfigurable, StageLifecycle<BatchRuntimeContext>

public class FieldCountAggregator
extends BatchAggregator<Object,co.cask.cdap.api.data.format.StructuredRecord,co.cask.cdap.api.data.format.StructuredRecord>

Groups on a specific field and adds count field. Used to test that the right values are going to the right groups, to test multiple group keys for the same value, and to test setting the group key class at runtime, and to test setting a supported non-writable class.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	FieldCountAggregator.Config Conf for the aggregator.

Field Summary

Fields

Modifier and Type	Field and Description
static PluginClass	PLUGIN_CLASS

Fields inherited from class co.cask.cdap.etl.api.batch.BatchAggregator

PLUGIN_TYPE

Constructor Summary

Constructors

Constructor and Description
FieldCountAggregator(FieldCountAggregator.Config config)

Method Summary

Methods

Modifier and Type	Method and Description
void	aggregate(Object groupKey, Iterator<co.cask.cdap.api.data.format.StructuredRecord> groupValues, Emitter<co.cask.cdap.api.data.format.StructuredRecord> emitter)
void	configurePipeline(PipelineConfigurer pipelineConfigurer)
static ETLPlugin	getPlugin(String fieldName, String fieldType)
void	groupBy(co.cask.cdap.api.data.format.StructuredRecord input, Emitter<Object> emitter)
void	initialize(BatchRuntimeContext context)
void	prepareRun(BatchAggregatorContext context)

Methods inherited from class co.cask.cdap.etl.api.batch.BatchAggregator

destroy

Methods inherited from class co.cask.cdap.etl.api.batch.BatchConfigurable

onRunFinish

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

PLUGIN_CLASS

public static final PluginClass PLUGIN_CLASS

Constructor Detail

FieldCountAggregator

public FieldCountAggregator(FieldCountAggregator.Config config)

Method Detail

configurePipeline

public void configurePipeline(PipelineConfigurer pipelineConfigurer)
                       throws IllegalArgumentException

Specified by:

configurePipeline in interface PipelineConfigurable

Overrides:

configurePipeline in class BatchAggregator<Object,co.cask.cdap.api.data.format.StructuredRecord,co.cask.cdap.api.data.format.StructuredRecord>

Throws:

IllegalArgumentException

prepareRun

public void prepareRun(BatchAggregatorContext context)
                throws Exception

Overrides:

prepareRun in class BatchAggregator<Object,co.cask.cdap.api.data.format.StructuredRecord,co.cask.cdap.api.data.format.StructuredRecord>

Throws:

Exception

groupBy

public void groupBy(co.cask.cdap.api.data.format.StructuredRecord input,
           Emitter<Object> emitter)
             throws Exception

Throws:

Exception

aggregate

public void aggregate(Object groupKey,
             Iterator<co.cask.cdap.api.data.format.StructuredRecord> groupValues,
             Emitter<co.cask.cdap.api.data.format.StructuredRecord> emitter)
               throws Exception

Throws:

Exception

initialize

public void initialize(BatchRuntimeContext context)
                throws Exception

Specified by:

initialize in interface StageLifecycle<BatchRuntimeContext>

Overrides:

initialize in class BatchAggregator<Object,co.cask.cdap.api.data.format.StructuredRecord,co.cask.cdap.api.data.format.StructuredRecord>

Throws:

Exception

getPlugin

public static ETLPlugin getPlugin(String fieldName,
                  String fieldType)