co.cask.cdap.etl.mock.batch

Class MockSink

java.lang.Object

co.cask.cdap.etl.api.batch.BatchConfigurable<BatchSinkContext>

co.cask.cdap.etl.api.batch.BatchSink<co.cask.cdap.api.data.format.StructuredRecord,byte[],Put>

co.cask.cdap.etl.mock.batch.MockSink

All Implemented Interfaces:

Destroyable, PipelineConfigurable, StageLifecycle<BatchRuntimeContext>, SubmitterLifecycle<BatchSinkContext>, Transformation<co.cask.cdap.api.data.format.StructuredRecord,KeyValue<byte[],Put>>

public class MockSink
extends BatchSink<co.cask.cdap.api.data.format.StructuredRecord,byte[],Put>

Mock sink that writes records to a Table and has a utility method for getting all records written.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	MockSink.Config Config for the sink.

Field Summary

Fields

Modifier and Type	Field and Description
static PluginClass	PLUGIN_CLASS

Fields inherited from class co.cask.cdap.etl.api.batch.BatchSink

PLUGIN_TYPE

Constructor Summary

Constructors

Constructor and Description
MockSink(MockSink.Config config)

Method Summary

Modifier and Type	Method and Description
static void	clear(DataSetManager<Table> tableManager) Clear any records written to this sink.
void	configurePipeline(PipelineConfigurer pipelineConfigurer)
static ETLPlugin	getPlugin(String tableName)
void	initialize(BatchRuntimeContext context)
void	prepareRun(BatchSinkContext context)
static List<co.cask.cdap.api.data.format.StructuredRecord>	readOutput(DataSetManager<Table> tableManager) Used to read the records written by this sink.
void	transform(co.cask.cdap.api.data.format.StructuredRecord input, Emitter<KeyValue<byte[],Put>> emitter)

Methods inherited from class co.cask.cdap.etl.api.batch.BatchSink

destroy

Methods inherited from class co.cask.cdap.etl.api.batch.BatchConfigurable

onRunFinish

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

PLUGIN_CLASS

public static final PluginClass PLUGIN_CLASS

Constructor Detail

MockSink

public MockSink(MockSink.Config config)

Method Detail

configurePipeline

public void configurePipeline(PipelineConfigurer pipelineConfigurer)

Specified by:

configurePipeline in interface PipelineConfigurable

Overrides:

configurePipeline in class BatchConfigurable<BatchSinkContext>

prepareRun

public void prepareRun(BatchSinkContext context)
                throws Exception

Specified by:

prepareRun in interface SubmitterLifecycle<BatchSinkContext>

Specified by:

prepareRun in class BatchConfigurable<BatchSinkContext>

Throws:

Exception

initialize

public void initialize(BatchRuntimeContext context)
                throws Exception

Specified by:

initialize in interface StageLifecycle<BatchRuntimeContext>

Overrides:

initialize in class BatchSink<co.cask.cdap.api.data.format.StructuredRecord,byte[],Put>

Throws:

Exception

transform

public void transform(co.cask.cdap.api.data.format.StructuredRecord input,
                      Emitter<KeyValue<byte[],Put>> emitter)
               throws Exception

Specified by:

transform in interface Transformation<co.cask.cdap.api.data.format.StructuredRecord,KeyValue<byte[],Put>>

Overrides:

transform in class BatchSink<co.cask.cdap.api.data.format.StructuredRecord,byte[],Put>

Throws:

Exception

getPlugin

public static ETLPlugin getPlugin(String tableName)

readOutput

public static List<co.cask.cdap.api.data.format.StructuredRecord> readOutput(DataSetManager<Table> tableManager)
                                                                      throws Exception

Used to read the records written by this sink.

Parameters:

tableManager - dataset manager used to get the sink dataset to read from

Throws:

Exception

clear

public static void clear(DataSetManager<Table> tableManager)

Clear any records written to this sink.

Parameters:

tableManager - dataset manager used to get the sink dataset