co.cask.cdap.etl.mock.batch

Class MockExternalSink

java.lang.Object

co.cask.cdap.etl.api.batch.BatchConfigurable<BatchSinkContext>

co.cask.cdap.etl.api.batch.BatchSink<co.cask.cdap.api.data.format.StructuredRecord,NullWritable,String>

co.cask.cdap.etl.mock.batch.MockExternalSink

All Implemented Interfaces:

Destroyable, PipelineConfigurable, StageLifecycle<BatchRuntimeContext>, Transformation<co.cask.cdap.api.data.format.StructuredRecord,KeyValue<NullWritable,String>>

public class MockExternalSink
extends BatchSink<co.cask.cdap.api.data.format.StructuredRecord,NullWritable,String>

Mock sink that writes records to a Table and has a utility method for getting all records written.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	MockExternalSink.Config Config for the sink.

Field Summary

Fields

Modifier and Type	Field and Description
static PluginClass	PLUGIN_CLASS
static String	PLUGIN_NAME

Fields inherited from class co.cask.cdap.etl.api.batch.BatchSink

PLUGIN_TYPE

Constructor Summary

Constructors

Constructor and Description
MockExternalSink(MockExternalSink.Config config)

Method Summary

Methods

Modifier and Type	Method and Description
static ETLPlugin	getPlugin(String name, String alias, String dirName) Returns ETLPlugin for MockExternalSink.
void	prepareRun(BatchSinkContext context)
static List<co.cask.cdap.api.data.format.StructuredRecord>	readOutput(String dirName) Used to read the records written by this sink.
void	transform(co.cask.cdap.api.data.format.StructuredRecord input, Emitter<KeyValue<NullWritable,String>> emitter)

Methods inherited from class co.cask.cdap.etl.api.batch.BatchSink

destroy, initialize

Methods inherited from class co.cask.cdap.etl.api.batch.BatchConfigurable

configurePipeline, onRunFinish

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

PLUGIN_CLASS

public static final PluginClass PLUGIN_CLASS

PLUGIN_NAME

public static final String PLUGIN_NAME

See Also:

Constant Field Values

Constructor Detail

MockExternalSink

public MockExternalSink(MockExternalSink.Config config)

Method Detail

prepareRun

public void prepareRun(BatchSinkContext context)
                throws Exception

Specified by:

prepareRun in class BatchConfigurable<BatchSinkContext>

Throws:

Exception

transform

public void transform(co.cask.cdap.api.data.format.StructuredRecord input,
             Emitter<KeyValue<NullWritable,String>> emitter)
               throws Exception

Specified by:

transform in interface Transformation<co.cask.cdap.api.data.format.StructuredRecord,KeyValue<NullWritable,String>>

Overrides:

transform in class BatchSink<co.cask.cdap.api.data.format.StructuredRecord,NullWritable,String>

Throws:

Exception

getPlugin

public static ETLPlugin getPlugin(@Nullable
                  String name,
                  String alias,
                  String dirName)

Returns ETLPlugin for MockExternalSink.

Parameters:

name - name of the provider, use null for backwards compatibility

alias - alias of the provider

dirName - directory name

Returns:

ETLPlugin for MockExternalSink

readOutput

public static List<co.cask.cdap.api.data.format.StructuredRecord> readOutput(String dirName)
                                                                      throws Exception

Used to read the records written by this sink.

Parameters:

dirName - directory where output files are found

Throws:

Exception