co.cask.cdap.etl.mock.spark.streaming

Class MockSource

java.lang.Object

co.cask.cdap.etl.api.streaming.StreamingSource<co.cask.cdap.api.data.format.StructuredRecord>

co.cask.cdap.etl.mock.spark.streaming.MockSource

All Implemented Interfaces:

PipelineConfigurable, Serializable

public class MockSource
extends StreamingSource<co.cask.cdap.api.data.format.StructuredRecord>

Mock source for spark streaming unit tests.

See Also:

Serialized Form

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	MockSource.Conf Config for mock source.

Field Summary

Fields

Modifier and Type	Field and Description
static PluginClass	PLUGIN_CLASS

Fields inherited from class co.cask.cdap.etl.api.streaming.StreamingSource

PLUGIN_TYPE

Constructor Summary

Constructors

Constructor and Description
MockSource(MockSource.Conf conf)

Method Summary

Modifier and Type	Method and Description
void	configurePipeline(PipelineConfigurer pipelineConfigurer)
static ETLPlugin	getPlugin(co.cask.cdap.api.data.schema.Schema schema, List<co.cask.cdap.api.data.format.StructuredRecord> records)
static ETLPlugin	getPlugin(co.cask.cdap.api.data.schema.Schema schema, List<co.cask.cdap.api.data.format.StructuredRecord> records, Long intervalMillis)
org.apache.spark.streaming.api.java.JavaDStream<co.cask.cdap.api.data.format.StructuredRecord>	getStream(StreamingContext context)

Methods inherited from class co.cask.cdap.etl.api.streaming.StreamingSource

getRequiredExecutors

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

PLUGIN_CLASS

public static final PluginClass PLUGIN_CLASS

Constructor Detail

MockSource

public MockSource(MockSource.Conf conf)

Method Detail

configurePipeline

public void configurePipeline(PipelineConfigurer pipelineConfigurer)

Specified by:

configurePipeline in interface PipelineConfigurable

Overrides:

configurePipeline in class StreamingSource<co.cask.cdap.api.data.format.StructuredRecord>

getStream

public org.apache.spark.streaming.api.java.JavaDStream<co.cask.cdap.api.data.format.StructuredRecord> getStream(StreamingContext context)
                                                                                                         throws Exception

Specified by:

getStream in class StreamingSource<co.cask.cdap.api.data.format.StructuredRecord>

Throws:

Exception

getPlugin

public static ETLPlugin getPlugin(co.cask.cdap.api.data.schema.Schema schema,
                                  List<co.cask.cdap.api.data.format.StructuredRecord> records)
                           throws IOException

Throws:

IOException

getPlugin

public static ETLPlugin getPlugin(co.cask.cdap.api.data.schema.Schema schema,
                                  List<co.cask.cdap.api.data.format.StructuredRecord> records,
                                  Long intervalMillis)
                           throws IOException

Throws:

IOException