co.cask.cdap.etl.mock.spark.compute

Class StringValueFilterCompute

java.lang.Object

co.cask.cdap.etl.api.batch.SparkCompute<co.cask.cdap.api.data.format.StructuredRecord,co.cask.cdap.api.data.format.StructuredRecord>

co.cask.cdap.etl.mock.spark.compute.StringValueFilterCompute

All Implemented Interfaces:

PipelineConfigurable, Serializable

public class StringValueFilterCompute
extends SparkCompute<co.cask.cdap.api.data.format.StructuredRecord,co.cask.cdap.api.data.format.StructuredRecord>

Transform that filters out records whose configured field is a configured value. For example, can filter all records whose 'foo' field is equal to 'bar'. Assumes the field is of type string.

See Also:

Serialized Form

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	StringValueFilterCompute.Conf Config for the plugin

Field Summary

Fields

Modifier and Type	Field and Description
static PluginClass	PLUGIN_CLASS

Fields inherited from class co.cask.cdap.etl.api.batch.SparkCompute

PLUGIN_TYPE

Constructor Summary

Constructors

Constructor and Description
StringValueFilterCompute(StringValueFilterCompute.Conf conf)

Method Summary

Modifier and Type	Method and Description
void	configurePipeline(PipelineConfigurer pipelineConfigurer)
static ETLPlugin	getPlugin(String field, String value)
void	initialize(SparkExecutionPluginContext context)
org.apache.spark.api.java.JavaRDD<co.cask.cdap.api.data.format.StructuredRecord>	transform(SparkExecutionPluginContext context, org.apache.spark.api.java.JavaRDD<co.cask.cdap.api.data.format.StructuredRecord> input)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

PLUGIN_CLASS

public static final PluginClass PLUGIN_CLASS

Constructor Detail

StringValueFilterCompute

public StringValueFilterCompute(StringValueFilterCompute.Conf conf)

Method Detail

configurePipeline

public void configurePipeline(PipelineConfigurer pipelineConfigurer)
                       throws IllegalArgumentException

Specified by:

configurePipeline in interface PipelineConfigurable

Overrides:

configurePipeline in class SparkCompute<co.cask.cdap.api.data.format.StructuredRecord,co.cask.cdap.api.data.format.StructuredRecord>

Throws:

IllegalArgumentException

initialize

public void initialize(SparkExecutionPluginContext context)
                throws Exception

Overrides:

initialize in class SparkCompute<co.cask.cdap.api.data.format.StructuredRecord,co.cask.cdap.api.data.format.StructuredRecord>

Throws:

Exception

transform

public org.apache.spark.api.java.JavaRDD<co.cask.cdap.api.data.format.StructuredRecord> transform(SparkExecutionPluginContext context,
                                                                                                  org.apache.spark.api.java.JavaRDD<co.cask.cdap.api.data.format.StructuredRecord> input)
                                                                                           throws Exception

Specified by:

transform in class SparkCompute<co.cask.cdap.api.data.format.StructuredRecord,co.cask.cdap.api.data.format.StructuredRecord>

Throws:

Exception

getPlugin

public static ETLPlugin getPlugin(String field,
                                  String value)