@Internal public class CacheTransformationTranslator<OUT,T extends CacheTransformation<OUT>> extends SimpleTransformationTranslator<OUT,T>
CacheTransformationTranslator.| Modifier and Type | Class and Description |
|---|---|
static class |
CacheTransformationTranslator.IdentityStreamOperator<T>
The
CacheTransformationTranslator.IdentityStreamOperator acts as a dummy source to consume cached intermediate
dataset. |
static class |
CacheTransformationTranslator.NoOpStreamOperator<T>
The
CacheTransformationTranslator.NoOpStreamOperator acts as a dummy sink so that the upstream can produce the
intermediate dataset to be cached. |
TransformationTranslator.Context| Modifier and Type | Field and Description |
|---|---|
static String |
CACHE_CONSUMER_OPERATOR_NAME |
static String |
CACHE_PRODUCER_OPERATOR_NAME |
| Constructor and Description |
|---|
CacheTransformationTranslator() |
| Modifier and Type | Method and Description |
|---|---|
protected Collection<Integer> |
translateForBatchInternal(T transformation,
TransformationTranslator.Context context)
Translates a given
Transformation to its runtime implementation for BATCH-style
execution. |
protected Collection<Integer> |
translateForStreamingInternal(T transformation,
TransformationTranslator.Context context)
Translates a given
Transformation to its runtime implementation for STREAMING-style
execution. |
translateForBatch, translateForStreamingpublic static final String CACHE_CONSUMER_OPERATOR_NAME
public static final String CACHE_PRODUCER_OPERATOR_NAME
protected Collection<Integer> translateForBatchInternal(T transformation, TransformationTranslator.Context context)
SimpleTransformationTranslatorTransformation to its runtime implementation for BATCH-style
execution.translateForBatchInternal in class SimpleTransformationTranslator<OUT,T extends CacheTransformation<OUT>>transformation - The transformation to be translated.context - The translation context.StreamNodes in the transformation graph
corresponding to this transformation. These will be the nodes that a potential following
transformation will need to connect to.protected Collection<Integer> translateForStreamingInternal(T transformation, TransformationTranslator.Context context)
SimpleTransformationTranslatorTransformation to its runtime implementation for STREAMING-style
execution.translateForStreamingInternal in class SimpleTransformationTranslator<OUT,T extends CacheTransformation<OUT>>transformation - The transformation to be translated.context - The translation context.StreamNodes in the transformation graph
corresponding to this transformation. These will be the nodes that a potential following
transformation will need to connect to.Copyright © 2014–2024 The Apache Software Foundation. All rights reserved.