Package org.apache.beam.runners.fnexecution.translation

Class PipelineTranslatorUtils

  • public final class PipelineTranslatorUtils
extends java.lang.Object
    Utilities for pipeline translation.

    • Method Summary

      All Methods Static Methods Concrete Methods 
      Modifier and Type Method Description
      static org.apache.beam.vendor.guava.v32_1_2_jre.com.google.common.collect.BiMap<java.lang.String,​java.lang.Integer> createOutputMap​(java.lang.Iterable<java.lang.String> localOutputs)
      Creates a mapping from PCollection id to output tag integer.
      static void fireEligibleTimers​(org.apache.beam.runners.core.InMemoryTimerInternals timerInternals, java.util.Map<org.apache.beam.sdk.values.KV<java.lang.String,​java.lang.String>,​org.apache.beam.sdk.fn.data.FnDataReceiver<org.apache.beam.sdk.util.construction.Timer>> timerReceivers, java.lang.Object currentTimerKey)
      Fires all timers which are ready to be fired.
      static java.lang.String getExecutableStageIntermediateId​(org.apache.beam.sdk.util.construction.graph.PipelineNode.PTransformNode transformNode)  
      static java.lang.String getInputId​(org.apache.beam.sdk.util.construction.graph.PipelineNode.PTransformNode transformNode)  
      static java.lang.String getOutputId​(org.apache.beam.sdk.util.construction.graph.PipelineNode.PTransformNode transformNode)  
      static <T> org.apache.beam.sdk.values.WindowedValues.WindowedValueCoder<T> getWindowedValueCoder​(java.lang.String pCollectionId, org.apache.beam.model.pipeline.v1.RunnerApi.Components components)  
      static org.apache.beam.sdk.values.WindowingStrategy getWindowingStrategy​(java.lang.String pCollectionId, org.apache.beam.model.pipeline.v1.RunnerApi.Components components)  
      static boolean hasUnboundedPCollections​(org.apache.beam.model.pipeline.v1.RunnerApi.Pipeline pipeline)
      Indicates whether the given pipeline has any unbounded PCollections.
      static <T> org.apache.beam.sdk.coders.Coder<org.apache.beam.sdk.values.WindowedValue<T>> instantiateCoder​(java.lang.String collectionId, org.apache.beam.model.pipeline.v1.RunnerApi.Components components)
      Creates a coder for a given PCollection id from the Proto definition.

      • Methods inherited from class java.lang.Object

        clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

    • Method Detail

      • createOutputMap

        public static org.apache.beam.vendor.guava.v32_1_2_jre.com.google.common.collect.BiMap<java.lang.String,​java.lang.Integer> createOutputMap​(java.lang.Iterable<java.lang.String> localOutputs)
        Creates a mapping from PCollection id to output tag integer.

      • instantiateCoder

        public static <T> org.apache.beam.sdk.coders.Coder<org.apache.beam.sdk.values.WindowedValue<T>> instantiateCoder​(java.lang.String collectionId,
                                                                                                                 org.apache.beam.model.pipeline.v1.RunnerApi.Components components)
        Creates a coder for a given PCollection id from the Proto definition.

      • getWindowingStrategy

        public static org.apache.beam.sdk.values.WindowingStrategy getWindowingStrategy​(java.lang.String pCollectionId,
                                                                                org.apache.beam.model.pipeline.v1.RunnerApi.Components components)

      • hasUnboundedPCollections

        public static boolean hasUnboundedPCollections​(org.apache.beam.model.pipeline.v1.RunnerApi.Pipeline pipeline)
        Indicates whether the given pipeline has any unbounded PCollections.

      • fireEligibleTimers

        public static void fireEligibleTimers​(org.apache.beam.runners.core.InMemoryTimerInternals timerInternals,
                                      java.util.Map<org.apache.beam.sdk.values.KV<java.lang.String,​java.lang.String>,​org.apache.beam.sdk.fn.data.FnDataReceiver<org.apache.beam.sdk.util.construction.Timer>> timerReceivers,
                                      java.lang.Object currentTimerKey)
        Fires all timers which are ready to be fired. This is done in a loop because timers may itself schedule timers.

      • getWindowedValueCoder

        public static <T> org.apache.beam.sdk.values.WindowedValues.WindowedValueCoder<T> getWindowedValueCoder​(java.lang.String pCollectionId,
                                                                                                        org.apache.beam.model.pipeline.v1.RunnerApi.Components components)

      • getInputId

        public static java.lang.String getInputId​(org.apache.beam.sdk.util.construction.graph.PipelineNode.PTransformNode transformNode)

      • getOutputId

        public static java.lang.String getOutputId​(org.apache.beam.sdk.util.construction.graph.PipelineNode.PTransformNode transformNode)

      • getExecutableStageIntermediateId

        public static java.lang.String getExecutableStageIntermediateId​(org.apache.beam.sdk.util.construction.graph.PipelineNode.PTransformNode transformNode)