org.apache.beam.sdk.io.gcp.bigtable.changestreams.action

Class GenerateInitialPartitionsAction

java.lang.Object

org.apache.beam.sdk.io.gcp.bigtable.changestreams.action.GenerateInitialPartitionsAction

@Internal
public class GenerateInitialPartitionsAction
extends java.lang.Object

Class to generate first set of outputs for DetectNewPartitionsDoFn.

Constructor Summary

Constructors

Constructor and Description
GenerateInitialPartitionsAction(ChangeStreamMetrics metrics, ChangeStreamDao changeStreamDao, com.google.cloud.Timestamp endTime)

Method Summary

Modifier and Type	Method and Description
boolean	run(org.apache.beam.sdk.transforms.DoFn.OutputReceiver<PartitionRecord> receiver, org.apache.beam.sdk.transforms.splittabledofn.ManualWatermarkEstimator<org.joda.time.Instant> watermarkEstimator, com.google.cloud.Timestamp startTime) The very first step of the pipeline when there are no partitions being streamed yet.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

GenerateInitialPartitionsAction

public GenerateInitialPartitionsAction(ChangeStreamMetrics metrics,
                                       ChangeStreamDao changeStreamDao,
                                       @Nullable
                                       com.google.cloud.Timestamp endTime)

Method Detail

run

public boolean run(org.apache.beam.sdk.transforms.DoFn.OutputReceiver<PartitionRecord> receiver,
                   org.apache.beam.sdk.transforms.splittabledofn.ManualWatermarkEstimator<org.joda.time.Instant> watermarkEstimator,
                   com.google.cloud.Timestamp startTime)

The very first step of the pipeline when there are no partitions being streamed yet. We want to get an initial list of partitions to stream and output them.

Returns:

true if this pipeline should continue, otherwise false.