Package org.apache.beam.runners.dataflow.util

Provides miscellaneous internal utilities used by the Google Cloud Dataflow runner.

Interface Summary

Interface	Description
CloudObjectTranslator<T>	A translator that takes an object and creates a CloudObject which can be converted back to the original object.
CoderCloudObjectTranslatorRegistrar	Coder authors have the ability to automatically have their Coder registered with the Dataflow Runner by creating a ServiceLoader entry and a concrete implementation of this interface.
MonitoringUtil.JobMessagesHandler	An interface that can be used for defining callbacks to receive a list of JobMessages containing monitoring information.
Stager	Interface for staging files needed for running a Dataflow pipeline.

Class Summary

Class	Description
CloudObject	A representation of an arbitrary Java object to be instantiated by Dataflow workers.
CloudObjects	Utilities for converting an object to a CloudObject.
DataflowTemplateJob	A DataflowPipelineJob that is returned when --templateRunner is set.
DataflowTransport	Helpers for cloud communication.
DefaultCoderCloudObjectTranslatorRegistrar	The CoderCloudObjectTranslatorRegistrar containing the default collection of Coder Cloud Object Translators.
GcsStager	Utility class for staging files to GCS.
MonitoringUtil	A helper class for monitoring jobs submitted to the service.
MonitoringUtil.LoggingHandler	A handler that logs monitoring messages.
MonitoringUtil.TimeStampComparator	Comparator for sorting rows in increasing order based on timestamp.
OutputReference	A representation used by Steps to reference the output of other Steps.
PackageUtil	Helper routines for packages.
PackageUtil.StagedFile
PropertyNames	Constant property names used by the SDK in CloudWorkflow specifications.
RandomAccessData	An elastic-sized byte array which allows you to manipulate it as a stream, or access it directly.
RandomAccessData.RandomAccessDataCoder	A Coder which encodes the valid parts of this stream.
RandomAccessData.UnsignedLexicographicalComparator	A Comparator that compares two byte arrays lexicographically.
RowCoderCloudObjectTranslator	Translator for row coders.
SchemaCoderCloudObjectTranslator	Translator for Schema coders.
Structs	A collection of static methods for manipulating datastructure representations transferred via the Dataflow API.
TimeUtil	A helper class for converting between Dataflow API and SDK time representations.