Package org.apache.beam.sdk.io.gcp.bigquery

Class AvroGenericRecordToStorageApiProto

  • public class AvroGenericRecordToStorageApiProto
extends java.lang.Object
    Utility methods for converting Avro GenericRecord objects to dynamic protocol message, for use with the Storage write API.

    • Method Summary

      All Methods Static Methods Concrete Methods 
      Modifier and Type Method Description
      static com.google.protobuf.DynamicMessage messageFromGenericRecord​(com.google.protobuf.Descriptors.Descriptor descriptor, org.apache.avro.generic.GenericRecord record, java.lang.String changeType, long changeSequenceNum)
      Forwards {@param changeSequenceNum} to messageFromGenericRecord(Descriptor, GenericRecord, String, String) via Long.toHexString(long).
      static com.google.protobuf.DynamicMessage messageFromGenericRecord​(com.google.protobuf.Descriptors.Descriptor descriptor, org.apache.avro.generic.GenericRecord record, java.lang.String changeType, java.lang.String changeSequenceNum)
      Given an Avro GenericRecord object, returns a protocol-buffer message that can be used to write data using the BigQuery Storage streaming API.
      static com.google.cloud.bigquery.storage.v1.TableSchema protoTableSchemaFromAvroSchema​(org.apache.avro.Schema schema)
      Given an Avro Schema, returns a protocol-buffer TableSchema that can be used to write data through BigQuery Storage API.

      • Methods inherited from class java.lang.Object

        clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

    • Constructor Detail

      • AvroGenericRecordToStorageApiProto

        public AvroGenericRecordToStorageApiProto()

    • Method Detail

      • protoTableSchemaFromAvroSchema

        public static com.google.cloud.bigquery.storage.v1.TableSchema protoTableSchemaFromAvroSchema​(org.apache.avro.Schema schema)
        Given an Avro Schema, returns a protocol-buffer TableSchema that can be used to write data through BigQuery Storage API.
        Parameters:
        schema - An Avro Schema
        Returns:
        Returns the TableSchema created from the provided Schema

      • messageFromGenericRecord

        public static com.google.protobuf.DynamicMessage messageFromGenericRecord​(com.google.protobuf.Descriptors.Descriptor descriptor,
                                                                          org.apache.avro.generic.GenericRecord record,
                                                                          @Nullable
                                                                          java.lang.String changeType,
                                                                          long changeSequenceNum)
        Forwards {@param changeSequenceNum} to messageFromGenericRecord(Descriptor, GenericRecord, String, String) via Long.toHexString(long).

      • messageFromGenericRecord

        public static com.google.protobuf.DynamicMessage messageFromGenericRecord​(com.google.protobuf.Descriptors.Descriptor descriptor,
                                                                          org.apache.avro.generic.GenericRecord record,
                                                                          @Nullable
                                                                          java.lang.String changeType,
                                                                          @Nullable
                                                                          java.lang.String changeSequenceNum)
        Given an Avro GenericRecord object, returns a protocol-buffer message that can be used to write data using the BigQuery Storage streaming API.
        Parameters:
        descriptor - The Descriptor for the DynamicMessage result
        record - An Avro GenericRecord
        Returns:
        A dynamic message representation of a Proto payload to be used for StorageWrite API