Package org.apache.beam.sdk.io.gcp.bigtable

Class BeamRowToBigtableMutation

  • All Implemented Interfaces:
    java.io.Serializable, org.apache.beam.sdk.transforms.display.HasDisplayData
    public class BeamRowToBigtableMutation
extends org.apache.beam.sdk.transforms.PTransform<org.apache.beam.sdk.values.PCollection<org.apache.beam.sdk.values.Row>,​org.apache.beam.sdk.values.PCollection<org.apache.beam.sdk.values.KV<com.google.protobuf.ByteString,​java.lang.Iterable<com.google.bigtable.v2.Mutation>>>>
implements java.io.Serializable
    Bigtable reference: .

    Requires a flat schema and a mapping which column family corresponds to which column.

    Row represents Bigtable Mutation in the following way:

    Mapped Beam Row:

    BEAM_ROW: ROW

    VALUE: Beam Schema type except for ARRAY, DECIMAL, ITERABLE, MAP, ROW

    Mapped Mutation:

    mutation: key, setCell[]

    setCell: familyName, columnQualifier, ROW[columnQualifier] - familyName comes from the column: family mapping

    See Also:
    Serialized Form

    • Field Summary

      • Fields inherited from class org.apache.beam.sdk.transforms.PTransform

        annotations, displayData, name, resourceHints

    • Constructor Summary

      Constructors 
      Constructor Description
      BeamRowToBigtableMutation​(java.util.Map<java.lang.String,​java.util.Set<java.lang.String>> familyColumnMapping)  

    • Method Summary

      All Methods Instance Methods Concrete Methods 
      Modifier and Type Method Description
      org.apache.beam.sdk.values.PCollection<org.apache.beam.sdk.values.KV<com.google.protobuf.ByteString,​java.lang.Iterable<com.google.bigtable.v2.Mutation>>> expand​(org.apache.beam.sdk.values.PCollection<org.apache.beam.sdk.values.Row> input)  

      • Methods inherited from class org.apache.beam.sdk.transforms.PTransform

        addAnnotation, compose, compose, getAdditionalInputs, getAnnotations, getDefaultOutputCoder, getDefaultOutputCoder, getDefaultOutputCoder, getKindString, getName, getResourceHints, populateDisplayData, setDisplayData, setResourceHints, toString, validate, validate

      • Methods inherited from class java.lang.Object

        clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

    • Constructor Detail

      • BeamRowToBigtableMutation

        public BeamRowToBigtableMutation​(java.util.Map<java.lang.String,​java.util.Set<java.lang.String>> familyColumnMapping)

    • Method Detail

      • expand

        public org.apache.beam.sdk.values.PCollection<org.apache.beam.sdk.values.KV<com.google.protobuf.ByteString,​java.lang.Iterable<com.google.bigtable.v2.Mutation>>> expand​(org.apache.beam.sdk.values.PCollection<org.apache.beam.sdk.values.Row> input)
        Specified by:
        expand in class org.apache.beam.sdk.transforms.PTransform<org.apache.beam.sdk.values.PCollection<org.apache.beam.sdk.values.Row>,​org.apache.beam.sdk.values.PCollection<org.apache.beam.sdk.values.KV<com.google.protobuf.ByteString,​java.lang.Iterable<com.google.bigtable.v2.Mutation>>>>