Package org.apache.beam.sdk.io.gcp.datastore

Class DatastoreV1.DeleteEntity

java.lang.Object

org.apache.beam.sdk.transforms.PTransform<org.apache.beam.sdk.values.PCollection<com.google.datastore.v1.Entity>,org.apache.beam.sdk.values.PDone>

org.apache.beam.sdk.io.gcp.datastore.DatastoreV1.DeleteEntity

All Implemented Interfaces:

java.io.Serializable, org.apache.beam.sdk.transforms.display.HasDisplayData

Enclosing class:

DatastoreV1

public static class DatastoreV1.DeleteEntity
extends org.apache.beam.sdk.transforms.PTransform<org.apache.beam.sdk.values.PCollection<com.google.datastore.v1.Entity>,org.apache.beam.sdk.values.PDone>

A PTransform that deletes Entities from Cloud Datastore.

See Also:

DatastoreIO, Serialized Form

Field Summary

Fields inherited from class org.apache.beam.sdk.transforms.PTransform

annotations, displayData, name, resourceHints

Method Summary

Modifier and Type	Method	Description
org.apache.beam.sdk.values.PDone	expand(org.apache.beam.sdk.values.PCollection<com.google.datastore.v1.Entity> input)
java.lang.String	getDatabaseId()
java.lang.String	getProjectId()
void	populateDisplayData(org.apache.beam.sdk.transforms.display.DisplayData.Builder builder)
java.lang.String	toString()
DatastoreV1.DeleteEntity	withDatabaseId(java.lang.String databaseId)	Returns a new DatastoreV1.DeleteEntity that deletes entities from the Cloud Datastore for the specified database.
DatastoreV1.DeleteEntity	withDatabaseId(org.apache.beam.sdk.options.ValueProvider<java.lang.String> databaseId)	Same as withDatabaseId(String) but with a ValueProvider.
DatastoreV1.DeleteEntity	withHintNumWorkers(int hintNumWorkers)	Returns a new DatastoreV1.DeleteEntity with a different worker count hint for ramp-up throttling.
DatastoreV1.DeleteEntity	withHintNumWorkers(org.apache.beam.sdk.options.ValueProvider<java.lang.Integer> hintNumWorkers)	Same as withHintNumWorkers(int) but with a ValueProvider.
DatastoreV1.DeleteEntity	withLocalhost(java.lang.String localhost)	Returns a new DatastoreV1.DeleteEntity that deletes entities from the Cloud Datastore Emulator running locally on the specified host port.
DatastoreV1.DeleteEntity	withProjectId(java.lang.String projectId)	Returns a new DatastoreV1.DeleteEntity that deletes entities from the Cloud Datastore for the specified project.
DatastoreV1.DeleteEntity	withProjectId(org.apache.beam.sdk.options.ValueProvider<java.lang.String> projectId)	Same as withProjectId(String) but with a ValueProvider.
DatastoreV1.DeleteEntity	withRampupThrottlingDisabled()	Returns a new DatastoreV1.DeleteEntity that does not throttle during ramp-up.
DatastoreV1.DeleteEntityWithSummary	withResults()	Returns DatastoreV1.DeleteEntityWithSummary transform which can be used in Wait.on(PCollection[]) to wait until all data is deleted.

Methods inherited from class org.apache.beam.sdk.transforms.PTransform

addAnnotation, compose, compose, getAdditionalInputs, getAnnotations, getDefaultOutputCoder, getDefaultOutputCoder, getDefaultOutputCoder, getKindString, getName, getResourceHints, setDisplayData, setResourceHints, validate, validate

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Method Detail

withProjectId

public DatastoreV1.DeleteEntity withProjectId(java.lang.String projectId)

Returns a new DatastoreV1.DeleteEntity that deletes entities from the Cloud Datastore for the specified project.

withDatabaseId

public DatastoreV1.DeleteEntity withDatabaseId(java.lang.String databaseId)

Returns a new DatastoreV1.DeleteEntity that deletes entities from the Cloud Datastore for the specified database.

withProjectId

public DatastoreV1.DeleteEntity withProjectId(org.apache.beam.sdk.options.ValueProvider<java.lang.String> projectId)

Same as withProjectId(String) but with a ValueProvider.

withDatabaseId

public DatastoreV1.DeleteEntity withDatabaseId(org.apache.beam.sdk.options.ValueProvider<java.lang.String> databaseId)

Same as withDatabaseId(String) but with a ValueProvider.

withLocalhost

public DatastoreV1.DeleteEntity withLocalhost(java.lang.String localhost)

Returns a new DatastoreV1.DeleteEntity that deletes entities from the Cloud Datastore Emulator running locally on the specified host port.

withRampupThrottlingDisabled

public DatastoreV1.DeleteEntity withRampupThrottlingDisabled()

Returns a new DatastoreV1.DeleteEntity that does not throttle during ramp-up.

withHintNumWorkers

public DatastoreV1.DeleteEntity withHintNumWorkers(int hintNumWorkers)

Returns a new DatastoreV1.DeleteEntity with a different worker count hint for ramp-up throttling. Value is ignored if ramp-up throttling is disabled.

withHintNumWorkers

public DatastoreV1.DeleteEntity withHintNumWorkers(org.apache.beam.sdk.options.ValueProvider<java.lang.Integer> hintNumWorkers)

Same as withHintNumWorkers(int) but with a ValueProvider.

withResults

public DatastoreV1.DeleteEntityWithSummary withResults()

Returns DatastoreV1.DeleteEntityWithSummary transform which can be used in Wait.on(PCollection[]) to wait until all data is deleted.

Example: delete a PCollection from one database and then from another database, making sure that deleting a window of data to the second database starts only after the respective window has been fully deleted from the first database.

 PCollection<Entity> entities = ... ;
 PCollection<DatastoreV1.WriteSuccessSummary> deleteSummary =
         entities.apply(DatastoreIO.v1().deleteEntity().withProjectId(project).withResults());
 

toString

public java.lang.String toString()

Overrides:

toString in class org.apache.beam.sdk.transforms.PTransform<org.apache.beam.sdk.values.PCollection<com.google.datastore.v1.Entity>,org.apache.beam.sdk.values.PDone>

populateDisplayData

public void populateDisplayData(org.apache.beam.sdk.transforms.display.DisplayData.Builder builder)

Specified by:

populateDisplayData in interface org.apache.beam.sdk.transforms.display.HasDisplayData

Overrides:

populateDisplayData in class org.apache.beam.sdk.transforms.PTransform<org.apache.beam.sdk.values.PCollection<com.google.datastore.v1.Entity>,org.apache.beam.sdk.values.PDone>

getProjectId

public java.lang.String getProjectId()

getDatabaseId

public java.lang.String getDatabaseId()

expand

public org.apache.beam.sdk.values.PDone expand(org.apache.beam.sdk.values.PCollection<com.google.datastore.v1.Entity> input)

Specified by:

expand in class org.apache.beam.sdk.transforms.PTransform<org.apache.beam.sdk.values.PCollection<com.google.datastore.v1.Entity>,org.apache.beam.sdk.values.PDone>