Packages

class DynamoDbManifest[F[_]] extends ProcessingManifest[F]

AWS DynamoDB implementation of processing manifests

Linear Supertypes
ProcessingManifest[F], AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. DynamoDbManifest
  2. ProcessingManifest
  3. AnyRef
  4. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new DynamoDbManifest(client: AmazonDynamoDB, primaryTable: String, resolver: Resolver[F])(implicit F: ManifestAction[F], C: Clock[F], L: RegistryLookup[F])

Value Members

  1. final def !=(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  4. final def asInstanceOf[T0]: T0
    Definition Classes
    Any
  5. val client: AmazonDynamoDB
  6. def clone(): AnyRef
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @native() @HotSpotIntrinsicCandidate() @throws( ... )
  7. def createRecord(itemId: ItemId, app: Application, recordId: UUID, previousRecordId: Option[UUID], state: State, time: Instant, author: Author, payload: Option[Payload]): DbRecord

    Turn raw Record elements into DynamoDB DbItem.

    Turn raw Record elements into DynamoDB DbItem. Can be overloaded by subclasses

    Attributes
    protected[com.snowplowanalytics.manifest.dynamodb]
  8. def deleteRecord(record: Record): F[Unit]

    Delete record from manifest (DynamoDB-specific API)

  9. final def eq(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  10. def equals(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  11. def fetch(processedBy: Option[Application], state: Option[State])(implicit F: ManifestAction[F], S: Sync[F]): Stream[F, ItemId]
    Definition Classes
    DynamoDbManifest → ProcessingManifest
  12. final def getClass(): Class[_]
    Definition Classes
    AnyRef → Any
    Annotations
    @native() @HotSpotIntrinsicCandidate()
  13. def getItem(id: String): F[Option[Item]]

    Get state of single item, with validating state of Item

    Get state of single item, with validating state of Item

    Definition Classes
    DynamoDbManifest → ProcessingManifest
  14. def getItemRecords(itemId: ItemId): F[List[Record]]

    Low-level item accessor

  15. def getUnprocessed(itemIds: Stream[F, ItemId], predicate: (Item) ⇒ Boolean)(implicit S: Sync[F]): F[List[Item]]

    Get items from collection of ids that: + were processed by preprocessor application + were NOT yet processed by specified application + match predicate function + not in "blocked" or "failed" state

    Get items from collection of ids that: + were processed by preprocessor application + were NOT yet processed by specified application + match predicate function + not in "blocked" or "failed" state

    predicate

    filter function to get only valid Items, e.g. containing particular payload

    Definition Classes
    ProcessingManifest
  16. def hashCode(): Int
    Definition Classes
    AnyRef → Any
    Annotations
    @native() @HotSpotIntrinsicCandidate()
  17. final def isInstanceOf[T0]: Boolean
    Definition Classes
    Any
  18. final def ne(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  19. final def notify(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native() @HotSpotIntrinsicCandidate()
  20. final def notifyAll(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native() @HotSpotIntrinsicCandidate()
  21. val primaryTable: String
  22. def processAll(app: Application, predicate: (Item) ⇒ Boolean, acquirePayload: Option[Payload], process: Process)(implicit S: Sync[F]): F[Unit]

    Apply Process function to all items unprocessed by app For each item, lock will be held.

    Apply Process function to all items unprocessed by app For each item, lock will be held. If any of items already holding a lock, function breaks immediately

    Definition Classes
    ProcessingManifest
  23. def processItem(app: Application, acquirePayload: Option[Payload], process: Process)(item: Item): F[(UUID, Instant)]

    Acquire lock, apply processing function and write its result back to manifest

    Acquire lock, apply processing function and write its result back to manifest

    Definition Classes
    ProcessingManifest
  24. def processNewItem(id: ItemId, app: Application, acquirePayload: Option[Payload], process: ProcessNew): F[Unit]

    Similar to processItem, but works without existing Item, instead it creates new one itself or queries it by known id Should be used when app is both adding item to manifest and processes it straight afterwards

    Similar to processItem, but works without existing Item, instead it creates new one itself or queries it by known id Should be used when app is both adding item to manifest and processes it straight afterwards

    id

    new item id, which should be either fetched or created

    app

    application doing discovering and processing

    acquirePayload

    optional payload that will be added as part of Processing, can be e.g. notification that app started to process it with some special configuration (cross-batch dedupe enabled)

    process

    Process that does not expect existing item

    Definition Classes
    ProcessingManifest
  25. def put(itemId: ItemId, app: Application, previousRecordId: Option[UUID], state: State, author: Option[Agent], payload: Option[Payload]): F[(UUID, Instant)]

    Add an atomic record to manifest

    Add an atomic record to manifest

    Definition Classes
    DynamoDbManifest → ProcessingManifest
  26. def putRecord(r: Record)(implicit F: Sync[F]): F[(UUID, Instant)]

    Add exact same record to manifest (low-level DynamoDB-specific API)

  27. def query(application: Application): F[Set[ItemId]]
  28. def query(preparedBy: Option[Application], requester: Option[Application])(implicit S: Sync[F]): Stream[F, ItemId]

    Get ids of items that were processed by processedBy and NOT processed by application Most common kind of query for Processing Manifest.

    Get ids of items that were processed by processedBy and NOT processed by application Most common kind of query for Processing Manifest.

    Definition Classes
    ProcessingManifest
  29. val resolver: Resolver[F]
    Definition Classes
    ProcessingManifest
  30. def stream(implicit S: Sync[F]): Stream[F, Record]

    Get full manifest

    Get full manifest

    Definition Classes
    DynamoDbManifest → ProcessingManifest
  31. final def synchronized[T0](arg0: ⇒ T0): T0
    Definition Classes
    AnyRef
  32. def toString(): String
    Definition Classes
    AnyRef → Any
  33. final def wait(arg0: Long, arg1: Int): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  34. final def wait(arg0: Long): Unit
    Definition Classes
    AnyRef
    Annotations
    @native() @throws( ... )
  35. final def wait(): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Deprecated Value Members

  1. def finalize(): Unit
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @Deprecated @deprecated @throws( classOf[java.lang.Throwable] )
    Deprecated

    (Since version ) see corresponding Javadoc for more information.

Inherited from ProcessingManifest[F]

Inherited from AnyRef

Inherited from Any

Ungrouped