com.amazonaws.services.kinesis.clientlibrary.proxies

Class KinesisProxy

java.lang.Object

com.amazonaws.services.kinesis.clientlibrary.proxies.KinesisProxy

All Implemented Interfaces:

IKinesisProxy, IKinesisProxyExtended

public class KinesisProxy
extends Object
implements IKinesisProxyExtended

Kinesis proxy - used to make calls to Amazon Kinesis (e.g. fetch data records and list of shards).

Constructor Summary

Constructors

Constructor and Description
KinesisProxy(String streamName, AWSCredentialsProvider credentialProvider, AmazonKinesis kinesisClient, long describeStreamBackoffTimeInMillis, int maxDescribeStreamRetryAttempts) Public constructor.
KinesisProxy(String streamName, AWSCredentialsProvider credentialProvider, String endpoint) Public constructor.
KinesisProxy(String streamName, AWSCredentialsProvider credentialProvider, String endpoint, String serviceName, String regionId, long describeStreamBackoffTimeInMillis, int maxDescribeStreamRetryAttempts) Public constructor.

Method Summary

Modifier and Type	Method and Description
GetRecordsResult	get(String shardIterator, int maxRecords) Get records from stream.
Set<String>	getAllShardIds() Fetch the shardIds of all shards in the stream.
String	getIterator(String shardId, String iteratorType, String sequenceNumber) Fetch a shard iterator from the specified position in the shard.
Shard	getShard(String shardId) Get the Shard corresponding to shardId associated with this IKinesisProxy.
List<Shard>	getShardList() Fetch all the shards defined for the stream (e.g.
DescribeStreamResult	getStreamInfo(String startShardId) Fetch information about stream.
PutRecordResult	put(String exclusiveMinimumSequenceNumber, String explicitHashKey, String partitionKey, ByteBuffer data)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

KinesisProxy

public KinesisProxy(String streamName,
                    AWSCredentialsProvider credentialProvider,
                    String endpoint)

Public constructor.

Parameters:

streamName - Data records will be fetched from this stream

credentialProvider - Provides credentials for signing Kinesis requests

endpoint - Kinesis endpoint

KinesisProxy

public KinesisProxy(String streamName,
                    AWSCredentialsProvider credentialProvider,
                    String endpoint,
                    String serviceName,
                    String regionId,
                    long describeStreamBackoffTimeInMillis,
                    int maxDescribeStreamRetryAttempts)

Public constructor.

Parameters:

streamName - Data records will be fetched from this stream

credentialProvider - Provides credentials for signing Kinesis requests

endpoint - Kinesis endpoint

serviceName - service name

regionId - region id

describeStreamBackoffTimeInMillis - Backoff time for DescribeStream calls in milliseconds

maxDescribeStreamRetryAttempts - Number of retry attempts for DescribeStream calls

KinesisProxy

public KinesisProxy(String streamName,
                    AWSCredentialsProvider credentialProvider,
                    AmazonKinesis kinesisClient,
                    long describeStreamBackoffTimeInMillis,
                    int maxDescribeStreamRetryAttempts)

Public constructor.

Parameters:

streamName - Data records will be fetched from this stream

credentialProvider - Provides credentials for signing Kinesis requests

kinesisClient - Kinesis client (used to fetch data from Kinesis)

describeStreamBackoffTimeInMillis - Backoff time for DescribeStream calls in milliseconds

maxDescribeStreamRetryAttempts - Number of retry attempts for DescribeStream calls

Method Detail

get

public GetRecordsResult get(String shardIterator,
                            int maxRecords)
                     throws ResourceNotFoundException,
                            InvalidArgumentException,
                            ExpiredIteratorException

Get records from stream.

Specified by:

get in interface IKinesisProxy

Parameters:

shardIterator - Fetch data records using this shard iterator

maxRecords - Fetch at most this many records

Returns:

List of data records from Kinesis.

Throws:

ResourceNotFoundException - The Kinesis stream or shard was not found

InvalidArgumentException - Invalid input parameters

ExpiredIteratorException - The iterator has expired

getStreamInfo

public DescribeStreamResult getStreamInfo(String startShardId)
                                   throws ResourceNotFoundException,
                                          LimitExceededException

Fetch information about stream. Useful for fetching the list of shards in a stream.

Specified by:

getStreamInfo in interface IKinesisProxy

Parameters:

startShardId - exclusive start shardId - used when paginating the list of shards.

Returns:

DescribeStreamOutput object containing a description of the stream.

Throws:

ResourceNotFoundException - The Kinesis stream was not found

LimitExceededException

getShard

public Shard getShard(String shardId)

Get the Shard corresponding to shardId associated with this IKinesisProxy.

Specified by:

getShard in interface IKinesisProxyExtended

Parameters:

shardId - Fetch the Shard with this given shardId

Returns:

the Shard with the given shardId

getShardList

public List<Shard> getShardList()

Fetch all the shards defined for the stream (e.g. obtained via calls to the DescribeStream API). This can be used to discover new shards and consume data from them.

Specified by:

getShardList in interface IKinesisProxy

Returns:

List of all shards in the Kinesis stream.

getAllShardIds

public Set<String> getAllShardIds()
                           throws ResourceNotFoundException

Fetch the shardIds of all shards in the stream.

Specified by:

getAllShardIds in interface IKinesisProxy

Returns:

Set of all shardIds

Throws:

ResourceNotFoundException - If the specified Kinesis stream was not found

getIterator

public String getIterator(String shardId,
                          String iteratorType,
                          String sequenceNumber)

Fetch a shard iterator from the specified position in the shard.

Specified by:

getIterator in interface IKinesisProxy

Parameters:

shardId - Shard id

iteratorType - one of: TRIM_HORIZON, LATEST, AT_SEQUENCE_NUMBER, AFTER_SEQUENCE_NUMBER

sequenceNumber - the sequence number - must be null unless iteratorEnum is AT_SEQUENCE_NUMBER or AFTER_SEQUENCE_NUMBER

Returns:

shard iterator which can be used to read data from Kinesis.

put

public PutRecordResult put(String exclusiveMinimumSequenceNumber,
                           String explicitHashKey,
                           String partitionKey,
                           ByteBuffer data)
                    throws ResourceNotFoundException,
                           InvalidArgumentException

Specified by:

put in interface IKinesisProxy

Parameters:

exclusiveMinimumSequenceNumber - (optional) used for record ordering

explicitHashKey - optionally supplied transformation of partitionkey

partitionKey - for this record

data - payload

Returns:

PutRecordResult (contains the Kinesis sequence number of the record).

Throws:

ResourceNotFoundException - The Kinesis stream was not found.

InvalidArgumentException - InvalidArgumentException.