com.amazonaws.services.kinesis.clientlibrary.proxies

Class KinesisProxy

java.lang.Object

com.amazonaws.services.kinesis.clientlibrary.proxies.KinesisProxy

All Implemented Interfaces:

IKinesisProxy, IKinesisProxyExtended

public class KinesisProxy
extends Object
implements IKinesisProxyExtended

Kinesis proxy - used to make calls to Amazon Kinesis (e.g. fetch data records and list of shards).

Constructor Summary

Constructors

Constructor and Description
KinesisProxy(String streamName, com.amazonaws.auth.AWSCredentialsProvider credentialProvider, com.amazonaws.services.kinesis.AmazonKinesis kinesisClient, long describeStreamBackoffTimeInMillis, int maxDescribeStreamRetryAttempts) Public constructor.
KinesisProxy(String streamName, com.amazonaws.auth.AWSCredentialsProvider credentialProvider, String endpoint) Public constructor.
KinesisProxy(String streamName, com.amazonaws.auth.AWSCredentialsProvider credentialProvider, String endpoint, String serviceName, String regionId, long describeStreamBackoffTimeInMillis, int maxDescribeStreamRetryAttempts) Public constructor.

Method Summary

Modifier and Type	Method and Description
com.amazonaws.services.kinesis.model.GetRecordsResult	get(String shardIterator, int maxRecords) Get records from stream.
Set<String>	getAllShardIds() Fetch the shardIds of all shards in the stream.
String	getIterator(String shardId, Date timestamp) Fetch a shard iterator from the specified position in the shard.
String	getIterator(String shardId, String iteratorType) Fetch a shard iterator from the specified position in the shard.
String	getIterator(String shardId, String iteratorType, String sequenceNumber) Fetch a shard iterator from the specified position in the shard.
com.amazonaws.services.kinesis.model.Shard	getShard(String shardId) Get the Shard corresponding to shardId associated with this IKinesisProxy.
List<com.amazonaws.services.kinesis.model.Shard>	getShardList() Fetch all the shards defined for the stream (e.g.
com.amazonaws.services.kinesis.model.DescribeStreamResult	getStreamInfo(String startShardId) Fetch information about stream.
com.amazonaws.services.kinesis.model.PutRecordResult	put(String exclusiveMinimumSequenceNumber, String explicitHashKey, String partitionKey, ByteBuffer data)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

KinesisProxy

public KinesisProxy(String streamName,
                    com.amazonaws.auth.AWSCredentialsProvider credentialProvider,
                    String endpoint)

Public constructor.

Parameters:

streamName - Data records will be fetched from this stream

credentialProvider - Provides credentials for signing Kinesis requests

endpoint - Kinesis endpoint

KinesisProxy

public KinesisProxy(String streamName,
                    com.amazonaws.auth.AWSCredentialsProvider credentialProvider,
                    String endpoint,
                    String serviceName,
                    String regionId,
                    long describeStreamBackoffTimeInMillis,
                    int maxDescribeStreamRetryAttempts)

Public constructor.

Parameters:

streamName - Data records will be fetched from this stream

credentialProvider - Provides credentials for signing Kinesis requests

endpoint - Kinesis endpoint

serviceName - service name

regionId - region id

describeStreamBackoffTimeInMillis - Backoff time for DescribeStream calls in milliseconds

maxDescribeStreamRetryAttempts - Number of retry attempts for DescribeStream calls

KinesisProxy

public KinesisProxy(String streamName,
                    com.amazonaws.auth.AWSCredentialsProvider credentialProvider,
                    com.amazonaws.services.kinesis.AmazonKinesis kinesisClient,
                    long describeStreamBackoffTimeInMillis,
                    int maxDescribeStreamRetryAttempts)

Public constructor.

Parameters:

streamName - Data records will be fetched from this stream

credentialProvider - Provides credentials for signing Kinesis requests

kinesisClient - Kinesis client (used to fetch data from Kinesis)

describeStreamBackoffTimeInMillis - Backoff time for DescribeStream calls in milliseconds

maxDescribeStreamRetryAttempts - Number of retry attempts for DescribeStream calls

Method Detail

get

public com.amazonaws.services.kinesis.model.GetRecordsResult get(String shardIterator,
                                                                 int maxRecords)
                                                          throws com.amazonaws.services.kinesis.model.ResourceNotFoundException,
                                                                 com.amazonaws.services.kinesis.model.InvalidArgumentException,
                                                                 com.amazonaws.services.kinesis.model.ExpiredIteratorException

Get records from stream.

Specified by:

get in interface IKinesisProxy

Parameters:

shardIterator - Fetch data records using this shard iterator

maxRecords - Fetch at most this many records

Returns:

List of data records from Kinesis.

Throws:

com.amazonaws.services.kinesis.model.ResourceNotFoundException - The Kinesis stream or shard was not found

com.amazonaws.services.kinesis.model.InvalidArgumentException - Invalid input parameters

com.amazonaws.services.kinesis.model.ExpiredIteratorException - The iterator has expired

getStreamInfo

public com.amazonaws.services.kinesis.model.DescribeStreamResult getStreamInfo(String startShardId)
                                                                        throws com.amazonaws.services.kinesis.model.ResourceNotFoundException,
                                                                               com.amazonaws.services.kinesis.model.LimitExceededException

Fetch information about stream. Useful for fetching the list of shards in a stream.

Specified by:

getStreamInfo in interface IKinesisProxy

Parameters:

startShardId - exclusive start shardId - used when paginating the list of shards.

Returns:

DescribeStreamOutput object containing a description of the stream.

Throws:

com.amazonaws.services.kinesis.model.ResourceNotFoundException - The Kinesis stream was not found

com.amazonaws.services.kinesis.model.LimitExceededException

getShard

public com.amazonaws.services.kinesis.model.Shard getShard(String shardId)

Get the Shard corresponding to shardId associated with this IKinesisProxy.

Specified by:

getShard in interface IKinesisProxyExtended

Parameters:

shardId - Fetch the Shard with this given shardId

Returns:

the Shard with the given shardId

getShardList

public List<com.amazonaws.services.kinesis.model.Shard> getShardList()

Fetch all the shards defined for the stream (e.g. obtained via calls to the DescribeStream API). This can be used to discover new shards and consume data from them.

Specified by:

getShardList in interface IKinesisProxy

Returns:

List of all shards in the Kinesis stream.

getAllShardIds

public Set<String> getAllShardIds()
                           throws com.amazonaws.services.kinesis.model.ResourceNotFoundException

Fetch the shardIds of all shards in the stream.

Specified by:

getAllShardIds in interface IKinesisProxy

Returns:

Set of all shardIds

Throws:

com.amazonaws.services.kinesis.model.ResourceNotFoundException - If the specified Kinesis stream was not found

getIterator

public String getIterator(String shardId,
                          String iteratorType,
                          String sequenceNumber)

Fetch a shard iterator from the specified position in the shard. This is to fetch a shard iterator for ShardIteratorType AT_SEQUENCE_NUMBER or AFTER_SEQUENCE_NUMBER which requires the starting sequence number. NOTE: Currently this method continues to fetch iterators for ShardIteratorTypes TRIM_HORIZON, LATEST, AT_SEQUENCE_NUMBER and AFTER_SEQUENCE_NUMBER. But this behavior will change in the next release, after which this method will only serve AT_SEQUENCE_NUMBER or AFTER_SEQUENCE_NUMBER ShardIteratorTypes. We recommend users who call this method directly to use the appropriate getIterator method based on the ShardIteratorType.

Specified by:

getIterator in interface IKinesisProxy

Parameters:

shardId - Shard id

iteratorType - one of: TRIM_HORIZON, LATEST, AT_SEQUENCE_NUMBER, AFTER_SEQUENCE_NUMBER

sequenceNumber - the sequence number - must be null unless iteratorEnum is AT_SEQUENCE_NUMBER or AFTER_SEQUENCE_NUMBER

Returns:

shard iterator which can be used to read data from Kinesis.

getIterator

public String getIterator(String shardId,
                          String iteratorType)

Fetch a shard iterator from the specified position in the shard. This is to fetch a shard iterator for ShardIteratorType LATEST or TRIM_HORIZON which doesn't require a starting sequence number.

Specified by:

getIterator in interface IKinesisProxy

Parameters:

shardId - Shard id

iteratorType - Either TRIM_HORIZON or LATEST.

Returns:

shard iterator which can be used to read data from Kinesis.

getIterator

public String getIterator(String shardId,
                          Date timestamp)

Fetch a shard iterator from the specified position in the shard. This is to fetch a shard iterator for ShardIteratorType AT_TIMESTAMP which requires the timestamp field.

Specified by:

getIterator in interface IKinesisProxy

Parameters:

shardId - Shard id

timestamp - The timestamp.

Returns:

shard iterator which can be used to read data from Kinesis.

put

public com.amazonaws.services.kinesis.model.PutRecordResult put(String exclusiveMinimumSequenceNumber,
                                                                String explicitHashKey,
                                                                String partitionKey,
                                                                ByteBuffer data)
                                                         throws com.amazonaws.services.kinesis.model.ResourceNotFoundException,
                                                                com.amazonaws.services.kinesis.model.InvalidArgumentException

Specified by:

put in interface IKinesisProxy

Parameters:

exclusiveMinimumSequenceNumber - (optional) used for record ordering

explicitHashKey - optionally supplied transformation of partitionkey

partitionKey - for this record

data - payload

Returns:

PutRecordResult (contains the Kinesis sequence number of the record).

Throws:

com.amazonaws.services.kinesis.model.ResourceNotFoundException - The Kinesis stream was not found.

com.amazonaws.services.kinesis.model.InvalidArgumentException - InvalidArgumentException.