org.apache.jackrabbit.oak.blob.cloud.aws.s3

Class S3Backend

java.lang.Object

org.apache.jackrabbit.oak.blob.cloud.aws.s3.S3Backend

All Implemented Interfaces:

Backend, SharedS3Backend

public class S3Backend
extends Object
implements SharedS3Backend

A data store backend that stores data on Amazon S3.

Constructor Summary

Constructors

Constructor and Description
S3Backend()

Method Summary

Modifier and Type	Method and Description
void	addMetadataRecord(File input, String name) Adds a metadata record with the specified name
void	addMetadataRecord(InputStream input, String name) Adds a metadata record with the specified name
void	close()
void	deleteAllMetadataRecords(String prefix) Deletes all the metadata records with the specified prefix.
Set<DataIdentifier>	deleteAllOlderThan(long min)
boolean	deleteMetadataRecord(String name) Deletes the metadata record with the specified name
void	deleteRecord(DataIdentifier identifier)
boolean	exists(DataIdentifier identifier) Check if record identified by identifier exists in Amazon S3.
boolean	exists(DataIdentifier identifier, boolean touch)
Iterator<DataIdentifier>	getAllIdentifiers()
List<DataRecord>	getAllMetadataRecords(String prefix) Gets all the metadata with a specified prefix.
Iterator<DataRecord>	getAllRecords() Returns a list of all DataRecords
String	getBucket()
long	getLastModified(DataIdentifier identifier)
long	getLength(DataIdentifier identifier)
DataRecord	getMetadataRecord(String name) Gets the metadata of the specified name.
DataRecord	getRecord(DataIdentifier identifier) Gets the record with the specified identifier
void	init(CachingDataStore store, String homeDir, Properties prop)
void	init(CachingDataStore store, String homeDir, String config) Initialize S3Backend.
InputStream	read(DataIdentifier identifier)
void	setBucket(String bucket)
void	setProperties(Properties properties) Properties used to configure the backend.
void	touch(DataIdentifier identifier, long minModifiedDate)
void	touchAsync(DataIdentifier identifier, long minModifiedDate, AsyncTouchCallback callback)
void	write(DataIdentifier identifier, File file) It uploads file to Amazon S3.
void	writeAsync(DataIdentifier identifier, File file, AsyncUploadCallback callback)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

S3Backend

public S3Backend()

Method Detail

init

public void init(CachingDataStore store,
                 String homeDir,
                 String config)
          throws DataStoreException

Initialize S3Backend. It creates AmazonS3Client and TransferManager from aws.properties. It creates S3 bucket if it doesn't pre-exist in S3.

Specified by:

init in interface Backend

Throws:

DataStoreException

init

public void init(CachingDataStore store,
                 String homeDir,
                 Properties prop)
          throws DataStoreException

Throws:

DataStoreException

write

public void write(DataIdentifier identifier,
                  File file)
           throws DataStoreException

It uploads file to Amazon S3. If file size is greater than 5MB, this method uses parallel concurrent connections to upload.

Specified by:

write in interface Backend

Throws:

DataStoreException

writeAsync

public void writeAsync(DataIdentifier identifier,
                       File file,
                       AsyncUploadCallback callback)
                throws DataStoreException

Specified by:

writeAsync in interface Backend

Throws:

DataStoreException

exists

public boolean exists(DataIdentifier identifier)
               throws DataStoreException

Check if record identified by identifier exists in Amazon S3.

Specified by:

exists in interface Backend

Throws:

DataStoreException

exists

public boolean exists(DataIdentifier identifier,
                      boolean touch)
               throws DataStoreException

Specified by:

exists in interface Backend

Throws:

DataStoreException

touchAsync

public void touchAsync(DataIdentifier identifier,
                       long minModifiedDate,
                       AsyncTouchCallback callback)
                throws DataStoreException

Specified by:

touchAsync in interface Backend

Throws:

DataStoreException

touch

public void touch(DataIdentifier identifier,
                  long minModifiedDate)
           throws DataStoreException

Specified by:

touch in interface Backend

Throws:

DataStoreException

read

public InputStream read(DataIdentifier identifier)
                 throws DataStoreException

Specified by:

read in interface Backend

Throws:

DataStoreException

getAllIdentifiers

public Iterator<DataIdentifier> getAllIdentifiers()
                                           throws DataStoreException

Specified by:

getAllIdentifiers in interface Backend

Throws:

DataStoreException

getLastModified

public long getLastModified(DataIdentifier identifier)
                     throws DataStoreException

Specified by:

getLastModified in interface Backend

Throws:

DataStoreException

getLength

public long getLength(DataIdentifier identifier)
               throws DataStoreException

Specified by:

getLength in interface Backend

Throws:

DataStoreException

deleteRecord

public void deleteRecord(DataIdentifier identifier)
                  throws DataStoreException

Specified by:

deleteRecord in interface Backend

Throws:

DataStoreException

deleteAllOlderThan

public Set<DataIdentifier> deleteAllOlderThan(long min)
                                       throws DataStoreException

Specified by:

deleteAllOlderThan in interface Backend

Throws:

DataStoreException

close

public void close()

Specified by:

close in interface Backend

getBucket

public String getBucket()

setBucket

public void setBucket(String bucket)

setProperties

public void setProperties(Properties properties)

Properties used to configure the backend. If provided explicitly before init is invoked then these take precedence

Parameters:

properties - to configure S3Backend

addMetadataRecord

public void addMetadataRecord(InputStream input,
                              String name)
                       throws DataStoreException

Description copied from interface: SharedS3Backend

Adds a metadata record with the specified name

Specified by:

addMetadataRecord in interface SharedS3Backend

Parameters:

input - the record input stream

name - the name

Throws:

DataStoreException

addMetadataRecord

public void addMetadataRecord(File input,
                              String name)
                       throws DataStoreException

Description copied from interface: SharedS3Backend

Adds a metadata record with the specified name

Specified by:

addMetadataRecord in interface SharedS3Backend

Parameters:

input - the record file

name - the name

Throws:

DataStoreException

getMetadataRecord

public DataRecord getMetadataRecord(String name)

Description copied from interface: SharedS3Backend

Gets the metadata of the specified name.

Specified by:

getMetadataRecord in interface SharedS3Backend

Parameters:

name - the name of the record

Returns:

the metadata DataRecord

getAllMetadataRecords

public List<DataRecord> getAllMetadataRecords(String prefix)

Description copied from interface: SharedS3Backend

Gets all the metadata with a specified prefix.

Specified by:

getAllMetadataRecords in interface SharedS3Backend

Parameters:

prefix - the prefix of the records to retrieve

Returns:

list of all the metadata DataRecords

deleteMetadataRecord

public boolean deleteMetadataRecord(String name)

Description copied from interface: SharedS3Backend

Deletes the metadata record with the specified name

Specified by:

deleteMetadataRecord in interface SharedS3Backend

Parameters:

name - the name of the record

Returns:

boolean to indicate success of deletion

deleteAllMetadataRecords

public void deleteAllMetadataRecords(String prefix)

Description copied from interface: SharedS3Backend

Deletes all the metadata records with the specified prefix.

Specified by:

deleteAllMetadataRecords in interface SharedS3Backend

Parameters:

prefix - the prefix of the record

getAllRecords

public Iterator<DataRecord> getAllRecords()

Description copied from interface: SharedS3Backend

Returns a list of all DataRecords

Specified by:

getAllRecords in interface SharedS3Backend

Returns:

iterator over DataRecords

getRecord

public DataRecord getRecord(DataIdentifier identifier)
                     throws DataStoreException

Description copied from interface: SharedS3Backend

Gets the record with the specified identifier

Specified by:

getRecord in interface SharedS3Backend

Parameters:

identifier - the record identifier

Returns:

the metadata DataRecord

Throws:

DataStoreException