com.groupon.lex.metrics.history.xdr

Class TSDataFileChain

java.lang.Object

com.groupon.lex.metrics.history.xdr.support.SequenceTSData

com.groupon.lex.metrics.history.xdr.TSDataFileChain

All Implemented Interfaces:

CollectHistory, TSData, Iterable<TimeSeriesCollection>, Collection<TimeSeriesCollection>

public class TSDataFileChain
extends SequenceTSData

A writeable TSDataFile, that uses multiple underlying files.

Author:

ariane

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
class	TSDataFileChain.BatchAdd
static class	TSDataFileChain.Key Saved metadata of a single file, used to identify the file and (re)open it.

Nested classes/interfaces inherited from interface com.groupon.lex.metrics.history.CollectHistory

CollectHistory.ApplyExpressions, CollectHistory.NamedEvaluation

Field Summary

Fields

Modifier and Type	Field and Description
static int	MAX_FILERECORDS
static long	MAX_FILESIZE

Method Summary

Modifier and Type	Method and Description
boolean	add(TimeSeriesCollection e)
boolean	addAll(Collection<? extends TimeSeriesCollection> e)
TSDataFileChain.BatchAdd	batchAdd()
boolean	canAddSingleRecord() Returns true if the file is suitable for adding single records at a time.
void	delete(TSDataFileChain.Key key) Removes the file associated with the given key.
org.joda.time.DateTime	getBegin() Get the lowest timestamp covered by this TSData series.
org.joda.time.DateTime	getEnd() Get the highest timestamp covered by this TSData series.
Optional<GCCloseable<FileChannel>>	getFileChannel() Return the file channel used to read this file, if it is uses a file descriptor.
long	getFileSize() Retrieve the filesize used by the TSData.
Set<TSDataFileChain.Key>	getKeys() Retrieves keys (file metadata) for all files in this chain.
short	getMajor() Returns the major version of the TSData file.
short	getMinor() Returns the minor version of the TSData file.
Collection<SequenceTSData>	getRawCollections()
com.groupon.lex.metrics.lib.sequence.ObjectSequence<TimeSeriesCollection>	getSequence()
boolean	hasPendingTasks() Tests if there are any pending tasks to be completed.
boolean	isOptimized() Returns true if the file is optimized for access by (GroupPath, Tags, MetricName) tuple.
static TSDataFileChain	openDir(Path dir)
static TSDataFileChain	openDir(Path dir, long max_filesize)
static TSDataFileChain	openDir(TSDataScanDir scandir)
static TSDataFileChain	openDir(TSDataScanDir scandir, long max_filesize)
static Optional<TSDataFileChain>	openDirExisting(Path dir)
static Optional<TSDataFileChain>	openDirExisting(Path dir, long max_filesize)
static Optional<TSDataFileChain>	openDirExisting(TSDataScanDir scandir)
static Optional<TSDataFileChain>	openDirExisting(TSDataScanDir scandir, long max_filesize)
CompletableFuture<?>	optimizeOldFiles() Start optimization of old files.
void	waitPendingTasks()

Methods inherited from class com.groupon.lex.metrics.history.xdr.support.SequenceTSData

contains, containsAll, getAppendCompression, getOptimizedCompression, isEmpty, iterator, parallelStream, setAppendCompression, setOptimizedCompression, size, spliterator, stream, stream, stream, streamReversed, toArray, toArray

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface com.groupon.lex.metrics.history.TSData

asColumnMajorTSData, clear, readonly, remove, removeAll, removeIf, retainAll

Methods inherited from interface java.util.Collection

equals, hashCode

Methods inherited from interface java.lang.Iterable

forEach

Methods inherited from interface com.groupon.lex.metrics.history.CollectHistory

addAll, evaluate, evaluate, evaluate, getContext, getContext, getContext, stream, stream, stream, streamGroup

Field Detail

MAX_FILESIZE

public static long MAX_FILESIZE

MAX_FILERECORDS

public static int MAX_FILERECORDS

Method Detail

hasPendingTasks

public boolean hasPendingTasks()

Tests if there are any pending tasks to be completed.

waitPendingTasks

public void waitPendingTasks()

openDirExisting

public static Optional<TSDataFileChain> openDirExisting(@NonNull
                                                        TSDataScanDir scandir)
                                                 throws IOException

Throws:

IOException

openDirExisting

public static Optional<TSDataFileChain> openDirExisting(@NonNull
                                                        TSDataScanDir scandir,
                                                        long max_filesize)
                                                 throws IOException

Throws:

IOException

openDir

public static TSDataFileChain openDir(@NonNull
                                      TSDataScanDir scandir)
                               throws IOException

Throws:

IOException

openDir

public static TSDataFileChain openDir(@NonNull
                                      TSDataScanDir scandir,
                                      long max_filesize)
                               throws IOException

Throws:

IOException

openDirExisting

public static Optional<TSDataFileChain> openDirExisting(@NonNull
                                                        Path dir)
                                                 throws IOException

Throws:

IOException

openDirExisting

public static Optional<TSDataFileChain> openDirExisting(@NonNull
                                                        Path dir,
                                                        long max_filesize)
                                                 throws IOException

Throws:

IOException

openDir

public static TSDataFileChain openDir(@NonNull
                                      Path dir)
                               throws IOException

Throws:

IOException

openDir

public static TSDataFileChain openDir(@NonNull
                                      Path dir,
                                      long max_filesize)
                               throws IOException

Throws:

IOException

getSequence

public com.groupon.lex.metrics.lib.sequence.ObjectSequence<TimeSeriesCollection> getSequence()

Specified by:

getSequence in class SequenceTSData

canAddSingleRecord

public boolean canAddSingleRecord()

Description copied from interface: TSData

Returns true if the file is suitable for adding single records at a time.

isOptimized

public boolean isOptimized()

Description copied from interface: TSData

Returns true if the file is optimized for access by (GroupPath, Tags, MetricName) tuple.

getFileSize

public long getFileSize()

Description copied from interface: TSData

Retrieve the filesize used by the TSData.

getBegin

public org.joda.time.DateTime getBegin()

Description copied from interface: TSData

Get the lowest timestamp covered by this TSData series.

getEnd

public org.joda.time.DateTime getEnd()

Description copied from interface: TSData

Get the highest timestamp covered by this TSData series.

getMajor

public short getMajor()

Description copied from interface: TSData

Returns the major version of the TSData file. Note that this is the file-data version, not the application version.

getMinor

public short getMinor()

Description copied from interface: TSData

Returns the minor version of the TSData file. Note that this is the file-data version, not the application version.

optimizeOldFiles

public CompletableFuture<?> optimizeOldFiles()

Start optimization of old files.

Returns:

a completable future of the background selection process. This future can be used to wait for the background selecting thread to complete, or to cancel the operation.

add

public boolean add(@NonNull
                   TimeSeriesCollection e)

addAll

public boolean addAll(@NonNull
                      Collection<? extends TimeSeriesCollection> e)

getKeys

public Set<TSDataFileChain.Key> getKeys()

Retrieves keys (file metadata) for all files in this chain.

delete

public void delete(@NonNull
                   TSDataFileChain.Key key)

Removes the file associated with the given key.

getRawCollections

public Collection<SequenceTSData> getRawCollections()

getFileChannel

public Optional<GCCloseable<FileChannel>> getFileChannel()

Description copied from interface: TSData

Return the file channel used to read this file, if it is uses a file descriptor. Returns Optional.empty() for memory mapped files.

batchAdd

public TSDataFileChain.BatchAdd batchAdd()