com.indeed.lsmtree.recordcache

Class StandalonePersistentRecordCache<K,V>

java.lang.Object

com.indeed.lsmtree.recordcache.StandalonePersistentRecordCache<K,V>

Type Parameters:

K - the type of keys maintained by this cache

V - the type of cached values

All Implemented Interfaces:

RecordCache<K,V>, Closeable, AutoCloseable

public final class StandalonePersistentRecordCache<K,V>
extends Object
implements RecordCache<K,V>

This class creates an LSM-tree based cache from recordLog files. We call it "standalone" because it does not need to access the recordLog files after initially loading them. This cache stores the V value in the underlying cache directly. This contrasts with PersistentRecordCache, which creates an underlying cache of key to (segment number of the recordLog file where the value is located) and then looks up the value in the relevant recordLog file using the segment number. NOTE: Since the dataset will occasionally double in size during compaction, this class is only recommended for use on recordLog datasets of under ~100GB.

Author:

jplaisance, dcahill

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	StandalonePersistentRecordCache.Builder<K,V>

Method Summary

Modifier and Type	Method and Description
void	close()
V	get(K key, CacheStats cacheStats)
Map<K,V>	getAll(Collection<K> keys, CacheStats cacheStats)
RecordLogDirectoryPoller.Functions	getFunctions()
long	getIndexActiveSpaceUsage()
long	getIndexFreeSpace()
long	getIndexReservedSpaceUsage()
long	getIndexTotalSpaceUsage()
Iterator<com.indeed.util.core.Either<Exception,fj.P2<K,V>>>	getStreaming(Iterator<K> keys, AtomicInteger progress, AtomicInteger skipped)
void	waitForCompactions()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Detail

getIndexActiveSpaceUsage

public long getIndexActiveSpaceUsage()
                              throws IOException

Throws:

IOException

getIndexTotalSpaceUsage

public long getIndexTotalSpaceUsage()
                             throws IOException

Throws:

IOException

getIndexReservedSpaceUsage

public long getIndexReservedSpaceUsage()

getIndexFreeSpace

public long getIndexFreeSpace()
                       throws IOException

Throws:

IOException

get

public V get(K key,
             CacheStats cacheStats)

Specified by:

get in interface RecordCache<K,V>

getAll

public Map<K,V> getAll(Collection<K> keys,
                       CacheStats cacheStats)

Specified by:

getAll in interface RecordCache<K,V>

getStreaming

public Iterator<com.indeed.util.core.Either<Exception,fj.P2<K,V>>> getStreaming(Iterator<K> keys,
                                                                                AtomicInteger progress,
                                                                                AtomicInteger skipped)

getFunctions

public RecordLogDirectoryPoller.Functions getFunctions()

Specified by:

getFunctions in interface RecordCache<K,V>

close

public void close()
           throws IOException

Specified by:

close in interface Closeable

Specified by:

close in interface AutoCloseable

Throws:

IOException

waitForCompactions

public void waitForCompactions()
                        throws InterruptedException

Throws:

InterruptedException