com.indeed.lsmtree.recordcache

Class RecordLogAppender<K,V>

java.lang.Object

com.indeed.lsmtree.recordlog.GenericRecordLogAppender<Operation>

com.indeed.lsmtree.recordcache.RecordLogAppender<K,V>

All Implemented Interfaces:

IRecordLogAppender<K,V>

public final class RecordLogAppender<K,V>
extends GenericRecordLogAppender<Operation>
implements IRecordLogAppender<K,V>

Author:

jplaisance

Field Summary

Fields inherited from class com.indeed.lsmtree.recordlog.GenericRecordLogAppender

LAST_POSITION_KEY, MAX_SEGMENT_KEY

Constructor Summary

Constructors

Constructor and Description
RecordLogAppender(File file, com.indeed.util.serialization.Serializer<K> keySerializer, com.indeed.util.serialization.Serializer<V> valueSerializer, Comparator<K> keyComparator, com.indeed.util.compress.CompressionCodec codec)
RecordLogAppender(File file, com.indeed.util.serialization.Serializer<K> keySerializer, com.indeed.util.serialization.Serializer<V> valueSerializer, Comparator<K> keyComparator, com.indeed.util.compress.CompressionCodec codec, AtomicReference<Map<String,String>> metadataRef)
RecordLogAppender(File file, com.indeed.util.serialization.Serializer<K> keySerializer, com.indeed.util.serialization.Serializer<V> valueSerializer, com.indeed.util.serialization.Serializer<Collection<K>> keyCollectionSerializer, Comparator<K> keyComparator, com.indeed.util.compress.CompressionCodec codec)
RecordLogAppender(File file, com.indeed.util.serialization.Serializer<K> keySerializer, com.indeed.util.serialization.Serializer<V> valueSerializer, com.indeed.util.serialization.Serializer<Collection<K>> keyCollectionSerializer, Comparator<K> keyComparator, com.indeed.util.compress.CompressionCodec codec, AtomicReference<Map<String,String>> metadataRef)

Method Summary

Modifier and Type	Method and Description
void	deleteDocs(Collection<K> ids) Marks keys as deleted.
void	putCheckpoint(long timestamp)
long	write(K key, V value) Writes a new key/value entry.

Methods inherited from class com.indeed.lsmtree.recordlog.GenericRecordLogAppender

flushWriter, getLastPosition, getMaxSegment, getMaxSegmentTimestamp, getMaxSegmentTimestring, getSegmentPath, readLongFromFile, writeOperation, writeStringToFile

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface com.indeed.lsmtree.recordcache.IRecordLogAppender

flushWriter, getLastPosition, getMaxSegment, getSegmentPath

Constructor Detail

RecordLogAppender

public RecordLogAppender(File file,
                         com.indeed.util.serialization.Serializer<K> keySerializer,
                         com.indeed.util.serialization.Serializer<V> valueSerializer,
                         Comparator<K> keyComparator,
                         com.indeed.util.compress.CompressionCodec codec)
                  throws IOException

Parameters:

file - record log directory

keySerializer - key serializer

valueSerializer - value serializer

keyComparator - key comparator

codec - compression codec

Throws:

IOException - if an I/O error occurs

RecordLogAppender

public RecordLogAppender(File file,
                         com.indeed.util.serialization.Serializer<K> keySerializer,
                         com.indeed.util.serialization.Serializer<V> valueSerializer,
                         Comparator<K> keyComparator,
                         com.indeed.util.compress.CompressionCodec codec,
                         AtomicReference<Map<String,String>> metadataRef)
                  throws IOException

Parameters:

file - record log directory

keySerializer - key serializer

valueSerializer - value serializer

keyComparator - key comparator

codec - compression codec

metadataRef - atomic reference to a metadata object, if nonnull after construction it will contain a reference to previous flushed metadata if it exists

Throws:

IOException - if an I/O error occurs

RecordLogAppender

public RecordLogAppender(File file,
                         com.indeed.util.serialization.Serializer<K> keySerializer,
                         com.indeed.util.serialization.Serializer<V> valueSerializer,
                         com.indeed.util.serialization.Serializer<Collection<K>> keyCollectionSerializer,
                         Comparator<K> keyComparator,
                         com.indeed.util.compress.CompressionCodec codec)
                  throws IOException

Parameters:

file - record log directory

keySerializer - key serializer

valueSerializer - value serializer

keyCollectionSerializer - key collection serializer

keyComparator - key comparator

codec - compression codec

Throws:

IOException - if an I/O error occurs

RecordLogAppender

public RecordLogAppender(File file,
                         com.indeed.util.serialization.Serializer<K> keySerializer,
                         com.indeed.util.serialization.Serializer<V> valueSerializer,
                         com.indeed.util.serialization.Serializer<Collection<K>> keyCollectionSerializer,
                         Comparator<K> keyComparator,
                         com.indeed.util.compress.CompressionCodec codec,
                         AtomicReference<Map<String,String>> metadataRef)
                  throws IOException

Parameters:

file - record log directory

keySerializer - key serializer

valueSerializer - value serializer

keyCollectionSerializer - key collection serializer

keyComparator - key comparator

codec - compression codec

metadataRef - atomic reference to a metadata object, if nonnull after construction it will contain a reference to previous flushed metadata if it exists

Throws:

IOException - if an I/O error occurs

Method Detail

deleteDocs

public void deleteDocs(Collection<K> ids)
                throws IOException

Marks keys as deleted.

Specified by:

deleteDocs in interface IRecordLogAppender<K,V>

Parameters:

ids - keys to delete

Throws:

IOException - if an I/O error occurs

write

public long write(K key,
                  V value)
           throws IOException

Writes a new key/value entry. Can be used to overwrite previous existing values.

Specified by:

write in interface IRecordLogAppender<K,V>

Parameters:

key - key to write

value - value to write

Returns:

position written

Throws:

IOException - if an I/O error occurs

putCheckpoint

public void putCheckpoint(long timestamp)
                   throws IOException

Specified by:

putCheckpoint in interface IRecordLogAppender<K,V>

Throws:

IOException