| Package | Description |
|---|---|
| org.apache.flink.runtime.io.disk | |
| org.apache.flink.runtime.io.disk.iomanager | |
| org.apache.flink.runtime.operators.hash | |
| org.apache.flink.runtime.operators.sort |
| Modifier and Type | Method and Description |
|---|---|
FileIOChannel.ID |
FileChannelManager.createChannel()
Creates an ID identifying an underlying file channel and returns it.
|
FileIOChannel.ID |
FileChannelManagerImpl.createChannel() |
| Constructor and Description |
|---|
ChannelReaderInputViewIterator(IOManager ioAccess,
FileIOChannel.ID channel,
LinkedBlockingQueue<org.apache.flink.core.memory.MemorySegment> returnQueue,
List<org.apache.flink.core.memory.MemorySegment> segments,
List<org.apache.flink.core.memory.MemorySegment> freeMemTarget,
org.apache.flink.api.common.typeutils.TypeSerializer<E> accessors,
int numBlocks) |
ChannelReaderInputViewIterator(IOManager ioAccess,
FileIOChannel.ID channel,
List<org.apache.flink.core.memory.MemorySegment> segments,
List<org.apache.flink.core.memory.MemorySegment> freeMemTarget,
org.apache.flink.api.common.typeutils.TypeSerializer<E> accessors,
int numBlocks) |
SeekableFileChannelInputView(IOManager ioManager,
FileIOChannel.ID channelId,
MemoryManager memManager,
List<org.apache.flink.core.memory.MemorySegment> memory,
int sizeOfLastBlock) |
| Modifier and Type | Field and Description |
|---|---|
protected FileIOChannel.ID |
AbstractFileIOChannel.id
The ID of the underlying channel.
|
| Modifier and Type | Method and Description |
|---|---|
FileIOChannel.ID |
IOManager.createChannel()
Creates a new
FileIOChannel.ID in one of the temp directories. |
FileIOChannel.ID |
FileIOChannel.getChannelID()
Gets the channel ID of this I/O channel.
|
FileIOChannel.ID |
AbstractFileIOChannel.getChannelID() |
FileIOChannel.ID |
FileIOChannel.Enumerator.next() |
| Modifier and Type | Method and Description |
|---|---|
BlockChannelReader<org.apache.flink.core.memory.MemorySegment> |
IOManager.createBlockChannelReader(FileIOChannel.ID channelID)
Creates a block channel reader that reads blocks from the given channel.
|
BlockChannelReader<org.apache.flink.core.memory.MemorySegment> |
IOManagerAsync.createBlockChannelReader(FileIOChannel.ID channelID,
LinkedBlockingQueue<org.apache.flink.core.memory.MemorySegment> returnQueue)
Creates a block channel reader that reads blocks from the given channel.
|
abstract BlockChannelReader<org.apache.flink.core.memory.MemorySegment> |
IOManager.createBlockChannelReader(FileIOChannel.ID channelID,
LinkedBlockingQueue<org.apache.flink.core.memory.MemorySegment> returnQueue)
Creates a block channel reader that reads blocks from the given channel.
|
BlockChannelWriter<org.apache.flink.core.memory.MemorySegment> |
IOManager.createBlockChannelWriter(FileIOChannel.ID channelID)
Creates a block channel writer that writes to the given channel.
|
BlockChannelWriter<org.apache.flink.core.memory.MemorySegment> |
IOManagerAsync.createBlockChannelWriter(FileIOChannel.ID channelID,
LinkedBlockingQueue<org.apache.flink.core.memory.MemorySegment> returnQueue) |
abstract BlockChannelWriter<org.apache.flink.core.memory.MemorySegment> |
IOManager.createBlockChannelWriter(FileIOChannel.ID channelID,
LinkedBlockingQueue<org.apache.flink.core.memory.MemorySegment> returnQueue)
Creates a block channel writer that writes to the given channel.
|
BlockChannelWriterWithCallback<org.apache.flink.core.memory.MemorySegment> |
IOManagerAsync.createBlockChannelWriter(FileIOChannel.ID channelID,
RequestDoneCallback<org.apache.flink.core.memory.MemorySegment> callback) |
abstract BlockChannelWriterWithCallback<org.apache.flink.core.memory.MemorySegment> |
IOManager.createBlockChannelWriter(FileIOChannel.ID channelID,
RequestDoneCallback<org.apache.flink.core.memory.MemorySegment> callback)
Creates a block channel writer that writes to the given channel.
|
BufferFileReader |
IOManagerAsync.createBufferFileReader(FileIOChannel.ID channelID,
RequestDoneCallback<Buffer> callback) |
abstract BufferFileReader |
IOManager.createBufferFileReader(FileIOChannel.ID channelID,
RequestDoneCallback<Buffer> callback) |
BufferFileSegmentReader |
IOManagerAsync.createBufferFileSegmentReader(FileIOChannel.ID channelID,
RequestDoneCallback<FileSegment> callback) |
abstract BufferFileSegmentReader |
IOManager.createBufferFileSegmentReader(FileIOChannel.ID channelID,
RequestDoneCallback<FileSegment> callback) |
BufferFileWriter |
IOManagerAsync.createBufferFileWriter(FileIOChannel.ID channelID) |
abstract BufferFileWriter |
IOManager.createBufferFileWriter(FileIOChannel.ID channelID) |
BulkBlockChannelReader |
IOManagerAsync.createBulkBlockChannelReader(FileIOChannel.ID channelID,
List<org.apache.flink.core.memory.MemorySegment> targetSegments,
int numBlocks)
Creates a block channel reader that reads all blocks from the given channel directly in one bulk.
|
abstract BulkBlockChannelReader |
IOManager.createBulkBlockChannelReader(FileIOChannel.ID channelID,
List<org.apache.flink.core.memory.MemorySegment> targetSegments,
int numBlocks)
Creates a block channel reader that reads all blocks from the given channel directly in one bulk.
|
static void |
IOManager.deleteChannel(FileIOChannel.ID channel)
Deletes the file underlying the given channel.
|
| Constructor and Description |
|---|
AbstractFileIOChannel(FileIOChannel.ID channelID,
boolean writeEnabled)
Creates a new channel to the path indicated by the given ID.
|
AsynchronousBlockReader(FileIOChannel.ID channelID,
RequestQueue<org.apache.flink.runtime.io.disk.iomanager.ReadRequest> requestQueue,
LinkedBlockingQueue<org.apache.flink.core.memory.MemorySegment> returnSegments)
Creates a new block channel reader for the given channel.
|
AsynchronousBlockWriter(FileIOChannel.ID channelID,
RequestQueue<org.apache.flink.runtime.io.disk.iomanager.WriteRequest> requestQueue,
LinkedBlockingQueue<org.apache.flink.core.memory.MemorySegment> returnSegments)
Creates a new block channel writer for the given channel.
|
AsynchronousBlockWriterWithCallback(FileIOChannel.ID channelID,
RequestQueue<org.apache.flink.runtime.io.disk.iomanager.WriteRequest> requestQueue,
RequestDoneCallback<org.apache.flink.core.memory.MemorySegment> callback)
Creates a new asynchronous block writer for the given channel.
|
AsynchronousBufferFileReader(FileIOChannel.ID channelID,
RequestQueue<org.apache.flink.runtime.io.disk.iomanager.ReadRequest> requestQueue,
RequestDoneCallback<Buffer> callback) |
AsynchronousBufferFileSegmentReader(FileIOChannel.ID channelID,
RequestQueue<org.apache.flink.runtime.io.disk.iomanager.ReadRequest> requestQueue,
RequestDoneCallback<FileSegment> callback) |
AsynchronousBufferFileWriter(FileIOChannel.ID channelID,
RequestQueue<org.apache.flink.runtime.io.disk.iomanager.WriteRequest> requestQueue) |
AsynchronousBulkBlockReader(FileIOChannel.ID channelID,
RequestQueue<org.apache.flink.runtime.io.disk.iomanager.ReadRequest> requestQueue,
List<org.apache.flink.core.memory.MemorySegment> sourceSegments,
int numBlocks) |
AsynchronousFileIOChannel(FileIOChannel.ID channelID,
RequestQueue<R> requestQueue,
RequestDoneCallback<T> callback,
boolean writeEnabled)
Creates a new channel access to the path indicated by the given ID.
|
SynchronousBufferFileReader(FileIOChannel.ID channelID,
boolean writeEnabled) |
SynchronousFileIOChannel(FileIOChannel.ID channelID,
boolean writeEnabled) |
| Modifier and Type | Method and Description |
|---|---|
int |
HashPartition.spillPartition(List<org.apache.flink.core.memory.MemorySegment> target,
IOManager ioAccess,
FileIOChannel.ID targetChannel,
LinkedBlockingQueue<org.apache.flink.core.memory.MemorySegment> bufferReturnQueue)
Spills this partition to disk and sets it up such that it continues spilling records that are added to
it.
|
| Modifier and Type | Method and Description |
|---|---|
FileIOChannel.ID |
UnilateralSortMerger.ChannelWithBlockCount.getChannel() |
| Modifier and Type | Method and Description |
|---|---|
protected void |
UnilateralSortMerger.SpillingThread.registerChannelToBeRemovedAtShudown(FileIOChannel.ID channel)
Adds a channel to the list of channels that are to be removed at shutdown.
|
protected void |
UnilateralSortMerger.SpillingThread.unregisterChannelToBeRemovedAtShudown(FileIOChannel.ID channel)
Removes a channel from the list of channels that are to be removed at shutdown.
|
| Constructor and Description |
|---|
ChannelWithBlockCount(FileIOChannel.ID channel,
int blockCount) |
Copyright © 2014–2020 The Apache Software Foundation. All rights reserved.