org.apache.flink.runtime.io.disk.iomanager

类 AsynchronousFileIOChannel<T,R extends org.apache.flink.runtime.io.disk.iomanager.IORequest>

java.lang.Object

org.apache.flink.runtime.io.disk.iomanager.AbstractFileIOChannel

org.apache.flink.runtime.io.disk.iomanager.AsynchronousFileIOChannel<T,R>

类型参数:

R - The type of request (e.g. ReadRequest or WriteRequest issued by this access to the I/O threads.

所有已实现的接口:

FileIOChannel

直接已知子类:

AsynchronousBlockReader, AsynchronousBlockWriterWithCallback, AsynchronousBufferFileReader, AsynchronousBufferFileSegmentReader, AsynchronousBufferFileWriter, AsynchronousBulkBlockReader

public abstract class AsynchronousFileIOChannel<T,R extends org.apache.flink.runtime.io.disk.iomanager.IORequest>
extends AbstractFileIOChannel

A base class for readers and writers that accept read or write requests for whole blocks. The request is delegated to an asynchronous I/O thread. After completion of the I/O request, the memory segment of the block is added to a collection to be returned.

The asynchrony of the access makes it possible to implement read-ahead or write-behind types of I/O accesses.

嵌套类概要

从接口继承的嵌套类/接口 org.apache.flink.runtime.io.disk.iomanager.FileIOChannel

FileIOChannel.Enumerator, FileIOChannel.ID

字段概要

字段

限定符和类型	字段和说明
protected boolean	closed Flag marking this channel as closed
protected Object	closeLock The lock that is used during closing to synchronize the thread that waits for all requests to be handled with the asynchronous I/O thread.
protected IOException	exception An exception that was encountered by the asynchronous request handling thread.
protected RequestQueue<R>	requestQueue A request queue for submitting asynchronous requests to the corresponding IO worker thread.
protected AtomicInteger	requestsNotReturned An atomic integer that counts the number of requests that we still wait for to return.
protected RequestDoneCallback<T>	resultHandler Handler for completed requests

从类继承的字段 org.apache.flink.runtime.io.disk.iomanager.AbstractFileIOChannel

fileChannel, id, LOG

构造器概要

构造器

限定符	构造器和说明
protected	AsynchronousFileIOChannel(FileIOChannel.ID channelID, RequestQueue<R> requestQueue, RequestDoneCallback<T> callback, boolean writeEnabled) Creates a new channel access to the path indicated by the given ID.

方法概要

限定符和类型	方法和说明
protected void	addRequest(R request)
void	checkErroneous() Checks the exception state of this channel.
void	close() Closes the channel and waits until all pending asynchronous requests are processed.
void	closeAndDelete() This method waits for all pending asynchronous requests to return.
protected void	handleProcessedBuffer(T buffer, IOException ex) Handles a processed Buffer.
boolean	isClosed() Checks whether the channel has been closed.
protected boolean	registerAllRequestsProcessedListener(NotificationListener listener) Registers a listener to be notified when all outstanding requests have been processed.

从类继承的方法 org.apache.flink.runtime.io.disk.iomanager.AbstractFileIOChannel

deleteChannel, getChannelID, getNioFileChannel, getSize

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

字段详细资料

closeLock

protected final Object closeLock

The lock that is used during closing to synchronize the thread that waits for all requests to be handled with the asynchronous I/O thread.

requestQueue

protected final RequestQueue<R extends org.apache.flink.runtime.io.disk.iomanager.IORequest> requestQueue

A request queue for submitting asynchronous requests to the corresponding IO worker thread.

requestsNotReturned

protected final AtomicInteger requestsNotReturned

An atomic integer that counts the number of requests that we still wait for to return.

resultHandler

protected final RequestDoneCallback<T> resultHandler

Handler for completed requests

exception

protected volatile IOException exception

An exception that was encountered by the asynchronous request handling thread.

closed

protected volatile boolean closed

Flag marking this channel as closed

构造器详细资料

AsynchronousFileIOChannel

protected AsynchronousFileIOChannel(FileIOChannel.ID channelID,
                                    RequestQueue<R> requestQueue,
                                    RequestDoneCallback<T> callback,
                                    boolean writeEnabled)
                             throws IOException

Creates a new channel access to the path indicated by the given ID. The channel accepts buffers to be read/written and hands them to the asynchronous I/O thread. After being processed, the buffers are returned by adding the to the given queue.

参数:

channelID - The id describing the path of the file that the channel accessed.

requestQueue - The queue that this channel hands its IO requests to.

callback - The callback to be invoked when a request is done.

writeEnabled - Flag describing whether the channel should be opened in read/write mode, rather than in read-only mode.

抛出:

IOException - Thrown, if the channel could no be opened.

方法详细资料

isClosed

public boolean isClosed()

从接口复制的说明: FileIOChannel

Checks whether the channel has been closed.

指定者:

isClosed 在接口中 FileIOChannel

指定者:

isClosed 在类中 AbstractFileIOChannel

返回:

True if the channel has been closed, false otherwise.

close

public void close()
           throws IOException

Closes the channel and waits until all pending asynchronous requests are processed. The underlying FileChannel is closed even if an exception interrupts the closing.

Important: the isClosed() method returns true immediately after this method has been called even when there are outstanding requests.

指定者:

close 在接口中 FileIOChannel

指定者:

close 在类中 AbstractFileIOChannel

抛出:

IOException - Thrown, if an I/O exception occurred while waiting for the buffers, or if the closing was interrupted.

closeAndDelete

public void closeAndDelete()
                    throws IOException

This method waits for all pending asynchronous requests to return. When the last request has returned, the channel is closed and deleted.

Even if an exception interrupts the closing, such that not all request are handled, the underlying FileChannel is closed and deleted.

指定者:

closeAndDelete 在接口中 FileIOChannel

覆盖:

closeAndDelete 在类中 AbstractFileIOChannel

抛出:

IOException - Thrown, if an I/O exception occurred while waiting for the buffers, or if the closing was interrupted.

checkErroneous

public final void checkErroneous()
                          throws IOException

Checks the exception state of this channel. The channel is erroneous, if one of its requests could not be processed correctly.

抛出:

IOException - Thrown, if the channel is erroneous. The thrown exception contains the original exception that defined the erroneous state as its cause.

handleProcessedBuffer

protected final void handleProcessedBuffer(T buffer,
                                           IOException ex)

Handles a processed Buffer. This method is invoked by the asynchronous IO worker threads upon completion of the IO request with the provided buffer and/or an exception that occurred while processing the request for that buffer.

参数:

buffer - The buffer to be processed.

ex - The exception that occurred in the I/O threads when processing the buffer's request.

addRequest

protected final void addRequest(R request)
                         throws IOException

抛出:

IOException

registerAllRequestsProcessedListener

protected boolean registerAllRequestsProcessedListener(NotificationListener listener)
                                                throws IOException

Registers a listener to be notified when all outstanding requests have been processed.

New requests can arrive right after the listener got notified. Therefore, it is not safe to assume that the number of outstanding requests is still zero after a notification unless there was a close right before the listener got called.

Returns true, if the registration was successful. A registration can fail, if there are no outstanding requests when trying to register a listener.

抛出:

IOException