org.apache.flink.streaming.runtime.tasks

Class RegularOperatorChain<OUT,OP extends StreamOperator<OUT>>

java.lang.Object

org.apache.flink.streaming.runtime.tasks.OperatorChain<OUT,OP>

org.apache.flink.streaming.runtime.tasks.RegularOperatorChain<OUT,OP>

All Implemented Interfaces:

Closeable, AutoCloseable, BoundedMultiInput

@Internal
public class RegularOperatorChain<OUT,OP extends StreamOperator<OUT>>
extends OperatorChain<OUT,OP>

A regular non finished on restore OperatorChain.

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.flink.streaming.runtime.tasks.OperatorChain

OperatorChain.ChainedSource

Field Summary

Fields inherited from class org.apache.flink.streaming.runtime.tasks.OperatorChain

chainedSources, closer, finishedOnRestoreInput, firstOperatorWrapper, isClosed, mainOperatorOutput, mainOperatorWrapper, numOperators, operatorEventDispatcher, streamOutputs, tailOperatorWrapper

Constructor Summary

Constructors

Constructor and Description
RegularOperatorChain(StreamTask<OUT,OP> containingTask, org.apache.flink.runtime.io.network.api.writer.RecordWriterDelegate<org.apache.flink.runtime.plugable.SerializationDelegate<StreamRecord<OUT>>> recordWriterDelegate)

Method Summary

Modifier and Type	Method and Description
void	close() This method releases all resources of the record writer output.
void	closeAllOperators() Execute StreamOperator.close() of each operator in the chain of this StreamTask.
void	dispatchOperatorEvent(org.apache.flink.runtime.jobgraph.OperatorID operator, org.apache.flink.util.SerializedValue<org.apache.flink.runtime.operators.coordination.OperatorEvent> event)
void	endInput(int inputId) Ends the main operator input specified by inputId).
void	finishOperators(StreamTaskActionExecutor actionExecutor, org.apache.flink.runtime.io.network.api.StopMode stopMode) Closes all operators in a chain effect way.
void	initializeStateAndOpenOperators(StreamTaskStateInitializer streamTaskStateInitializer) Initialize state and open all operators in the chain from tail to heads, contrary to StreamOperator.close() which happens heads to tail (see OperatorChain.finishOperators(StreamTaskActionExecutor, StopMode)).
boolean	isTaskDeployedAsFinished()
void	notifyCheckpointAborted(long checkpointId)
void	notifyCheckpointComplete(long checkpointId)
void	notifyCheckpointSubsumed(long checkpointId)
void	prepareSnapshotPreBarrier(long checkpointId)
void	snapshotState(Map<org.apache.flink.runtime.jobgraph.OperatorID,OperatorSnapshotFutures> operatorSnapshotsInProgress, org.apache.flink.runtime.checkpoint.CheckpointMetaData checkpointMetaData, org.apache.flink.runtime.checkpoint.CheckpointOptions checkpointOptions, java.util.function.Supplier<Boolean> isRunning, org.apache.flink.runtime.checkpoint.channel.ChannelStateWriter.ChannelStateWriteResult channelStateWriteResult, org.apache.flink.runtime.state.CheckpointStreamFactory storage)

Methods inherited from class org.apache.flink.streaming.runtime.tasks.OperatorChain

abortCheckpoint, alignedBarrierTimeout, broadcastEvent, broadcastEvent, flushOutputs, getAllOperators, getAllOperators, getChainedSource, getChainedSourceOutputs, getFinishedOnRestoreInputOrDefault, getMainOperator, getMainOperatorOutput, getNumberOfOperators, getOperatorEventDispatcher, getSourceTaskInput, getSourceTaskInputs, getStreamOutputs, getTailOperator, isClosed, sendAcknowledgeCheckpointEvent, snapshotChannelStates

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

RegularOperatorChain

public RegularOperatorChain(StreamTask<OUT,OP> containingTask,
                            org.apache.flink.runtime.io.network.api.writer.RecordWriterDelegate<org.apache.flink.runtime.plugable.SerializationDelegate<StreamRecord<OUT>>> recordWriterDelegate)

Method Detail

isTaskDeployedAsFinished

public boolean isTaskDeployedAsFinished()

Specified by:

isTaskDeployedAsFinished in class OperatorChain<OUT,OP extends StreamOperator<OUT>>

dispatchOperatorEvent

public void dispatchOperatorEvent(org.apache.flink.runtime.jobgraph.OperatorID operator,
                                  org.apache.flink.util.SerializedValue<org.apache.flink.runtime.operators.coordination.OperatorEvent> event)
                           throws org.apache.flink.util.FlinkException

Specified by:

dispatchOperatorEvent in class OperatorChain<OUT,OP extends StreamOperator<OUT>>

Throws:

org.apache.flink.util.FlinkException

prepareSnapshotPreBarrier

public void prepareSnapshotPreBarrier(long checkpointId)
                               throws Exception

Specified by:

prepareSnapshotPreBarrier in class OperatorChain<OUT,OP extends StreamOperator<OUT>>

Throws:

Exception

endInput

public void endInput(int inputId)
              throws Exception

Description copied from class: OperatorChain

Ends the main operator input specified by inputId).

Specified by:

endInput in interface BoundedMultiInput

Specified by:

endInput in class OperatorChain<OUT,OP extends StreamOperator<OUT>>

Parameters:

inputId - the input ID starts from 1 which indicates the first input.

Throws:

Exception

initializeStateAndOpenOperators

public void initializeStateAndOpenOperators(StreamTaskStateInitializer streamTaskStateInitializer)
                                     throws Exception

Description copied from class: OperatorChain

Initialize state and open all operators in the chain from tail to heads, contrary to StreamOperator.close() which happens heads to tail (see OperatorChain.finishOperators(StreamTaskActionExecutor, StopMode)).

Specified by:

initializeStateAndOpenOperators in class OperatorChain<OUT,OP extends StreamOperator<OUT>>

Throws:

Exception

finishOperators

public void finishOperators(StreamTaskActionExecutor actionExecutor,
                            org.apache.flink.runtime.io.network.api.StopMode stopMode)
                     throws Exception

Description copied from class: OperatorChain

Closes all operators in a chain effect way. Closing happens from heads to tail operator in the chain, contrary to StreamOperator.open() which happens tail to heads (see OperatorChain.initializeStateAndOpenOperators(StreamTaskStateInitializer)).

Specified by:

finishOperators in class OperatorChain<OUT,OP extends StreamOperator<OUT>>

Throws:

Exception

closeAllOperators

public void closeAllOperators()
                       throws Exception

Description copied from class: OperatorChain

Execute StreamOperator.close() of each operator in the chain of this StreamTask. Closing happens from tail to head operator in the chain.

Overrides:

closeAllOperators in class OperatorChain<OUT,OP extends StreamOperator<OUT>>

Throws:

Exception

close

public void close()
           throws IOException

Description copied from class: OperatorChain

This method releases all resources of the record writer output. It stops the output flushing thread (if there is one) and releases all buffers currently held by the output serializers.

This method should never fail.

Specified by:

close in interface Closeable

Specified by:

close in interface AutoCloseable

Overrides:

close in class OperatorChain<OUT,OP extends StreamOperator<OUT>>

Throws:

IOException

notifyCheckpointComplete

public void notifyCheckpointComplete(long checkpointId)
                              throws Exception

Specified by:

notifyCheckpointComplete in class OperatorChain<OUT,OP extends StreamOperator<OUT>>

Throws:

Exception

notifyCheckpointAborted

public void notifyCheckpointAborted(long checkpointId)
                             throws Exception

Specified by:

notifyCheckpointAborted in class OperatorChain<OUT,OP extends StreamOperator<OUT>>

Throws:

Exception

notifyCheckpointSubsumed

public void notifyCheckpointSubsumed(long checkpointId)
                              throws Exception

Specified by:

notifyCheckpointSubsumed in class OperatorChain<OUT,OP extends StreamOperator<OUT>>

Throws:

Exception

snapshotState

public void snapshotState(Map<org.apache.flink.runtime.jobgraph.OperatorID,OperatorSnapshotFutures> operatorSnapshotsInProgress,
                          org.apache.flink.runtime.checkpoint.CheckpointMetaData checkpointMetaData,
                          org.apache.flink.runtime.checkpoint.CheckpointOptions checkpointOptions,
                          java.util.function.Supplier<Boolean> isRunning,
                          org.apache.flink.runtime.checkpoint.channel.ChannelStateWriter.ChannelStateWriteResult channelStateWriteResult,
                          org.apache.flink.runtime.state.CheckpointStreamFactory storage)
                   throws Exception

Specified by:

snapshotState in class OperatorChain<OUT,OP extends StreamOperator<OUT>>

Throws:

Exception