org.apache.flink.streaming.api.operators.sort

类 MultiInputSortingDataInput<IN,K>

java.lang.Object

org.apache.flink.streaming.api.operators.sort.MultiInputSortingDataInput<IN,K>

所有已实现的接口:

Closeable, AutoCloseable, org.apache.flink.runtime.io.AvailabilityProvider, PushingAsyncDataInput<IN>, StreamTaskInput<IN>

public final class MultiInputSortingDataInput<IN,K>
extends Object
implements StreamTaskInput<IN>

An input that wraps an underlying input and sorts the incoming records. It starts emitting records downstream only when all the other inputs coupled with this MultiInputSortingDataInput have finished sorting as well.

Moreover it will report it is available or approximately available if it has some records pending only if the head of the CommonContext#getQueueOfHeads() belongs to the input. That way there is only ever one input that reports it is available.

The sorter uses binary comparison of keys, which are extracted and serialized when received from the chained input. Moreover the timestamps of incoming records are used for secondary ordering. For the comparison it uses either FixedLengthByteKeyComparator if the length of the serialized key is constant, or VariableLengthByteKeyComparator otherwise.

Watermarks, watermark statuses, nor latency markers are propagated downstream as they do not make sense with buffered records. The input emits the largest watermark seen after all records.

嵌套类概要

嵌套类

限定符和类型	类和说明
static class	MultiInputSortingDataInput.SelectableSortingInputs A wrapper that combines sorting inputs with a InputSelectable that should be used to choose which input to consume next from.

从接口继承的嵌套类/接口 org.apache.flink.streaming.runtime.io.PushingAsyncDataInput

PushingAsyncDataInput.DataOutput<T>

从接口继承的嵌套类/接口 org.apache.flink.runtime.io.AvailabilityProvider

org.apache.flink.runtime.io.AvailabilityProvider.AvailabilityHelper

字段概要

从接口继承的字段 org.apache.flink.streaming.runtime.io.StreamTaskInput

UNSPECIFIED

从接口继承的字段 org.apache.flink.runtime.io.AvailabilityProvider

AVAILABLE

方法概要

限定符和类型	方法和说明
void	close()
DataInputStatus	emitNext(PushingAsyncDataInput.DataOutput<IN> output) Pushes the next element to the output from current data input, and returns the input status to indicate whether there are more available data in current input.
CompletableFuture<?>	getAvailableFuture()
int	getInputIndex() Returns the input index of this input.
CompletableFuture<Void>	prepareSnapshot(org.apache.flink.runtime.checkpoint.channel.ChannelStateWriter channelStateWriter, long checkpointId) Prepares to spill the in-flight input buffers as checkpoint snapshot.
static <K> MultiInputSortingDataInput.SelectableSortingInputs	wrapInputs(org.apache.flink.runtime.jobgraph.tasks.TaskInvokable containingTask, StreamTaskInput<Object>[] sortingInputs, org.apache.flink.api.java.functions.KeySelector<Object,K>[] keySelectors, org.apache.flink.api.common.typeutils.TypeSerializer<Object>[] inputSerializers, org.apache.flink.api.common.typeutils.TypeSerializer<K> keySerializer, StreamTaskInput<Object>[] passThroughInputs, org.apache.flink.runtime.memory.MemoryManager memoryManager, org.apache.flink.runtime.io.disk.iomanager.IOManager ioManager, boolean objectReuse, double managedMemoryFraction, org.apache.flink.configuration.Configuration jobConfiguration, org.apache.flink.api.common.ExecutionConfig executionConfig)

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

从接口继承的方法 org.apache.flink.runtime.io.AvailabilityProvider

and, isApproximatelyAvailable, isAvailable, or

方法详细资料

wrapInputs

public static <K> MultiInputSortingDataInput.SelectableSortingInputs wrapInputs(org.apache.flink.runtime.jobgraph.tasks.TaskInvokable containingTask,
                                                                                StreamTaskInput<Object>[] sortingInputs,
                                                                                org.apache.flink.api.java.functions.KeySelector<Object,K>[] keySelectors,
                                                                                org.apache.flink.api.common.typeutils.TypeSerializer<Object>[] inputSerializers,
                                                                                org.apache.flink.api.common.typeutils.TypeSerializer<K> keySerializer,
                                                                                StreamTaskInput<Object>[] passThroughInputs,
                                                                                org.apache.flink.runtime.memory.MemoryManager memoryManager,
                                                                                org.apache.flink.runtime.io.disk.iomanager.IOManager ioManager,
                                                                                boolean objectReuse,
                                                                                double managedMemoryFraction,
                                                                                org.apache.flink.configuration.Configuration jobConfiguration,
                                                                                org.apache.flink.api.common.ExecutionConfig executionConfig)

getInputIndex

public int getInputIndex()

从接口复制的说明: StreamTaskInput

Returns the input index of this input.

指定者:

getInputIndex 在接口中 StreamTaskInput<IN>

prepareSnapshot

public CompletableFuture<Void> prepareSnapshot(org.apache.flink.runtime.checkpoint.channel.ChannelStateWriter channelStateWriter,
                                               long checkpointId)

从接口复制的说明: StreamTaskInput

Prepares to spill the in-flight input buffers as checkpoint snapshot.

指定者:

prepareSnapshot 在接口中 StreamTaskInput<IN>

close

public void close()
           throws IOException

指定者:

close 在接口中 Closeable

指定者:

close 在接口中 AutoCloseable

抛出:

IOException

emitNext

public DataInputStatus emitNext(PushingAsyncDataInput.DataOutput<IN> output)
                         throws Exception

从接口复制的说明: PushingAsyncDataInput

Pushes the next element to the output from current data input, and returns the input status to indicate whether there are more available data in current input.

This method should be non blocking.

指定者:

emitNext 在接口中 PushingAsyncDataInput<IN>

抛出:

Exception

getAvailableFuture

public CompletableFuture<?> getAvailableFuture()

指定者:

getAvailableFuture 在接口中 org.apache.flink.runtime.io.AvailabilityProvider