org.apache.flink.runtime.operators

类 AbstractOuterJoinDriver<IT1,IT2,OT>

java.lang.Object

org.apache.flink.runtime.operators.AbstractOuterJoinDriver<IT1,IT2,OT>

所有已实现的接口:

Driver<org.apache.flink.api.common.functions.FlatJoinFunction<IT1,IT2,OT>,OT>

直接已知子类:

FullOuterJoinDriver, LeftOuterJoinDriver, RightOuterJoinDriver

public abstract class AbstractOuterJoinDriver<IT1,IT2,OT>
extends Object
implements Driver<org.apache.flink.api.common.functions.FlatJoinFunction<IT1,IT2,OT>,OT>

The abstract outer join driver implements the logic of an outer join operator at runtime. It instantiates a sort-merge based strategy to find joining pairs of records or joining records with null depending on the outer join type.

另请参阅:

FlatJoinFunction

字段概要

字段

限定符和类型	字段和说明
protected static org.slf4j.Logger	LOG
protected JoinTaskIterator<IT1,IT2,OT>	outerJoinIterator
protected boolean	running
protected TaskContext<org.apache.flink.api.common.functions.FlatJoinFunction<IT1,IT2,OT>,OT>	taskContext

构造器概要

构造器

构造器和说明
AbstractOuterJoinDriver()

方法概要

限定符和类型	方法和说明
void	cancel() This method is invoked when the driver must aborted in mid processing.
void	cleanup() This method is invoked in any case (clean termination and exception) at the end of the tasks operation.
protected abstract JoinTaskIterator<IT1,IT2,OT>	getNonReusingOuterJoinIterator(DriverStrategy driverStrategy, org.apache.flink.util.MutableObjectIterator<IT1> in1, org.apache.flink.util.MutableObjectIterator<IT2> in2, org.apache.flink.api.common.typeutils.TypeSerializer<IT1> serializer1, org.apache.flink.api.common.typeutils.TypeComparator<IT1> comparator1, org.apache.flink.api.common.typeutils.TypeSerializer<IT2> serializer2, org.apache.flink.api.common.typeutils.TypeComparator<IT2> comparator2, org.apache.flink.api.common.typeutils.TypePairComparatorFactory<IT1,IT2> pairComparatorFactory, MemoryManager memoryManager, IOManager ioManager, double driverMemFraction)
int	getNumberOfDriverComparators() Gets the number of comparators required for this driver.
int	getNumberOfInputs() Gets the number of inputs that the task has.
protected abstract JoinTaskIterator<IT1,IT2,OT>	getReusingOuterJoinIterator(DriverStrategy driverStrategy, org.apache.flink.util.MutableObjectIterator<IT1> in1, org.apache.flink.util.MutableObjectIterator<IT2> in2, org.apache.flink.api.common.typeutils.TypeSerializer<IT1> serializer1, org.apache.flink.api.common.typeutils.TypeComparator<IT1> comparator1, org.apache.flink.api.common.typeutils.TypeSerializer<IT2> serializer2, org.apache.flink.api.common.typeutils.TypeComparator<IT2> comparator2, org.apache.flink.api.common.typeutils.TypePairComparatorFactory<IT1,IT2> pairComparatorFactory, MemoryManager memoryManager, IOManager ioManager, double driverMemFraction)
Class<org.apache.flink.api.common.functions.FlatJoinFunction<IT1,IT2,OT>>	getStubType() Gets the class of the stub type that is run by this task.
void	prepare() This method is called before the user code is opened.
void	run() The main operation method of the task.
void	setup(TaskContext<org.apache.flink.api.common.functions.FlatJoinFunction<IT1,IT2,OT>,OT> context)

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

字段详细资料

LOG

protected static final org.slf4j.Logger LOG

taskContext

protected TaskContext<org.apache.flink.api.common.functions.FlatJoinFunction<IT1,IT2,OT>,OT> taskContext

outerJoinIterator

protected volatile JoinTaskIterator<IT1,IT2,OT> outerJoinIterator

running

protected volatile boolean running

构造器详细资料

AbstractOuterJoinDriver

public AbstractOuterJoinDriver()

方法详细资料

setup

public void setup(TaskContext<org.apache.flink.api.common.functions.FlatJoinFunction<IT1,IT2,OT>,OT> context)

指定者:

setup 在接口中 Driver<org.apache.flink.api.common.functions.FlatJoinFunction<IT1,IT2,OT>,OT>

getNumberOfInputs

public int getNumberOfInputs()

从接口复制的说明: Driver

Gets the number of inputs that the task has.

指定者:

getNumberOfInputs 在接口中 Driver<org.apache.flink.api.common.functions.FlatJoinFunction<IT1,IT2,OT>,OT>

返回:

The number of inputs.

getStubType

public Class<org.apache.flink.api.common.functions.FlatJoinFunction<IT1,IT2,OT>> getStubType()

从接口复制的说明: Driver

Gets the class of the stub type that is run by this task. For example, a MapTask should return MapFunction.class.

指定者:

getStubType 在接口中 Driver<org.apache.flink.api.common.functions.FlatJoinFunction<IT1,IT2,OT>,OT>

返回:

The class of the stub type run by the task.

getNumberOfDriverComparators

public int getNumberOfDriverComparators()

从接口复制的说明: Driver

Gets the number of comparators required for this driver.

指定者:

getNumberOfDriverComparators 在接口中 Driver<org.apache.flink.api.common.functions.FlatJoinFunction<IT1,IT2,OT>,OT>

返回:

The number of comparators required for this driver.

prepare

public void prepare()
             throws Exception

从接口复制的说明: Driver

This method is called before the user code is opened. An exception thrown by this method signals failure of the task.

指定者:

prepare 在接口中 Driver<org.apache.flink.api.common.functions.FlatJoinFunction<IT1,IT2,OT>,OT>

抛出:

Exception - Exceptions may be forwarded and signal task failure.

run

public void run()
         throws Exception

从接口复制的说明: Driver

The main operation method of the task. It should call the user code with the data subsets until the input is depleted.

指定者:

run 在接口中 Driver<org.apache.flink.api.common.functions.FlatJoinFunction<IT1,IT2,OT>,OT>

抛出:

Exception - Any exception thrown by this method signals task failure. Because exceptions in the user code typically signal situations where this instance in unable to proceed, exceptions from the user code should be forwarded.

cleanup

public void cleanup()
             throws Exception

从接口复制的说明: Driver

This method is invoked in any case (clean termination and exception) at the end of the tasks operation.

指定者:

cleanup 在接口中 Driver<org.apache.flink.api.common.functions.FlatJoinFunction<IT1,IT2,OT>,OT>

抛出:

Exception - Exceptions may be forwarded.

cancel

public void cancel()

从接口复制的说明: Driver

This method is invoked when the driver must aborted in mid processing. It is invoked asynchronously by a different thread.

指定者:

cancel 在接口中 Driver<org.apache.flink.api.common.functions.FlatJoinFunction<IT1,IT2,OT>,OT>

getReusingOuterJoinIterator

protected abstract JoinTaskIterator<IT1,IT2,OT> getReusingOuterJoinIterator(DriverStrategy driverStrategy,
                                                                            org.apache.flink.util.MutableObjectIterator<IT1> in1,
                                                                            org.apache.flink.util.MutableObjectIterator<IT2> in2,
                                                                            org.apache.flink.api.common.typeutils.TypeSerializer<IT1> serializer1,
                                                                            org.apache.flink.api.common.typeutils.TypeComparator<IT1> comparator1,
                                                                            org.apache.flink.api.common.typeutils.TypeSerializer<IT2> serializer2,
                                                                            org.apache.flink.api.common.typeutils.TypeComparator<IT2> comparator2,
                                                                            org.apache.flink.api.common.typeutils.TypePairComparatorFactory<IT1,IT2> pairComparatorFactory,
                                                                            MemoryManager memoryManager,
                                                                            IOManager ioManager,
                                                                            double driverMemFraction)
                                                                     throws Exception

抛出:

Exception

getNonReusingOuterJoinIterator

protected abstract JoinTaskIterator<IT1,IT2,OT> getNonReusingOuterJoinIterator(DriverStrategy driverStrategy,
                                                                               org.apache.flink.util.MutableObjectIterator<IT1> in1,
                                                                               org.apache.flink.util.MutableObjectIterator<IT2> in2,
                                                                               org.apache.flink.api.common.typeutils.TypeSerializer<IT1> serializer1,
                                                                               org.apache.flink.api.common.typeutils.TypeComparator<IT1> comparator1,
                                                                               org.apache.flink.api.common.typeutils.TypeSerializer<IT2> serializer2,
                                                                               org.apache.flink.api.common.typeutils.TypeComparator<IT2> comparator2,
                                                                               org.apache.flink.api.common.typeutils.TypePairComparatorFactory<IT1,IT2> pairComparatorFactory,
                                                                               MemoryManager memoryManager,
                                                                               IOManager ioManager,
                                                                               double driverMemFraction)
                                                                        throws Exception

抛出:

Exception