org.apache.flink.runtime.scheduler.adaptivebatch

类 DefaultVertexParallelismAndInputInfosDecider

java.lang.Object

org.apache.flink.runtime.scheduler.adaptivebatch.DefaultVertexParallelismAndInputInfosDecider

所有已实现的接口:

VertexParallelismAndInputInfosDecider

public class DefaultVertexParallelismAndInputInfosDecider
extends Object
implements VertexParallelismAndInputInfosDecider

Default implementation of VertexParallelismAndInputInfosDecider. This implementation will decide parallelism and JobVertexInputInfos as follows:

1. For job vertices whose inputs are all ALL_TO_ALL edges, evenly distribute data to downstream subtasks, make different downstream subtasks consume roughly the same amount of data.

2. For other cases, evenly distribute subpartitions to downstream subtasks, make different downstream subtasks consume roughly the same number of subpartitions.

方法概要

限定符和类型	方法和说明
ParallelismAndInputInfos	decideParallelismAndInputInfosForVertex(JobVertexID jobVertexId, List<BlockingResultInfo> consumedResults, int vertexInitialParallelism, int vertexMaxParallelism) Decide the parallelism and JobVertexInputInfos for this job vertex.

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

方法详细资料

decideParallelismAndInputInfosForVertex

public ParallelismAndInputInfos decideParallelismAndInputInfosForVertex(JobVertexID jobVertexId,
                                                                        List<BlockingResultInfo> consumedResults,
                                                                        int vertexInitialParallelism,
                                                                        int vertexMaxParallelism)

从接口复制的说明: VertexParallelismAndInputInfosDecider

Decide the parallelism and JobVertexInputInfos for this job vertex.

指定者:

decideParallelismAndInputInfosForVertex 在接口中 VertexParallelismAndInputInfosDecider

参数:

jobVertexId - The job vertex id

consumedResults - The information of consumed blocking results

vertexInitialParallelism - The initial parallelism of the job vertex. If it's a positive number, it will be respected. If it's not set(equals to ExecutionConfig.PARALLELISM_DEFAULT), a parallelism will be automatically decided for the vertex.

vertexMaxParallelism - The max parallelism of the job vertex.

返回:

the parallelism and vertex input infos.