org.apache.flink.runtime.scheduler.adaptivebatch

类 SpeculativeScheduler

java.lang.Object

org.apache.flink.runtime.scheduler.SchedulerBase

org.apache.flink.runtime.scheduler.DefaultScheduler

org.apache.flink.runtime.scheduler.adaptivebatch.AdaptiveBatchScheduler

org.apache.flink.runtime.scheduler.adaptivebatch.SpeculativeScheduler

所有已实现的接口:

AutoCloseable, CheckpointScheduling, GlobalFailureHandler, SchedulerNG, SchedulerOperations, SlowTaskDetectorListener, org.apache.flink.util.AutoCloseableAsync

public class SpeculativeScheduler
extends AdaptiveBatchScheduler
implements SlowTaskDetectorListener

The speculative scheduler.

字段概要

从类继承的字段 org.apache.flink.runtime.scheduler.DefaultScheduler

executionDeployer, executionSlotAllocator, log

从类继承的字段 org.apache.flink.runtime.scheduler.SchedulerBase

executionVertexVersioner, inputsLocationsRetriever, jobManagerJobMetricGroup, operatorCoordinatorHandler, stateLocationRetriever

构造器概要

构造器

构造器和说明

SpeculativeScheduler(org.slf4j.Logger log, JobGraph jobGraph, Executor ioExecutor, org.apache.flink.configuration.Configuration jobMasterConfiguration, java.util.function.Consumer<org.apache.flink.runtime.concurrent.ComponentMainThreadExecutor> startUpAction, org.apache.flink.util.concurrent.ScheduledExecutor delayExecutor, ClassLoader userCodeLoader, CheckpointsCleaner checkpointsCleaner, CheckpointRecoveryFactory checkpointRecoveryFactory, JobManagerJobMetricGroup jobManagerJobMetricGroup, SchedulingStrategyFactory schedulingStrategyFactory, FailoverStrategy.Factory failoverStrategyFactory, RestartBackoffTimeStrategy restartBackoffTimeStrategy, ExecutionOperations executionOperations, ExecutionVertexVersioner executionVertexVersioner, ExecutionSlotAllocatorFactory executionSlotAllocatorFactory, long initializationTimestamp, org.apache.flink.runtime.concurrent.ComponentMainThreadExecutor mainThreadExecutor, JobStatusListener jobStatusListener, ExecutionGraphFactory executionGraphFactory, ShuffleMaster<?> shuffleMaster, org.apache.flink.api.common.time.Time rpcTimeout, VertexParallelismAndInputInfosDecider vertexParallelismAndInputInfosDecider, int defaultMaxParallelism, BlocklistOperations blocklistOperations, org.apache.flink.configuration.JobManagerOptions.HybridPartitionDataConsumeConstraint hybridPartitionDataConsumeConstraint, Map<JobVertexID,ForwardGroup> forwardGroupsByJobVertexId)

方法概要

限定符和类型	方法和说明
CompletableFuture<Void>	closeAsync()
SpeculativeExecutionVertex	getExecutionVertex(ExecutionVertexID executionVertexId)
protected void	handleTaskFailure(Execution failedExecution, Throwable error)
void	notifySlowTasks(Map<ExecutionVertexID,Collection<ExecutionAttemptID>> slowTasks) Notify detected slow tasks.
protected void	onTaskFailed(Execution execution)
protected void	onTaskFinished(Execution execution, IOMetrics ioMetrics)
protected void	resetForNewExecution(ExecutionVertexID executionVertexId)
protected void	startSchedulingInternal()

从类继承的方法 org.apache.flink.runtime.scheduler.adaptivebatch.AdaptiveBatchScheduler

allocateSlotsAndDeploy, computeVertexParallelismStoreForDynamicGraph, getMarkPartitionFinishedStrategy

从类继承的方法 org.apache.flink.runtime.scheduler.DefaultScheduler

cancelAllPendingSlotRequestsForVertex, cancelAllPendingSlotRequestsInternal, cancelExecution, createFailureHandlingResultSnapshot, getNumberOfRestarts, handleGlobalFailure, recordTaskFailure

从类继承的方法 org.apache.flink.runtime.scheduler.SchedulerBase

acknowledgeCheckpoint, archiveFromFailureHandlingResult, archiveGlobalFailure, cancel, computeVertexParallelismStore, computeVertexParallelismStore, computeVertexParallelismStore, computeVertexParallelismStore, declineCheckpoint, deliverCoordinationRequestToCoordinator, deliverOperatorEventToCoordinator, failJob, getDefaultMaxParallelism, getExceptionHistory, getExecutionGraph, getExecutionJobVertex, getJobGraph, getJobTerminationFuture, getMainThreadExecutor, getResultPartitionAvailabilityChecker, getSchedulingTopology, notifyKvStateRegistered, notifyKvStateUnregistered, registerJobMetrics, reportCheckpointMetrics, requestJob, requestJobDetails, requestJobStatus, requestKvStateLocation, requestNextInputSplit, requestPartitionState, resetForNewExecutions, restoreState, setGlobalFailureCause, startCheckpointScheduler, startScheduling, stopCheckpointScheduler, stopWithSavepoint, transitionExecutionGraphState, transitionToRunning, transitionToScheduled, triggerCheckpoint, triggerSavepoint, updateAccumulators, updateTaskExecutionState

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

从接口继承的方法 org.apache.flink.runtime.scheduler.SchedulerNG

updateTaskExecutionState

从接口继承的方法 org.apache.flink.util.AutoCloseableAsync

close

构造器详细资料

SpeculativeScheduler

public SpeculativeScheduler(org.slf4j.Logger log,
                            JobGraph jobGraph,
                            Executor ioExecutor,
                            org.apache.flink.configuration.Configuration jobMasterConfiguration,
                            java.util.function.Consumer<org.apache.flink.runtime.concurrent.ComponentMainThreadExecutor> startUpAction,
                            org.apache.flink.util.concurrent.ScheduledExecutor delayExecutor,
                            ClassLoader userCodeLoader,
                            CheckpointsCleaner checkpointsCleaner,
                            CheckpointRecoveryFactory checkpointRecoveryFactory,
                            JobManagerJobMetricGroup jobManagerJobMetricGroup,
                            SchedulingStrategyFactory schedulingStrategyFactory,
                            FailoverStrategy.Factory failoverStrategyFactory,
                            RestartBackoffTimeStrategy restartBackoffTimeStrategy,
                            ExecutionOperations executionOperations,
                            ExecutionVertexVersioner executionVertexVersioner,
                            ExecutionSlotAllocatorFactory executionSlotAllocatorFactory,
                            long initializationTimestamp,
                            org.apache.flink.runtime.concurrent.ComponentMainThreadExecutor mainThreadExecutor,
                            JobStatusListener jobStatusListener,
                            ExecutionGraphFactory executionGraphFactory,
                            ShuffleMaster<?> shuffleMaster,
                            org.apache.flink.api.common.time.Time rpcTimeout,
                            VertexParallelismAndInputInfosDecider vertexParallelismAndInputInfosDecider,
                            int defaultMaxParallelism,
                            BlocklistOperations blocklistOperations,
                            org.apache.flink.configuration.JobManagerOptions.HybridPartitionDataConsumeConstraint hybridPartitionDataConsumeConstraint,
                            Map<JobVertexID,ForwardGroup> forwardGroupsByJobVertexId)
                     throws Exception

抛出:

Exception

方法详细资料

startSchedulingInternal

protected void startSchedulingInternal()

覆盖:

startSchedulingInternal 在类中 AdaptiveBatchScheduler

closeAsync

public CompletableFuture<Void> closeAsync()

指定者:

closeAsync 在接口中 org.apache.flink.util.AutoCloseableAsync

覆盖:

closeAsync 在类中 SchedulerBase

getExecutionVertex

public SpeculativeExecutionVertex getExecutionVertex(ExecutionVertexID executionVertexId)

覆盖:

getExecutionVertex 在类中 SchedulerBase

onTaskFinished

protected void onTaskFinished(Execution execution,
                              IOMetrics ioMetrics)

覆盖:

onTaskFinished 在类中 AdaptiveBatchScheduler

onTaskFailed

protected void onTaskFailed(Execution execution)

覆盖:

onTaskFailed 在类中 DefaultScheduler

handleTaskFailure

protected void handleTaskFailure(Execution failedExecution,
                                 @Nullable
                                 Throwable error)

覆盖:

handleTaskFailure 在类中 DefaultScheduler

resetForNewExecution

protected void resetForNewExecution(ExecutionVertexID executionVertexId)

覆盖:

resetForNewExecution 在类中 AdaptiveBatchScheduler

notifySlowTasks

public void notifySlowTasks(Map<ExecutionVertexID,Collection<ExecutionAttemptID>> slowTasks)

从接口复制的说明: SlowTaskDetectorListener

Notify detected slow tasks.

指定者:

notifySlowTasks 在接口中 SlowTaskDetectorListener

参数:

slowTasks - the map of execution vertices and their execution attempts which are detected as slow.