| Modifier and Type | Method and Description |
|---|---|
static void |
ClientUtils.extractAndUploadJobGraphFiles(JobGraph jobGraph,
org.apache.flink.util.function.SupplierWithException<BlobClient,IOException> clientSupplier)
Extracts all files required for the execution from the given
JobGraph and uploads them using the BlobClient
from the given Supplier. |
static void |
ClientUtils.uploadJobGraphFiles(JobGraph jobGraph,
Collection<org.apache.flink.core.fs.Path> userJars,
Collection<org.apache.flink.api.java.tuple.Tuple2<String,org.apache.flink.core.fs.Path>> userArtifacts,
org.apache.flink.util.function.SupplierWithException<BlobClient,IOException> clientSupplier)
Uploads the given jars and artifacts required for the execution of the given
JobGraph using the BlobClient from
the given Supplier. |
| Modifier and Type | Method and Description |
|---|---|
JobGraph |
SingleJobJobGraphStore.recoverJobGraph(org.apache.flink.api.common.JobID jobId) |
| Modifier and Type | Method and Description |
|---|---|
JobManagerRunner |
JobManagerRunnerFactory.createJobManagerRunner(JobGraph jobGraph,
org.apache.flink.configuration.Configuration configuration,
RpcService rpcService,
HighAvailabilityServices highAvailabilityServices,
HeartbeatServices heartbeatServices,
JobManagerSharedServices jobManagerServices,
JobManagerJobMetricGroupFactory jobManagerJobMetricGroupFactory,
FatalErrorHandler fatalErrorHandler) |
JobManagerRunner |
DefaultJobManagerRunnerFactory.createJobManagerRunner(JobGraph jobGraph,
org.apache.flink.configuration.Configuration configuration,
RpcService rpcService,
HighAvailabilityServices highAvailabilityServices,
HeartbeatServices heartbeatServices,
JobManagerSharedServices jobManagerServices,
JobManagerJobMetricGroupFactory jobManagerJobMetricGroupFactory,
FatalErrorHandler fatalErrorHandler) |
void |
SingleJobJobGraphStore.putJobGraph(JobGraph jobGraph) |
CompletableFuture<Acknowledge> |
MiniDispatcher.submitJob(JobGraph jobGraph,
org.apache.flink.api.common.time.Time timeout) |
CompletableFuture<Acknowledge> |
DispatcherGateway.submitJob(JobGraph jobGraph,
org.apache.flink.api.common.time.Time timeout)
Submit a job to the dispatcher.
|
CompletableFuture<Acknowledge> |
Dispatcher.submitJob(JobGraph jobGraph,
org.apache.flink.api.common.time.Time timeout) |
| Modifier and Type | Method and Description |
|---|---|
MiniDispatcher |
JobDispatcherFactory.createDispatcher(RpcService rpcService,
DispatcherId fencingToken,
Collection<JobGraph> recoveredJobs,
PartialDispatcherServicesWithJobGraphStore partialDispatcherServicesWithJobGraphStore) |
Dispatcher |
DispatcherFactory.createDispatcher(RpcService rpcService,
DispatcherId fencingToken,
Collection<JobGraph> recoveredJobs,
PartialDispatcherServicesWithJobGraphStore partialDispatcherServicesWithJobGraphStore)
Create a
Dispatcher. |
StandaloneDispatcher |
SessionDispatcherFactory.createDispatcher(RpcService rpcService,
DispatcherId fencingToken,
Collection<JobGraph> recoveredJobs,
PartialDispatcherServicesWithJobGraphStore partialDispatcherServicesWithJobGraphStore) |
| Constructor and Description |
|---|
MiniDispatcher(RpcService rpcService,
String endpointId,
DispatcherId fencingToken,
DispatcherServices dispatcherServices,
JobGraph jobGraph,
ClusterEntrypoint.ExecutionMode executionMode) |
SingleJobJobGraphStore(JobGraph jobGraph) |
| Constructor and Description |
|---|
Dispatcher(RpcService rpcService,
String endpointId,
DispatcherId fencingToken,
Collection<JobGraph> recoveredJobs,
DispatcherServices dispatcherServices) |
StandaloneDispatcher(RpcService rpcService,
String endpointId,
DispatcherId fencingToken,
Collection<JobGraph> recoveredJobs,
DispatcherServices dispatcherServices) |
| Modifier and Type | Method and Description |
|---|---|
JobGraph |
FileJobGraphRetriever.retrieveJobGraph(org.apache.flink.configuration.Configuration configuration) |
JobGraph |
JobGraphRetriever.retrieveJobGraph(org.apache.flink.configuration.Configuration configuration)
Retrieve the
JobGraph. |
| Modifier and Type | Method and Description |
|---|---|
static ExecutionGraph |
ExecutionGraphBuilder.buildGraph(ExecutionGraph prior,
JobGraph jobGraph,
org.apache.flink.configuration.Configuration jobManagerConfig,
ScheduledExecutorService futureExecutor,
Executor ioExecutor,
SlotProvider slotProvider,
ClassLoader classLoader,
CheckpointRecoveryFactory recoveryFactory,
org.apache.flink.api.common.time.Time rpcTimeout,
RestartStrategy restartStrategy,
org.apache.flink.metrics.MetricGroup metrics,
BlobWriter blobWriter,
org.apache.flink.api.common.time.Time allocationTimeout,
org.slf4j.Logger log,
ShuffleMaster<?> shuffleMaster,
JobMasterPartitionTracker partitionTracker)
Builds the ExecutionGraph from the JobGraph.
|
static ExecutionGraph |
ExecutionGraphBuilder.buildGraph(ExecutionGraph prior,
JobGraph jobGraph,
org.apache.flink.configuration.Configuration jobManagerConfig,
ScheduledExecutorService futureExecutor,
Executor ioExecutor,
SlotProvider slotProvider,
ClassLoader classLoader,
CheckpointRecoveryFactory recoveryFactory,
org.apache.flink.api.common.time.Time rpcTimeout,
RestartStrategy restartStrategy,
org.apache.flink.metrics.MetricGroup metrics,
BlobWriter blobWriter,
org.apache.flink.api.common.time.Time allocationTimeout,
org.slf4j.Logger log,
ShuffleMaster<?> shuffleMaster,
JobMasterPartitionTracker partitionTracker,
FailoverStrategy.Factory failoverStrategyFactory) |
| Modifier and Type | Method and Description |
|---|---|
static String |
JsonPlanGenerator.generatePlan(JobGraph jg) |
| Constructor and Description |
|---|
DefaultLogicalTopology(JobGraph jobGraph) |
| Modifier and Type | Method and Description |
|---|---|
JobGraph |
JobGraphStore.recoverJobGraph(org.apache.flink.api.common.JobID jobId)
|
JobGraph |
StandaloneJobGraphStore.recoverJobGraph(org.apache.flink.api.common.JobID jobId) |
JobGraph |
ZooKeeperJobGraphStore.recoverJobGraph(org.apache.flink.api.common.JobID jobId) |
| Modifier and Type | Method and Description |
|---|---|
void |
JobGraphWriter.putJobGraph(JobGraph jobGraph)
Adds the
JobGraph instance. |
void |
StandaloneJobGraphStore.putJobGraph(JobGraph jobGraph) |
void |
ZooKeeperJobGraphStore.putJobGraph(JobGraph jobGraph) |
void |
ThrowingJobGraphWriter.putJobGraph(JobGraph jobGraph) |
| Constructor and Description |
|---|
ZooKeeperJobGraphStore(String zooKeeperFullBasePath,
ZooKeeperStateHandleStore<JobGraph> zooKeeperStateHandleStore,
org.apache.curator.framework.recipes.cache.PathChildrenCache pathCache)
Submitted job graph store backed by ZooKeeper.
|
| Constructor and Description |
|---|
JobManagerRunnerImpl(JobGraph jobGraph,
JobMasterServiceFactory jobMasterFactory,
HighAvailabilityServices haServices,
LibraryCacheManager libraryCacheManager,
Executor executor,
FatalErrorHandler fatalErrorHandler)
Exceptions that occur while creating the JobManager or JobManagerRunnerImpl are directly
thrown and not reported to the given
FatalErrorHandler. |
JobMaster(RpcService rpcService,
JobMasterConfiguration jobMasterConfiguration,
ResourceID resourceId,
JobGraph jobGraph,
HighAvailabilityServices highAvailabilityService,
SlotPoolFactory slotPoolFactory,
SchedulerFactory schedulerFactory,
JobManagerSharedServices jobManagerSharedServices,
HeartbeatServices heartbeatServices,
JobManagerJobMetricGroupFactory jobMetricGroupFactory,
OnCompletionActions jobCompletionActions,
FatalErrorHandler fatalErrorHandler,
ClassLoader userCodeLoader,
SchedulerNGFactory schedulerNGFactory,
ShuffleMaster<?> shuffleMaster,
PartitionTrackerFactory partitionTrackerFactory) |
| Modifier and Type | Method and Description |
|---|---|
JobManagerJobMetricGroup |
DefaultJobManagerJobMetricGroupFactory.create(JobGraph jobGraph) |
JobManagerJobMetricGroup |
JobManagerJobMetricGroupFactory.create(JobGraph jobGraph)
Create a new
JobManagerJobMetricGroup. |
JobManagerJobMetricGroup |
UnregisteredJobManagerJobMetricGroupFactory.create(JobGraph jobGraph) |
JobMasterService |
JobMasterServiceFactory.createJobMasterService(JobGraph jobGraph,
OnCompletionActions jobCompletionActions,
ClassLoader userCodeClassloader) |
JobMaster |
DefaultJobMasterServiceFactory.createJobMasterService(JobGraph jobGraph,
OnCompletionActions jobCompletionActions,
ClassLoader userCodeClassloader) |
| Modifier and Type | Method and Description |
|---|---|
JobManagerJobMetricGroup |
JobManagerMetricGroup.addJob(JobGraph job) |
JobManagerJobMetricGroup |
UnregisteredMetricGroups.UnregisteredJobManagerMetricGroup.addJob(JobGraph job) |
| Modifier and Type | Method and Description |
|---|---|
org.apache.flink.api.common.JobExecutionResult |
JobExecutor.executeJobBlocking(JobGraph jobGraph)
Run the given job and block until its execution result can be returned.
|
org.apache.flink.api.common.JobExecutionResult |
MiniCluster.executeJobBlocking(JobGraph job)
This method runs a job in blocking mode.
|
void |
MiniCluster.runDetached(JobGraph job)
This method executes a job in detached mode.
|
CompletableFuture<org.apache.flink.api.common.JobSubmissionResult> |
MiniCluster.submitJob(JobGraph jobGraph) |
| Modifier and Type | Method and Description |
|---|---|
protected JobGraph |
SchedulerBase.getJobGraph() |
| Modifier and Type | Method and Description |
|---|---|
SchedulerNG |
DefaultSchedulerFactory.createInstance(org.slf4j.Logger log,
JobGraph jobGraph,
BackPressureStatsTracker backPressureStatsTracker,
Executor ioExecutor,
org.apache.flink.configuration.Configuration jobMasterConfiguration,
SlotProvider slotProvider,
ScheduledExecutorService futureExecutor,
ClassLoader userCodeLoader,
CheckpointRecoveryFactory checkpointRecoveryFactory,
org.apache.flink.api.common.time.Time rpcTimeout,
BlobWriter blobWriter,
JobManagerJobMetricGroup jobManagerJobMetricGroup,
org.apache.flink.api.common.time.Time slotRequestTimeout,
ShuffleMaster<?> shuffleMaster,
JobMasterPartitionTracker partitionTracker) |
SchedulerNG |
SchedulerNGFactory.createInstance(org.slf4j.Logger log,
JobGraph jobGraph,
BackPressureStatsTracker backPressureStatsTracker,
Executor ioExecutor,
org.apache.flink.configuration.Configuration jobMasterConfiguration,
SlotProvider slotProvider,
ScheduledExecutorService futureExecutor,
ClassLoader userCodeLoader,
CheckpointRecoveryFactory checkpointRecoveryFactory,
org.apache.flink.api.common.time.Time rpcTimeout,
BlobWriter blobWriter,
JobManagerJobMetricGroup jobManagerJobMetricGroup,
org.apache.flink.api.common.time.Time slotRequestTimeout,
ShuffleMaster<?> shuffleMaster,
JobMasterPartitionTracker partitionTracker) |
SchedulerNG |
LegacySchedulerFactory.createInstance(org.slf4j.Logger log,
JobGraph jobGraph,
BackPressureStatsTracker backPressureStatsTracker,
Executor ioExecutor,
org.apache.flink.configuration.Configuration jobMasterConfiguration,
SlotProvider slotProvider,
ScheduledExecutorService futureExecutor,
ClassLoader userCodeLoader,
CheckpointRecoveryFactory checkpointRecoveryFactory,
org.apache.flink.api.common.time.Time rpcTimeout,
BlobWriter blobWriter,
JobManagerJobMetricGroup jobManagerJobMetricGroup,
org.apache.flink.api.common.time.Time slotRequestTimeout,
ShuffleMaster<?> shuffleMaster,
JobMasterPartitionTracker partitionTracker) |
| Constructor and Description |
|---|
DefaultScheduler(org.slf4j.Logger log,
JobGraph jobGraph,
BackPressureStatsTracker backPressureStatsTracker,
Executor ioExecutor,
org.apache.flink.configuration.Configuration jobMasterConfiguration,
SlotProvider slotProvider,
ScheduledExecutorService futureExecutor,
ScheduledExecutor delayExecutor,
ClassLoader userCodeLoader,
CheckpointRecoveryFactory checkpointRecoveryFactory,
org.apache.flink.api.common.time.Time rpcTimeout,
BlobWriter blobWriter,
JobManagerJobMetricGroup jobManagerJobMetricGroup,
org.apache.flink.api.common.time.Time slotRequestTimeout,
ShuffleMaster<?> shuffleMaster,
JobMasterPartitionTracker partitionTracker,
SchedulingStrategyFactory schedulingStrategyFactory,
FailoverStrategy.Factory failoverStrategyFactory,
RestartBackoffTimeStrategy restartBackoffTimeStrategy,
org.apache.flink.runtime.scheduler.ExecutionVertexOperations executionVertexOperations,
ExecutionVertexVersioner executionVertexVersioner,
ExecutionSlotAllocatorFactory executionSlotAllocatorFactory) |
LegacyScheduler(org.slf4j.Logger log,
JobGraph jobGraph,
BackPressureStatsTracker backPressureStatsTracker,
Executor ioExecutor,
org.apache.flink.configuration.Configuration jobMasterConfiguration,
SlotProvider slotProvider,
ScheduledExecutorService futureExecutor,
ClassLoader userCodeLoader,
CheckpointRecoveryFactory checkpointRecoveryFactory,
org.apache.flink.api.common.time.Time rpcTimeout,
RestartStrategyFactory restartStrategyFactory,
BlobWriter blobWriter,
JobManagerJobMetricGroup jobManagerJobMetricGroup,
org.apache.flink.api.common.time.Time slotRequestTimeout,
ShuffleMaster<?> shuffleMaster,
JobMasterPartitionTracker partitionTracker) |
SchedulerBase(org.slf4j.Logger log,
JobGraph jobGraph,
BackPressureStatsTracker backPressureStatsTracker,
Executor ioExecutor,
org.apache.flink.configuration.Configuration jobMasterConfiguration,
SlotProvider slotProvider,
ScheduledExecutorService futureExecutor,
ClassLoader userCodeLoader,
CheckpointRecoveryFactory checkpointRecoveryFactory,
org.apache.flink.api.common.time.Time rpcTimeout,
RestartStrategyFactory restartStrategyFactory,
BlobWriter blobWriter,
JobManagerJobMetricGroup jobManagerJobMetricGroup,
org.apache.flink.api.common.time.Time slotRequestTimeout,
ShuffleMaster<?> shuffleMaster,
JobMasterPartitionTracker partitionTracker,
ExecutionVertexVersioner executionVertexVersioner,
boolean legacyScheduling) |
Copyright © 2014–2020 The Apache Software Foundation. All rights reserved.