org.apache.flink.runtime.scheduler

类 DefaultScheduler

java.lang.Object

org.apache.flink.runtime.scheduler.SchedulerBase

org.apache.flink.runtime.scheduler.DefaultScheduler

所有已实现的接口:

AutoCloseable, CheckpointScheduling, GlobalFailureHandler, SchedulerNG, SchedulerOperations, org.apache.flink.util.AutoCloseableAsync

直接已知子类:

AdaptiveBatchScheduler

public class DefaultScheduler
extends SchedulerBase
implements SchedulerOperations

The future default scheduler.

字段概要

字段

限定符和类型	字段和说明
protected ExecutionDeployer	executionDeployer
protected ExecutionSlotAllocator	executionSlotAllocator
protected FailoverStrategy	failoverStrategy
protected org.slf4j.Logger	log
protected SchedulingStrategy	schedulingStrategy
protected ShuffleMaster<?>	shuffleMaster

从类继承的字段 org.apache.flink.runtime.scheduler.SchedulerBase

executionVertexVersioner, inputsLocationsRetriever, jobInfo, jobManagerJobMetricGroup, operatorCoordinatorHandler, stateLocationRetriever

构造器概要

构造器

限定符

构造器和说明

protected

DefaultScheduler(org.slf4j.Logger log, JobGraph jobGraph, Executor ioExecutor, org.apache.flink.configuration.Configuration jobMasterConfiguration, Consumer<org.apache.flink.runtime.concurrent.ComponentMainThreadExecutor> startUpAction, org.apache.flink.util.concurrent.ScheduledExecutor delayExecutor, ClassLoader userCodeLoader, CheckpointsCleaner checkpointsCleaner, CheckpointRecoveryFactory checkpointRecoveryFactory, JobManagerJobMetricGroup jobManagerJobMetricGroup, SchedulingStrategyFactory schedulingStrategyFactory, FailoverStrategy.Factory failoverStrategyFactory, RestartBackoffTimeStrategy restartBackoffTimeStrategy, ExecutionOperations executionOperations, ExecutionVertexVersioner executionVertexVersioner, ExecutionSlotAllocatorFactory executionSlotAllocatorFactory, long initializationTimestamp, org.apache.flink.runtime.concurrent.ComponentMainThreadExecutor mainThreadExecutor, JobStatusListener jobStatusListener, Collection<org.apache.flink.core.failure.FailureEnricher> failureEnrichers, ExecutionGraphFactory executionGraphFactory, ShuffleMaster<?> shuffleMaster, org.apache.flink.api.common.time.Time rpcTimeout, VertexParallelismStore vertexParallelismStore, ExecutionDeployer.Factory executionDeployerFactory)

方法概要

限定符和类型	方法和说明
void	allocateSlotsAndDeploy(List<ExecutionVertexID> verticesToDeploy) Allocate slots and deploy the vertex when slots are returned.
protected void	cancelAllPendingSlotRequestsForVertex(ExecutionVertexID executionVertexId)
protected void	cancelAllPendingSlotRequestsInternal()
protected CompletableFuture<?>	cancelExecution(Execution execution)
protected FailureHandlingResultSnapshot	createFailureHandlingResultSnapshot(FailureHandlingResult failureHandlingResult)
protected long	getNumberOfRestarts()
void	handleGlobalFailure(Throwable error) Handles a global failure.
protected void	handleTaskFailure(Execution failedExecution, Throwable error)
protected void	maybeRestartTasks(FailureHandlingResult failureHandlingResult)
protected void	notifyCoordinatorsAboutTaskFailure(Execution execution, Throwable error)
protected void	onTaskFailed(Execution execution)
protected void	onTaskFinished(Execution execution, IOMetrics ioMetrics)
protected FailureHandlingResult	recordTaskFailure(Execution failedExecution, Throwable error)
protected void	startSchedulingInternal()

从类继承的方法 org.apache.flink.runtime.scheduler.SchedulerBase

acknowledgeCheckpoint, archiveFromFailureHandlingResult, archiveGlobalFailure, cancel, closeAsync, computeVertexParallelismStore, computeVertexParallelismStore, computeVertexParallelismStore, computeVertexParallelismStore, declineCheckpoint, deliverCoordinationRequestToCoordinator, deliverOperatorEventToCoordinator, failJob, getDefaultMaxParallelism, getExceptionHistory, getExecutionGraph, getExecutionJobVertex, getExecutionVertex, getJobGraph, getJobId, getJobTerminationFuture, getMainThreadExecutor, getMarkPartitionFinishedStrategy, getResultPartitionAvailabilityChecker, getSchedulingTopology, notifyEndOfData, notifyKvStateRegistered, notifyKvStateUnregistered, registerJobMetrics, reportCheckpointMetrics, reportInitializationMetrics, requestCheckpointStats, requestJob, requestJobStatus, requestKvStateLocation, requestNextInputSplit, requestPartitionState, resetForNewExecution, resetForNewExecutions, restoreState, setGlobalFailureCause, startCheckpointScheduler, startScheduling, stopCheckpointScheduler, stopWithSavepoint, transitionExecutionGraphState, transitionToRunning, transitionToScheduled, triggerCheckpoint, triggerSavepoint, updateAccumulators, updateTaskExecutionState

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

从接口继承的方法 org.apache.flink.runtime.scheduler.SchedulerNG

requestJobResourceRequirements, updateJobResourceRequirements, updateTaskExecutionState

从接口继承的方法 org.apache.flink.util.AutoCloseableAsync

close

字段详细资料

log

protected final org.slf4j.Logger log

executionSlotAllocator

protected final ExecutionSlotAllocator executionSlotAllocator

schedulingStrategy

protected final SchedulingStrategy schedulingStrategy

shuffleMaster

protected final ShuffleMaster<?> shuffleMaster

executionDeployer

protected final ExecutionDeployer executionDeployer

failoverStrategy

protected final FailoverStrategy failoverStrategy

构造器详细资料

DefaultScheduler

protected DefaultScheduler(org.slf4j.Logger log,
                           JobGraph jobGraph,
                           Executor ioExecutor,
                           org.apache.flink.configuration.Configuration jobMasterConfiguration,
                           Consumer<org.apache.flink.runtime.concurrent.ComponentMainThreadExecutor> startUpAction,
                           org.apache.flink.util.concurrent.ScheduledExecutor delayExecutor,
                           ClassLoader userCodeLoader,
                           CheckpointsCleaner checkpointsCleaner,
                           CheckpointRecoveryFactory checkpointRecoveryFactory,
                           JobManagerJobMetricGroup jobManagerJobMetricGroup,
                           SchedulingStrategyFactory schedulingStrategyFactory,
                           FailoverStrategy.Factory failoverStrategyFactory,
                           RestartBackoffTimeStrategy restartBackoffTimeStrategy,
                           ExecutionOperations executionOperations,
                           ExecutionVertexVersioner executionVertexVersioner,
                           ExecutionSlotAllocatorFactory executionSlotAllocatorFactory,
                           long initializationTimestamp,
                           org.apache.flink.runtime.concurrent.ComponentMainThreadExecutor mainThreadExecutor,
                           JobStatusListener jobStatusListener,
                           Collection<org.apache.flink.core.failure.FailureEnricher> failureEnrichers,
                           ExecutionGraphFactory executionGraphFactory,
                           ShuffleMaster<?> shuffleMaster,
                           org.apache.flink.api.common.time.Time rpcTimeout,
                           VertexParallelismStore vertexParallelismStore,
                           ExecutionDeployer.Factory executionDeployerFactory)
                    throws Exception

抛出:

Exception

方法详细资料

getNumberOfRestarts

protected long getNumberOfRestarts()

指定者:

getNumberOfRestarts 在类中 SchedulerBase

cancelAllPendingSlotRequestsInternal

protected void cancelAllPendingSlotRequestsInternal()

指定者:

cancelAllPendingSlotRequestsInternal 在类中 SchedulerBase

startSchedulingInternal

protected void startSchedulingInternal()

指定者:

startSchedulingInternal 在类中 SchedulerBase

onTaskFinished

protected void onTaskFinished(Execution execution,
                              IOMetrics ioMetrics)

指定者:

onTaskFinished 在类中 SchedulerBase

onTaskFailed

protected void onTaskFailed(Execution execution)

指定者:

onTaskFailed 在类中 SchedulerBase

handleTaskFailure

protected void handleTaskFailure(Execution failedExecution,
                                 @Nullable
                                 Throwable error)

recordTaskFailure

protected FailureHandlingResult recordTaskFailure(Execution failedExecution,
                                                  @Nullable
                                                  Throwable error)

notifyCoordinatorsAboutTaskFailure

protected void notifyCoordinatorsAboutTaskFailure(Execution execution,
                                                  @Nullable
                                                  Throwable error)

handleGlobalFailure

public void handleGlobalFailure(Throwable error)

从接口复制的说明: GlobalFailureHandler

Handles a global failure.

指定者:

handleGlobalFailure 在接口中 GlobalFailureHandler

参数:

error - A cause that describes the global failure.

maybeRestartTasks

protected void maybeRestartTasks(FailureHandlingResult failureHandlingResult)

createFailureHandlingResultSnapshot

protected FailureHandlingResultSnapshot createFailureHandlingResultSnapshot(FailureHandlingResult failureHandlingResult)

cancelExecution

protected CompletableFuture<?> cancelExecution(Execution execution)

cancelAllPendingSlotRequestsForVertex

protected void cancelAllPendingSlotRequestsForVertex(ExecutionVertexID executionVertexId)

allocateSlotsAndDeploy

public void allocateSlotsAndDeploy(List<ExecutionVertexID> verticesToDeploy)

从接口复制的说明: SchedulerOperations

Allocate slots and deploy the vertex when slots are returned. Vertices will be deployed only after all of them have been assigned slots. The given order will be respected, i.e. tasks with smaller indices will be deployed earlier. Only vertices in CREATED state will be accepted. Errors will happen if scheduling Non-CREATED vertices.

指定者:

allocateSlotsAndDeploy 在接口中 SchedulerOperations

参数:

verticesToDeploy - The execution vertices to deploy