| Modifier and Type | Method and Description |
|---|---|
ExecutionVertexID |
ExecutionAttemptID.getExecutionVertexId() |
ExecutionVertexID |
ExecutionVertex.getID() |
| Modifier and Type | Method and Description |
|---|---|
void |
EdgeManager.connectVertexWithConsumedPartitionGroup(ExecutionVertexID executionVertexId,
ConsumedPartitionGroup consumedPartitionGroup) |
List<ConsumedPartitionGroup> |
EdgeManager.getConsumedPartitionGroupsForVertex(ExecutionVertexID executionVertexId) |
ExecutionVertex |
DefaultExecutionGraph.getExecutionVertexOrThrow(ExecutionVertexID id) |
ExecutionVertex |
InternalExecutionGraphAccessor.getExecutionVertexOrThrow(ExecutionVertexID id) |
| Constructor and Description |
|---|
ExecutionAttemptID(ExecutionGraphID executionGraphId,
ExecutionVertexID executionVertexId,
int attemptNumber) |
| Modifier and Type | Method and Description |
|---|---|
Set<ExecutionVertexID> |
RestartAllFailoverStrategy.getTasksNeedingRestart(ExecutionVertexID executionVertexId,
Throwable cause)
Returns all vertices on any task failure.
|
Set<ExecutionVertexID> |
FailoverStrategy.getTasksNeedingRestart(ExecutionVertexID executionVertexId,
Throwable cause)
Returns a set of IDs corresponding to the set of vertices that should be restarted.
|
Set<ExecutionVertexID> |
RestartPipelinedRegionFailoverStrategy.getTasksNeedingRestart(ExecutionVertexID executionVertexId,
Throwable cause)
Returns a set of IDs corresponding to the set of vertices that should be restarted.
|
Set<ExecutionVertexID> |
FailureHandlingResult.getVerticesToRestart()
Returns the tasks to restart.
|
| Modifier and Type | Method and Description |
|---|---|
SchedulingPipelinedRegion |
RestartPipelinedRegionFailoverStrategy.getFailoverRegion(ExecutionVertexID vertexID)
Returns the failover region that contains the given execution vertex.
|
Set<ExecutionVertexID> |
RestartAllFailoverStrategy.getTasksNeedingRestart(ExecutionVertexID executionVertexId,
Throwable cause)
Returns all vertices on any task failure.
|
Set<ExecutionVertexID> |
FailoverStrategy.getTasksNeedingRestart(ExecutionVertexID executionVertexId,
Throwable cause)
Returns a set of IDs corresponding to the set of vertices that should be restarted.
|
Set<ExecutionVertexID> |
RestartPipelinedRegionFailoverStrategy.getTasksNeedingRestart(ExecutionVertexID executionVertexId,
Throwable cause)
Returns a set of IDs corresponding to the set of vertices that should be restarted.
|
| Modifier and Type | Method and Description |
|---|---|
static Set<Set<SchedulingExecutionVertex>> |
SchedulingPipelinedRegionComputeUtil.computePipelinedRegions(Iterable<? extends SchedulingExecutionVertex> topologicallySortedVertices,
Function<ExecutionVertexID,? extends SchedulingExecutionVertex> executionVertexRetriever,
Function<IntermediateResultPartitionID,? extends SchedulingResultPartition> resultPartitionRetriever) |
static FailureHandlingResult |
FailureHandlingResult.restartable(Execution failedExecution,
Throwable cause,
long timestamp,
CompletableFuture<Map<String,String>> failureLabels,
Set<ExecutionVertexID> verticesToRestart,
long restartDelayMS,
boolean globalFailure,
boolean isRootCause)
Creates a result of a set of tasks to restart to recover from the failure.
|
| Modifier and Type | Method and Description |
|---|---|
boolean |
RegionPartitionGroupReleaseStrategy.isRegionOfVertexFinished(ExecutionVertexID executionVertexId) |
List<ConsumedPartitionGroup> |
NotReleasingPartitionGroupReleaseStrategy.vertexFinished(ExecutionVertexID finishedVertex) |
List<ConsumedPartitionGroup> |
RegionPartitionGroupReleaseStrategy.vertexFinished(ExecutionVertexID finishedVertex) |
List<ConsumedPartitionGroup> |
PartitionGroupReleaseStrategy.vertexFinished(ExecutionVertexID finishedVertex)
Calling this method informs the strategy that a vertex finished.
|
void |
NotReleasingPartitionGroupReleaseStrategy.vertexUnfinished(ExecutionVertexID executionVertexID) |
void |
RegionPartitionGroupReleaseStrategy.vertexUnfinished(ExecutionVertexID executionVertexId) |
void |
PartitionGroupReleaseStrategy.vertexUnfinished(ExecutionVertexID executionVertexID)
Calling this method informs the strategy that a vertex is no longer in finished state, e.g.,
when a vertex is re-executed.
|
| Modifier and Type | Method and Description |
|---|---|
void |
RegionPartitionGroupReleaseStrategy.notifySchedulingTopologyUpdated(SchedulingTopology schedulingTopology,
List<ExecutionVertexID> newExecutionVertices) |
| Modifier and Type | Method and Description |
|---|---|
ExecutionVertexID |
ExecutionVertexFinishedEvent.getExecutionVertexId() |
| Modifier and Type | Method and Description |
|---|---|
List<ExecutionVertexID> |
ExecutionVertexResetEvent.getExecutionVertexIds() |
| Constructor and Description |
|---|
ExecutionVertexResetEvent(List<ExecutionVertexID> executionVertexIds) |
| Modifier and Type | Method and Description |
|---|---|
ExecutionVertexID |
ExecutionVertexVersion.getExecutionVertexId() |
| Modifier and Type | Method and Description |
|---|---|
Map<ExecutionVertexID,ExecutionVertexVersion> |
ExecutionVertexVersioner.getExecutionVertexVersions(Collection<ExecutionVertexID> executionVertexIds) |
Collection<ExecutionVertexID> |
ExecutionGraphToInputsLocationsRetrieverAdapter.getProducersOfConsumedPartitionGroup(ConsumedPartitionGroup consumedPartitionGroup) |
Collection<ExecutionVertexID> |
InputsLocationsRetriever.getProducersOfConsumedPartitionGroup(ConsumedPartitionGroup consumedPartitionGroup)
Get the producer execution vertices of a consumed result partition group.
|
Set<ExecutionVertexID> |
ExecutionVertexVersioner.getUnmodifiedExecutionVertices(Set<ExecutionVertexVersion> executionVertexVersions) |
Map<ExecutionVertexID,ExecutionVertexVersion> |
ExecutionVertexVersioner.recordVertexModifications(Collection<ExecutionVertexID> vertices) |
| Modifier and Type | Method and Description |
|---|---|
protected void |
DefaultScheduler.cancelAllPendingSlotRequestsForVertex(ExecutionVertexID executionVertexId) |
Collection<ConsumedPartitionGroup> |
ExecutionGraphToInputsLocationsRetrieverAdapter.getConsumedPartitionGroups(ExecutionVertexID executionVertexId) |
Collection<ConsumedPartitionGroup> |
InputsLocationsRetriever.getConsumedPartitionGroups(ExecutionVertexID executionVertexId)
Get the consumed result partition groups of an execution vertex.
|
ExecutionVertex |
SchedulerBase.getExecutionVertex(ExecutionVertexID executionVertexId) |
ExecutionVertexVersion |
ExecutionVertexVersioner.getExecutionVertexVersion(ExecutionVertexID executionVertexId) |
CompletableFuture<Collection<TaskManagerLocation>> |
PreferredLocationsRetriever.getPreferredLocations(ExecutionVertexID executionVertexId,
Set<ExecutionVertexID> producersToIgnore)
Returns preferred locations of an execution vertex.
|
Collection<TaskManagerLocation> |
SyncPreferredLocationsRetriever.getPreferredLocations(ExecutionVertexID executionVertexId,
Set<ExecutionVertexID> producersToIgnore)
Returns preferred locations of an execution vertex.
|
CompletableFuture<Collection<TaskManagerLocation>> |
DefaultPreferredLocationsRetriever.getPreferredLocations(ExecutionVertexID executionVertexId,
Set<ExecutionVertexID> producersToIgnore) |
Optional<TaskManagerLocation> |
StateLocationRetriever.getStateLocation(ExecutionVertexID executionVertexId)
Returns state location of an execution vertex.
|
Optional<CompletableFuture<TaskManagerLocation>> |
ExecutionGraphToInputsLocationsRetrieverAdapter.getTaskManagerLocation(ExecutionVertexID executionVertexId) |
Optional<CompletableFuture<TaskManagerLocation>> |
InputsLocationsRetriever.getTaskManagerLocation(ExecutionVertexID executionVertexId)
Get the task manager location future for an execution vertex.
|
ExecutionVertexVersion |
ExecutionVertexVersioner.recordModification(ExecutionVertexID executionVertexId) |
protected void |
SchedulerBase.resetForNewExecution(ExecutionVertexID executionVertexId) |
| Modifier and Type | Method and Description |
|---|---|
void |
ExecutionDeployer.allocateSlotsAndDeploy(List<Execution> executionsToDeploy,
Map<ExecutionVertexID,ExecutionVertexVersion> requiredVersionByVertex)
Allocate slots and deploy executions.
|
void |
DefaultExecutionDeployer.allocateSlotsAndDeploy(List<Execution> executionsToDeploy,
Map<ExecutionVertexID,ExecutionVertexVersion> requiredVersionByVertex) |
void |
SchedulerOperations.allocateSlotsAndDeploy(List<ExecutionVertexID> verticesToDeploy)
Allocate slots and deploy the vertex when slots are returned.
|
void |
DefaultScheduler.allocateSlotsAndDeploy(List<ExecutionVertexID> verticesToDeploy) |
ExecutionDeployer |
ExecutionDeployer.Factory.createInstance(org.slf4j.Logger log,
ExecutionSlotAllocator executionSlotAllocator,
ExecutionOperations executionOperations,
ExecutionVertexVersioner executionVertexVersioner,
org.apache.flink.api.common.time.Time partitionRegistrationTimeout,
BiConsumer<ExecutionVertexID,AllocationID> allocationReservationFunc,
org.apache.flink.runtime.concurrent.ComponentMainThreadExecutor mainThreadExecutor)
Instantiate an
ExecutionDeployer with the given params. |
DefaultExecutionDeployer |
DefaultExecutionDeployer.Factory.createInstance(org.slf4j.Logger log,
ExecutionSlotAllocator executionSlotAllocator,
ExecutionOperations executionOperations,
ExecutionVertexVersioner executionVertexVersioner,
org.apache.flink.api.common.time.Time partitionRegistrationTimeout,
BiConsumer<ExecutionVertexID,AllocationID> allocationReservationFunc,
org.apache.flink.runtime.concurrent.ComponentMainThreadExecutor mainThreadExecutor) |
Map<ExecutionVertexID,ExecutionVertexVersion> |
ExecutionVertexVersioner.getExecutionVertexVersions(Collection<ExecutionVertexID> executionVertexIds) |
CompletableFuture<Collection<TaskManagerLocation>> |
PreferredLocationsRetriever.getPreferredLocations(ExecutionVertexID executionVertexId,
Set<ExecutionVertexID> producersToIgnore)
Returns preferred locations of an execution vertex.
|
Collection<TaskManagerLocation> |
SyncPreferredLocationsRetriever.getPreferredLocations(ExecutionVertexID executionVertexId,
Set<ExecutionVertexID> producersToIgnore)
Returns preferred locations of an execution vertex.
|
CompletableFuture<Collection<TaskManagerLocation>> |
DefaultPreferredLocationsRetriever.getPreferredLocations(ExecutionVertexID executionVertexId,
Set<ExecutionVertexID> producersToIgnore) |
void |
SchedulingTopologyListener.notifySchedulingTopologyUpdated(SchedulingTopology schedulingTopology,
List<ExecutionVertexID> newExecutionVertices)
Notifies that the scheduling topology is just updated.
|
Map<ExecutionVertexID,ExecutionVertexVersion> |
ExecutionVertexVersioner.recordVertexModifications(Collection<ExecutionVertexID> vertices) |
protected void |
SchedulerBase.resetForNewExecutions(Collection<ExecutionVertexID> vertices) |
protected void |
SchedulerBase.restoreState(Set<ExecutionVertexID> vertices,
boolean isGlobalRecovery) |
void |
VertexEndOfDataListener.restoreVertices(Set<ExecutionVertexID> executionVertices) |
protected void |
SchedulerBase.transitionToScheduled(List<ExecutionVertexID> verticesToDeploy) |
| Modifier and Type | Method and Description |
|---|---|
boolean |
DefaultSchedulingPipelinedRegion.contains(ExecutionVertexID vertexId) |
DefaultSchedulingPipelinedRegion |
DefaultExecutionTopology.getPipelinedRegionOfVertex(ExecutionVertexID vertexId) |
org.apache.flink.runtime.scheduler.adapter.DefaultExecutionVertex |
DefaultExecutionTopology.getVertex(ExecutionVertexID executionVertexId) |
org.apache.flink.runtime.scheduler.adapter.DefaultExecutionVertex |
DefaultSchedulingPipelinedRegion.getVertex(ExecutionVertexID vertexId) |
| Modifier and Type | Method and Description |
|---|---|
LogicalSlot |
ReservedSlots.getSlotFor(ExecutionVertexID executionVertexId) |
| Modifier and Type | Method and Description |
|---|---|
static ReservedSlots |
ReservedSlots.create(Map<ExecutionVertexID,LogicalSlot> assignedSlots) |
| Modifier and Type | Method and Description |
|---|---|
Set<ExecutionVertexID> |
BatchJobRecoveryContext.getTasksNeedingRestart(ExecutionVertexID vertexId,
boolean considerResultConsumable)
Retrieves a set of vertices that need to be restarted.
|
| Modifier and Type | Method and Description |
|---|---|
Set<ExecutionVertexID> |
BatchJobRecoveryContext.getTasksNeedingRestart(ExecutionVertexID vertexId,
boolean considerResultConsumable)
Retrieves a set of vertices that need to be restarted.
|
void |
BatchJobRecoveryHandler.onExecutionFinished(ExecutionVertexID executionVertexId)
Records the execution vertex finished event for use during future batch job recovery.
|
void |
DummyBatchJobRecoveryHandler.onExecutionFinished(ExecutionVertexID executionVertexId) |
void |
DefaultBatchJobRecoveryHandler.onExecutionFinished(ExecutionVertexID executionVertexId) |
protected void |
AdaptiveBatchScheduler.resetForNewExecution(ExecutionVertexID executionVertexId) |
void |
DefaultSpeculativeExecutionHandler.resetForNewExecution(ExecutionVertexID executionVertexId) |
void |
DummySpeculativeExecutionHandler.resetForNewExecution(ExecutionVertexID executionVertexId) |
void |
SpeculativeExecutionHandler.resetForNewExecution(ExecutionVertexID executionVertexId)
Resets the state of the component for a new execution of a specific execution vertex.
|
| Modifier and Type | Method and Description |
|---|---|
void |
AdaptiveBatchScheduler.allocateSlotsAndDeploy(List<ExecutionVertexID> verticesToDeploy) |
void |
DefaultSpeculativeExecutionHandler.notifySlowTasks(Map<ExecutionVertexID,Collection<ExecutionAttemptID>> slowTasks) |
void |
DefaultSpeculativeExecutionHandler.notifyTaskFinished(Execution execution,
Function<ExecutionVertexID,CompletableFuture<?>> cancelPendingExecutionsFunction) |
void |
DummySpeculativeExecutionHandler.notifyTaskFinished(Execution execution,
Function<ExecutionVertexID,CompletableFuture<?>> cancelPendingExecutionsFunction) |
void |
SpeculativeExecutionHandler.notifyTaskFinished(Execution execution,
Function<ExecutionVertexID,CompletableFuture<?>> cancelPendingExecutionsFunction)
Notifies that a task has finished its execution.
|
void |
BatchJobRecoveryHandler.onExecutionVertexReset(Collection<ExecutionVertexID> vertices)
Handles the reset event for a collection of execution vertices and records the event for use
during future batch job recovery.
|
void |
DummyBatchJobRecoveryHandler.onExecutionVertexReset(Collection<ExecutionVertexID> vertices) |
void |
DefaultBatchJobRecoveryHandler.onExecutionVertexReset(Collection<ExecutionVertexID> vertices) |
protected void |
AdaptiveBatchScheduler.resetForNewExecutions(Collection<ExecutionVertexID> vertices) |
void |
BatchJobRecoveryContext.resetVerticesInRecovering(Set<ExecutionVertexID> verticesToReset)
Resets vertices specified by their IDs during recovery process.
|
| Constructor and Description |
|---|
DefaultSpeculativeExecutionHandler(org.apache.flink.configuration.Configuration jobMasterConfiguration,
BlocklistOperations blocklistOperations,
Function<ExecutionVertexID,ExecutionVertex> executionVertexRetriever,
Supplier<Map<ExecutionAttemptID,Execution>> registerExecutionsSupplier,
BiConsumer<List<Execution>,Collection<ExecutionVertexID>> allocateSlotsAndDeployFunction,
org.slf4j.Logger log) |
DefaultSpeculativeExecutionHandler(org.apache.flink.configuration.Configuration jobMasterConfiguration,
BlocklistOperations blocklistOperations,
Function<ExecutionVertexID,ExecutionVertex> executionVertexRetriever,
Supplier<Map<ExecutionAttemptID,Execution>> registerExecutionsSupplier,
BiConsumer<List<Execution>,Collection<ExecutionVertexID>> allocateSlotsAndDeployFunction,
org.slf4j.Logger log) |
| Modifier and Type | Method and Description |
|---|---|
static FailureHandlingResultSnapshot |
FailureHandlingResultSnapshot.create(FailureHandlingResult failureHandlingResult,
Function<ExecutionVertexID,Collection<Execution>> currentExecutionsLookup)
Creates a
FailureHandlingResultSnapshot based on the passed FailureHandlingResult and ExecutionVertices. |
| Modifier and Type | Method and Description |
|---|---|
void |
SlowTaskDetectorListener.notifySlowTasks(Map<ExecutionVertexID,Collection<ExecutionAttemptID>> slowTasks)
Notify detected slow tasks.
|
| Modifier and Type | Method and Description |
|---|---|
static ExecutionVertexID |
ExecutionVertexID.fromByteBuf(org.apache.flink.shaded.netty4.io.netty.buffer.ByteBuf buf) |
ExecutionVertexID |
ConsumerVertexGroup.getFirst() |
| Modifier and Type | Method and Description |
|---|---|
Iterator<ExecutionVertexID> |
ConsumerVertexGroup.iterator() |
| Modifier and Type | Method and Description |
|---|---|
static ConsumerVertexGroup |
ConsumerVertexGroup.fromSingleVertex(ExecutionVertexID vertex,
ResultPartitionType resultPartitionType) |
SchedulingExecutionVertex |
SchedulingTopology.getVertex(ExecutionVertexID executionVertexId)
Looks up the
SchedulingExecutionVertex for the given ExecutionVertexID. |
void |
VertexwiseSchedulingStrategy.onExecutionStateChange(ExecutionVertexID executionVertexId,
ExecutionState executionState) |
void |
PipelinedRegionSchedulingStrategy.onExecutionStateChange(ExecutionVertexID executionVertexId,
ExecutionState executionState) |
void |
SchedulingStrategy.onExecutionStateChange(ExecutionVertexID executionVertexId,
ExecutionState executionState)
Called whenever an
Execution changes its state. |
| Modifier and Type | Method and Description |
|---|---|
InputConsumableDecider |
InputConsumableDecider.Factory.createInstance(SchedulingTopology schedulingTopology,
Function<ExecutionVertexID,Boolean> scheduledVertexRetriever) |
InputConsumableDecider |
AllFinishedInputConsumableDecider.Factory.createInstance(SchedulingTopology schedulingTopology,
Function<ExecutionVertexID,Boolean> scheduledVertexRetriever) |
InputConsumableDecider |
PartialFinishedInputConsumableDecider.Factory.createInstance(SchedulingTopology schedulingTopology,
Function<ExecutionVertexID,Boolean> scheduledVertexRetriever) |
InputConsumableDecider |
DefaultInputConsumableDecider.Factory.createInstance(SchedulingTopology schedulingTopology,
Function<ExecutionVertexID,Boolean> scheduledVertexRetriever) |
static ConsumerVertexGroup |
ConsumerVertexGroup.fromMultipleVertices(List<ExecutionVertexID> vertices,
ResultPartitionType resultPartitionType) |
boolean |
InputConsumableDecider.isInputConsumable(SchedulingExecutionVertex executionVertex,
Set<ExecutionVertexID> verticesToSchedule,
Map<ConsumedPartitionGroup,Boolean> consumableStatusCache)
Determining whether the input of an execution vertex is consumable.
|
boolean |
AllFinishedInputConsumableDecider.isInputConsumable(SchedulingExecutionVertex executionVertex,
Set<ExecutionVertexID> verticesToDeploy,
Map<ConsumedPartitionGroup,Boolean> consumableStatusCache) |
boolean |
PartialFinishedInputConsumableDecider.isInputConsumable(SchedulingExecutionVertex executionVertex,
Set<ExecutionVertexID> verticesToDeploy,
Map<ConsumedPartitionGroup,Boolean> consumableStatusCache) |
boolean |
DefaultInputConsumableDecider.isInputConsumable(SchedulingExecutionVertex executionVertex,
Set<ExecutionVertexID> verticesToSchedule,
Map<ConsumedPartitionGroup,Boolean> consumableStatusCache) |
void |
VertexwiseSchedulingStrategy.notifySchedulingTopologyUpdated(SchedulingTopology schedulingTopology,
List<ExecutionVertexID> newExecutionVertices) |
void |
VertexwiseSchedulingStrategy.restartTasks(Set<ExecutionVertexID> verticesToRestart) |
void |
PipelinedRegionSchedulingStrategy.restartTasks(Set<ExecutionVertexID> verticesToRestart) |
void |
SchedulingStrategy.restartTasks(Set<ExecutionVertexID> verticesToRestart)
Called whenever vertices need to be restarted (due to task failure).
|
Copyright © 2014–2025 The Apache Software Foundation. All rights reserved.