| Modifier and Type | Method and Description |
|---|---|
static DefaultExecutionGraph |
DefaultExecutionGraphBuilder.buildGraph(JobGraph jobGraph,
org.apache.flink.configuration.Configuration jobManagerConfig,
ScheduledExecutorService futureExecutor,
Executor ioExecutor,
ClassLoader classLoader,
CompletedCheckpointStore completedCheckpointStore,
CheckpointsCleaner checkpointsCleaner,
CheckpointIDCounter checkpointIdCounter,
org.apache.flink.api.common.time.Time rpcTimeout,
BlobWriter blobWriter,
org.slf4j.Logger log,
ShuffleMaster<?> shuffleMaster,
JobMasterPartitionTracker partitionTracker,
TaskDeploymentDescriptorFactory.PartitionLocationConstraint partitionLocationConstraint,
ExecutionDeploymentListener executionDeploymentListener,
ExecutionStateUpdateListener executionStateUpdateListener,
long initializationTimestamp,
VertexAttemptNumberStore vertexAttemptNumberStore,
VertexParallelismStore vertexParallelismStore,
Supplier<CheckpointStatsTracker> checkpointStatsTrackerFactory,
boolean isDynamicGraph,
ExecutionJobVertex.Factory executionJobVertexFactory,
MarkPartitionFinishedStrategy markPartitionFinishedStrategy,
boolean nonFinishedHybridPartitionShouldBeUnknown,
JobManagerJobMetricGroup jobManagerJobMetricGroup) |
static ArchivedExecutionGraph |
ArchivedExecutionGraph.createSparseArchivedExecutionGraphWithJobVertices(org.apache.flink.api.common.JobID jobId,
String jobName,
org.apache.flink.api.common.JobStatus jobStatus,
JobType jobType,
Throwable throwable,
JobCheckpointingSettings checkpointingSettings,
long initializationTimestamp,
Iterable<JobVertex> jobVertices,
VertexParallelismStore initialParallelismStore) |
| Constructor and Description |
|---|
DefaultExecutionGraph(JobType jobType,
JobInformation jobInformation,
ScheduledExecutorService futureExecutor,
Executor ioExecutor,
org.apache.flink.api.common.time.Time rpcTimeout,
int executionHistorySizeLimit,
ClassLoader userClassLoader,
BlobWriter blobWriter,
PartitionGroupReleaseStrategy.Factory partitionGroupReleaseStrategyFactory,
ShuffleMaster<?> shuffleMaster,
JobMasterPartitionTracker partitionTracker,
ExecutionDeploymentListener executionDeploymentListener,
ExecutionStateUpdateListener executionStateUpdateListener,
long initializationTimestamp,
VertexAttemptNumberStore initialAttemptCounts,
VertexParallelismStore vertexParallelismStore,
boolean isDynamic,
ExecutionJobVertex.Factory executionJobVertexFactory,
List<org.apache.flink.core.execution.JobStatusHook> jobStatusHooks,
MarkPartitionFinishedStrategy markPartitionFinishedStrategy,
TaskDeploymentDescriptorFactory taskDeploymentDescriptorFactory) |
| Modifier and Type | Interface and Description |
|---|---|
interface |
MutableVertexParallelismStore
Mutability extension to the
VertexParallelismStore. |
| Modifier and Type | Class and Description |
|---|---|
class |
DefaultVertexParallelismStore
Maintains the configured parallelisms for vertices, which should be defined by a scheduler.
|
| Modifier and Type | Method and Description |
|---|---|
static VertexParallelismStore |
SchedulerBase.computeVertexParallelismStore(Iterable<JobVertex> vertices)
Compute the
VertexParallelismStore for all given vertices, which will set defaults
and ensure that the returned store contains valid parallelisms. |
static VertexParallelismStore |
SchedulerBase.computeVertexParallelismStore(Iterable<JobVertex> vertices,
Function<JobVertex,Integer> defaultMaxParallelismFunc) |
static VertexParallelismStore |
SchedulerBase.computeVertexParallelismStore(Iterable<JobVertex> vertices,
Function<JobVertex,Integer> defaultMaxParallelismFunc,
Function<Integer,Integer> normalizeParallelismFunc)
Compute the
VertexParallelismStore for all given vertices, which will set defaults
and ensure that the returned store contains valid parallelisms, with a custom function for
default max parallelism calculation and a custom function for normalizing vertex parallelism. |
static VertexParallelismStore |
SchedulerBase.computeVertexParallelismStore(JobGraph jobGraph)
Compute the
VertexParallelismStore for all vertices of a given job graph, which will
set defaults and ensure that the returned store contains valid parallelisms. |
| Modifier and Type | Method and Description |
|---|---|
static Optional<VertexParallelismStore> |
DefaultVertexParallelismStore.applyJobResourceRequirements(VertexParallelismStore oldVertexParallelismStore,
JobResourceRequirements jobResourceRequirements)
Create a new
VertexParallelismStore that reflects given JobResourceRequirements. |
| Modifier and Type | Method and Description |
|---|---|
static Optional<VertexParallelismStore> |
DefaultVertexParallelismStore.applyJobResourceRequirements(VertexParallelismStore oldVertexParallelismStore,
JobResourceRequirements jobResourceRequirements)
Create a new
VertexParallelismStore that reflects given JobResourceRequirements. |
ExecutionGraph |
ExecutionGraphFactory.createAndRestoreExecutionGraph(JobGraph jobGraph,
CompletedCheckpointStore completedCheckpointStore,
CheckpointsCleaner checkpointsCleaner,
CheckpointIDCounter checkpointIdCounter,
TaskDeploymentDescriptorFactory.PartitionLocationConstraint partitionLocationConstraint,
long initializationTimestamp,
VertexAttemptNumberStore vertexAttemptNumberStore,
VertexParallelismStore vertexParallelismStore,
ExecutionStateUpdateListener executionStateUpdateListener,
MarkPartitionFinishedStrategy markPartitionFinishedStrategy,
org.slf4j.Logger log)
Create and restore
ExecutionGraph from the given JobGraph and services. |
ExecutionGraph |
DefaultExecutionGraphFactory.createAndRestoreExecutionGraph(JobGraph jobGraph,
CompletedCheckpointStore completedCheckpointStore,
CheckpointsCleaner checkpointsCleaner,
CheckpointIDCounter checkpointIdCounter,
TaskDeploymentDescriptorFactory.PartitionLocationConstraint partitionLocationConstraint,
long initializationTimestamp,
VertexAttemptNumberStore vertexAttemptNumberStore,
VertexParallelismStore vertexParallelismStore,
ExecutionStateUpdateListener executionStateUpdateListener,
MarkPartitionFinishedStrategy markPartitionFinishedStrategy,
org.slf4j.Logger log) |
| Constructor and Description |
|---|
DefaultScheduler(org.slf4j.Logger log,
JobGraph jobGraph,
Executor ioExecutor,
org.apache.flink.configuration.Configuration jobMasterConfiguration,
Consumer<org.apache.flink.runtime.concurrent.ComponentMainThreadExecutor> startUpAction,
org.apache.flink.util.concurrent.ScheduledExecutor delayExecutor,
ClassLoader userCodeLoader,
CheckpointsCleaner checkpointsCleaner,
CheckpointRecoveryFactory checkpointRecoveryFactory,
JobManagerJobMetricGroup jobManagerJobMetricGroup,
SchedulingStrategyFactory schedulingStrategyFactory,
FailoverStrategy.Factory failoverStrategyFactory,
RestartBackoffTimeStrategy restartBackoffTimeStrategy,
ExecutionOperations executionOperations,
ExecutionVertexVersioner executionVertexVersioner,
ExecutionSlotAllocatorFactory executionSlotAllocatorFactory,
long initializationTimestamp,
org.apache.flink.runtime.concurrent.ComponentMainThreadExecutor mainThreadExecutor,
JobStatusListener jobStatusListener,
Collection<org.apache.flink.core.failure.FailureEnricher> failureEnrichers,
ExecutionGraphFactory executionGraphFactory,
ShuffleMaster<?> shuffleMaster,
org.apache.flink.api.common.time.Time rpcTimeout,
VertexParallelismStore vertexParallelismStore,
ExecutionDeployer.Factory executionDeployerFactory) |
SchedulerBase(org.slf4j.Logger log,
JobGraph jobGraph,
Executor ioExecutor,
org.apache.flink.configuration.Configuration jobMasterConfiguration,
CheckpointsCleaner checkpointsCleaner,
CheckpointRecoveryFactory checkpointRecoveryFactory,
JobManagerJobMetricGroup jobManagerJobMetricGroup,
ExecutionVertexVersioner executionVertexVersioner,
long initializationTimestamp,
org.apache.flink.runtime.concurrent.ComponentMainThreadExecutor mainThreadExecutor,
JobStatusListener jobStatusListener,
ExecutionGraphFactory executionGraphFactory,
VertexParallelismStore vertexParallelismStore) |
| Modifier and Type | Method and Description |
|---|---|
VertexParallelismStore |
JobGraphJobInformation.getVertexParallelismStore() |
| Constructor and Description |
|---|
JobGraphJobInformation(JobGraph jobGraph,
VertexParallelismStore vertexParallelismStore) |
| Modifier and Type | Method and Description |
|---|---|
static VertexParallelismStore |
AdaptiveBatchScheduler.computeVertexParallelismStoreForDynamicGraph(Iterable<JobVertex> vertices,
int defaultMaxParallelism)
Compute the
VertexParallelismStore for all given vertices in a dynamic graph, which
will set defaults and ensure that the returned store contains valid parallelisms, with the
configured default max parallelism. |
Copyright © 2014–2025 The Apache Software Foundation. All rights reserved.