org.apache.flink.runtime.scheduler.adaptivebatch

Interface VertexParallelismAndInputInfosDecider

All Known Implementing Classes:

DefaultVertexParallelismAndInputInfosDecider

public interface VertexParallelismAndInputInfosDecider

VertexParallelismAndInputInfosDecider is responsible for deciding the parallelism and JobVertexInputInfos of a job vertex, based on the information of the consumed blocking results.

Method Summary

Modifier and Type	Method and Description
int	computeSourceParallelismUpperBound(JobVertexID jobVertexId, int maxParallelism) Compute source parallelism upper bound for the source vertex.
ParallelismAndInputInfos	decideParallelismAndInputInfosForVertex(JobVertexID jobVertexId, List<BlockingResultInfo> consumedResults, int vertexInitialParallelism, int vertexMinParallelism, int vertexMaxParallelism) Decide the parallelism and JobVertexInputInfos for this job vertex.
long	getDataVolumePerTask() Get the average size of data volume to expect each task instance to process.

Method Detail

decideParallelismAndInputInfosForVertex

ParallelismAndInputInfos decideParallelismAndInputInfosForVertex(JobVertexID jobVertexId,
                                                                 List<BlockingResultInfo> consumedResults,
                                                                 int vertexInitialParallelism,
                                                                 int vertexMinParallelism,
                                                                 int vertexMaxParallelism)

Decide the parallelism and JobVertexInputInfos for this job vertex.

Parameters:

jobVertexId - The job vertex id

consumedResults - The information of consumed blocking results

vertexInitialParallelism - The initial parallelism of the job vertex. If it's a positive number, it will be respected. If it's not set(equals to ExecutionConfig.PARALLELISM_DEFAULT), a parallelism will be automatically decided for the vertex.

vertexMinParallelism - The min parallelism of the job vertex.

vertexMaxParallelism - The max parallelism of the job vertex.

Returns:

the parallelism and vertex input infos.

computeSourceParallelismUpperBound

int computeSourceParallelismUpperBound(JobVertexID jobVertexId,
                                       int maxParallelism)

Compute source parallelism upper bound for the source vertex.

Parameters:

jobVertexId - The job vertex id

maxParallelism - The max parallelism of the job vertex.

Returns:

the upper bound parallelism for the source vertex.

getDataVolumePerTask

long getDataVolumePerTask()

Get the average size of data volume to expect each task instance to process.

Returns:

the data volume.