org.apache.flink.runtime.deployment

Class TaskDeploymentDescriptorFactory

java.lang.Object

org.apache.flink.runtime.deployment.TaskDeploymentDescriptorFactory

public class TaskDeploymentDescriptorFactory
extends Object

Factory of TaskDeploymentDescriptor to deploy Task from Execution.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	TaskDeploymentDescriptorFactory.PartitionLocationConstraint Defines whether the partition's location must be known at deployment time or can be unknown and, therefore, updated later.
static class	TaskDeploymentDescriptorFactory.ShuffleDescriptorAndIndex This class represents the shuffle descriptor with it index in ConsumedPartitionGroup.
static class	TaskDeploymentDescriptorFactory.ShuffleDescriptorGroup A set of shuffle descriptors that will be serialized together.

Field Summary

Fields

Modifier and Type	Field and Description
static org.apache.flink.configuration.ConfigOption<Integer>	OFFLOAD_SHUFFLE_DESCRIPTORS_THRESHOLD This is an expert option, that we do not want to expose in the documentation.

Constructor Summary

Constructors

Constructor and Description

TaskDeploymentDescriptorFactory(org.apache.flink.types.Either<org.apache.flink.util.SerializedValue<JobInformation>,PermanentBlobKey> jobInformationOrBlobKey, org.apache.flink.api.common.JobID jobID, TaskDeploymentDescriptorFactory.PartitionLocationConstraint partitionDeploymentConstraint, BlobWriter blobWriter, boolean nonFinishedHybridPartitionShouldBeUnknown, int offloadShuffleDescriptorsThreshold)

Method Summary

Modifier and Type	Method and Description
TaskDeploymentDescriptor	createDeploymentDescriptor(Execution execution, AllocationID allocationID, JobManagerTaskRestore taskRestore, Collection<ResultPartitionDeploymentDescriptor> producedPartitions)
static ShuffleDescriptor	getConsumedPartitionShuffleDescriptor(IntermediateResultPartition consumedPartition, TaskDeploymentDescriptorFactory.PartitionLocationConstraint partitionDeploymentConstraint, boolean nonFinishedHybridPartitionShouldBeUnknown)
TaskDeploymentDescriptor.MaybeOffloaded<JobInformation>	getSerializedJobInformation()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

OFFLOAD_SHUFFLE_DESCRIPTORS_THRESHOLD

@Experimental
public static final org.apache.flink.configuration.ConfigOption<Integer> OFFLOAD_SHUFFLE_DESCRIPTORS_THRESHOLD

This is an expert option, that we do not want to expose in the documentation. The default value is good enough for almost all cases

Constructor Detail

TaskDeploymentDescriptorFactory

public TaskDeploymentDescriptorFactory(org.apache.flink.types.Either<org.apache.flink.util.SerializedValue<JobInformation>,PermanentBlobKey> jobInformationOrBlobKey,
                                       org.apache.flink.api.common.JobID jobID,
                                       TaskDeploymentDescriptorFactory.PartitionLocationConstraint partitionDeploymentConstraint,
                                       BlobWriter blobWriter,
                                       boolean nonFinishedHybridPartitionShouldBeUnknown,
                                       int offloadShuffleDescriptorsThreshold)

Method Detail

getSerializedJobInformation

public TaskDeploymentDescriptor.MaybeOffloaded<JobInformation> getSerializedJobInformation()

createDeploymentDescriptor

public TaskDeploymentDescriptor createDeploymentDescriptor(Execution execution,
                                                           AllocationID allocationID,
                                                           @Nullable
                                                           JobManagerTaskRestore taskRestore,
                                                           Collection<ResultPartitionDeploymentDescriptor> producedPartitions)
                                                    throws IOException,
                                                           ClusterDatasetCorruptedException

Throws:

IOException

ClusterDatasetCorruptedException

getConsumedPartitionShuffleDescriptor

public static ShuffleDescriptor getConsumedPartitionShuffleDescriptor(IntermediateResultPartition consumedPartition,
                                                                      TaskDeploymentDescriptorFactory.PartitionLocationConstraint partitionDeploymentConstraint,
                                                                      boolean nonFinishedHybridPartitionShouldBeUnknown)