Package org.apache.flink.runtime.io.network.partition.hybrid.tiered.tier.remote

Class RemoteTierMasterAgent

java.lang.Object

org.apache.flink.runtime.io.network.partition.hybrid.tiered.tier.remote.RemoteTierMasterAgent

All Implemented Interfaces:

TierMasterAgent

public class RemoteTierMasterAgent
extends Object
implements TierMasterAgent

The implementation of TierMasterAgent for the remote tier.

Method Summary

Modifier and Type	Method	Description
TierShuffleDescriptor	addPartitionAndGetShuffleDescriptor(org.apache.flink.api.common.JobID jobID, int numSubpartitions, ResultPartitionID resultPartitionID)	Add a new tiered storage partition and get the TierShuffleDescriptor.
void	close()	Close this tier master agent.
CompletableFuture<Map<ResultPartitionID,ShuffleMetrics>>	getPartitionWithMetrics(org.apache.flink.api.common.JobID jobId, Duration timeout, Set<ResultPartitionID> expectedPartitions)	Retrieves specified partitions and their metrics (identified by expectedPartitions), the metrics include sizes of sub-partitions in a result partition.
boolean	partitionInRemote()	Is this tier manage the partition in remote cluster instead of flink taskmanager.
void	registerJob(org.apache.flink.api.common.JobID jobID, TierShuffleHandler tierShuffleHandler)	Register a job id with a TierShuffleHandler.
void	releasePartition(TierShuffleDescriptor shuffleDescriptor)	Release a tiered storage partition.
void	unregisterJob(org.apache.flink.api.common.JobID jobID)	Unregister a job id.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.flink.runtime.io.network.partition.hybrid.tiered.tier.TierMasterAgent

restoreState, restoreState, snapshotState, snapshotState

Method Detail

registerJob

public void registerJob(org.apache.flink.api.common.JobID jobID,
                        TierShuffleHandler tierShuffleHandler)

Description copied from interface: TierMasterAgent

Register a job id with a TierShuffleHandler.

Specified by:

registerJob in interface TierMasterAgent

unregisterJob

public void unregisterJob(org.apache.flink.api.common.JobID jobID)

Description copied from interface: TierMasterAgent

Unregister a job id.

Specified by:

unregisterJob in interface TierMasterAgent

addPartitionAndGetShuffleDescriptor

public TierShuffleDescriptor addPartitionAndGetShuffleDescriptor(org.apache.flink.api.common.JobID jobID,
                                                                 int numSubpartitions,
                                                                 ResultPartitionID resultPartitionID)

Description copied from interface: TierMasterAgent

Add a new tiered storage partition and get the TierShuffleDescriptor.

Specified by:

addPartitionAndGetShuffleDescriptor in interface TierMasterAgent

getPartitionWithMetrics

public CompletableFuture<Map<ResultPartitionID,ShuffleMetrics>> getPartitionWithMetrics(org.apache.flink.api.common.JobID jobId,
                                                                                              Duration timeout,
                                                                                              Set<ResultPartitionID> expectedPartitions)

Description copied from interface: TierMasterAgent

Retrieves specified partitions and their metrics (identified by expectedPartitions), the metrics include sizes of sub-partitions in a result partition.

Specified by:

getPartitionWithMetrics in interface TierMasterAgent

Parameters:

jobId - ID of the target job

timeout - The timeout used for retrieve the specified partitions.

expectedPartitions - The set of identifiers for the result partitions whose metrics are to be fetched.

Returns:

A future will contain a map of the partitions with their metrics that could be retrieved from the expected partitions within the specified timeout period.

releasePartition

public void releasePartition(TierShuffleDescriptor shuffleDescriptor)

Description copied from interface: TierMasterAgent

Release a tiered storage partition.

Specified by:

releasePartition in interface TierMasterAgent

Parameters:

shuffleDescriptor - the partition shuffle descriptor to be released

close

public void close()

Description copied from interface: TierMasterAgent

Close this tier master agent.

Specified by:

close in interface TierMasterAgent

partitionInRemote

public boolean partitionInRemote()

Description copied from interface: TierMasterAgent

Is this tier manage the partition in remote cluster instead of flink taskmanager.

Specified by:

partitionInRemote in interface TierMasterAgent