alluxio.master.job.plan

Class PlanTracker

java.lang.Object

alluxio.master.job.plan.PlanTracker

@ThreadSafe
public class PlanTracker
extends java.lang.Object

The PlanTracker is used to create, remove, and provide access to the set of currently scheduled or finished jobs. All modification of the status of jobs should occur within this class,

Constructor Summary

Constructors

Constructor and Description
PlanTracker(long capacity, long retentionMs, long maxJobPurgeCount, WorkflowTracker workflowTracker) Create a new instance of PlanTracker.

Method Summary

Modifier and Type	Method and Description
java.util.Collection<PlanCoordinator>	coordinators() A collection of all PlanCoordinator currently tracked by the job master.
java.util.stream.Stream<PlanInfo>	failed()
java.util.Set<java.lang.Long>	findJobs(java.lang.String name, java.util.List<Status> statusList)
PlanCoordinator	getCoordinator(long jobId) Gets a PlanCoordinator associated with the given job Id.
java.util.Collection<java.lang.Long>	list() A collection of all job Ids currently tracked in the job master.
void	run(PlanConfig jobConfig, CommandManager manager, JobServerContext ctx, java.util.List<WorkerInfo> workers, long jobId) Adds a job with the given JobConfig to the job tracker.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

PlanTracker

public PlanTracker(long capacity,
                   long retentionMs,
                   long maxJobPurgeCount,
                   WorkflowTracker workflowTracker)

Create a new instance of PlanTracker.

Parameters:

capacity - the capacity of jobs that can be handled

retentionMs - the minimum amount of time to retain jobs

maxJobPurgeCount - the max amount of jobs to purge when reaching max capacity

workflowTracker - the workflow tracker instance

Method Detail

getCoordinator

@Nullable
public PlanCoordinator getCoordinator(long jobId)

Gets a PlanCoordinator associated with the given job Id.

Parameters:

jobId - the job id associated with the PlanCoordinator

Returns:

The PlanCoordinator associated with the id, or null if there is no association

run

public void run(PlanConfig jobConfig,
                CommandManager manager,
                JobServerContext ctx,
                java.util.List<WorkerInfo> workers,
                long jobId)
         throws JobDoesNotExistException,
                ResourceExhaustedException

Adds a job with the given JobConfig to the job tracker.

Parameters:

jobConfig - configuration for the job

manager - command manager for jobs

ctx - the JobServerContext from the job master

workers - a list of available workers

jobId - job id of the newly added job

Throws:

JobDoesNotExistException - if the job type does not exist

ResourceExhaustedException - if there is no more space available in the job master

list

public java.util.Collection<java.lang.Long> list()

A collection of all job Ids currently tracked in the job master. Jobs may be in a finished state.

Returns:

An unmodifiable collection of all tracked Job Ids

coordinators

public java.util.Collection<PlanCoordinator> coordinators()

A collection of all PlanCoordinator currently tracked by the job master. May contain coordinators for jobs which have finished.

Returns:

An unmodifiable collection of all tracked PlanCoordinator

failed

public java.util.stream.Stream<PlanInfo> failed()

Returns:

list of failed plans

findJobs

public java.util.Set<java.lang.Long> findJobs(java.lang.String name,
                                              java.util.List<Status> statusList)

Parameters:

name - job name filter

statusList - status list filter

Returns:

job ids matching conditions