org.apache.gobblin.util

Class PublisherUtils

java.lang.Object

org.apache.gobblin.util.PublisherUtils

public class PublisherUtils
extends Object

Utility class for DataPublisher.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	PublisherUtils.SplitExtractsResult
static class	PublisherUtils.WorkUnitStateSuccess Implementation of Predicate that checks if a given WorkUnitState has a WorkUnitState.WorkingState equal to WorkUnitState.WorkingState.SUCCESSFUL.

Constructor Summary

Constructors

Constructor and Description
PublisherUtils()

Method Summary

Modifier and Type	Method and Description
static com.google.common.collect.Multimap<Extract,WorkUnitState>	createExtractToWorkUnitStateMap(Collection<? extends WorkUnitState> workUnitStates) Creates a Multimap that maps Extract to their corresponds WorkUnitStates.
static com.google.common.collect.Multimap<Extract,WorkUnitState>	getExtractsForPredicate(com.google.common.collect.Multimap<Extract,WorkUnitState> extractToWorkUnitStateMap, com.google.common.base.Predicate<WorkUnitState> predicate) Given a Multimap of Extracts to WorkUnitStates, filter out any Extracts where all of the corresponding WorkUnitStates do not meet the given Predicate.
static PublisherUtils.SplitExtractsResult	splitExtractsByPredicate(com.google.common.collect.Multimap<Extract,WorkUnitState> extractToWorkUnitStateMap, com.google.common.base.Predicate<WorkUnitState> predicate) Given a Multimap of Extracts to WorkUnitStates, filter out any Extracts where all of the corresponding WorkUnitStates do not meet the given Predicate.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

PublisherUtils

public PublisherUtils()

Method Detail

createExtractToWorkUnitStateMap

public static com.google.common.collect.Multimap<Extract,WorkUnitState> createExtractToWorkUnitStateMap(Collection<? extends WorkUnitState> workUnitStates)

Creates a Multimap that maps Extract to their corresponds WorkUnitStates.

See Also:

Multimap

getExtractsForPredicate

public static com.google.common.collect.Multimap<Extract,WorkUnitState> getExtractsForPredicate(com.google.common.collect.Multimap<Extract,WorkUnitState> extractToWorkUnitStateMap,
                                                                                                com.google.common.base.Predicate<WorkUnitState> predicate)

Given a Multimap of Extracts to WorkUnitStates, filter out any Extracts where all of the corresponding WorkUnitStates do not meet the given Predicate.

splitExtractsByPredicate

public static PublisherUtils.SplitExtractsResult splitExtractsByPredicate(com.google.common.collect.Multimap<Extract,WorkUnitState> extractToWorkUnitStateMap,
                                                                          com.google.common.base.Predicate<WorkUnitState> predicate)

Given a Multimap of Extracts to WorkUnitStates, filter out any Extracts where all of the corresponding WorkUnitStates do not meet the given Predicate.

• The filtered Extracts will be available in SplitExtractsResult#getFiltered()
• The Extracts satisfying the predicated will be available in SplitExtractsResult#getRetained()