Package org.apache.beam.sdk.extensions.ordered

Class OrderedEventProcessorResult<KeyT,ResultT,EventT>

java.lang.Object

org.apache.beam.sdk.extensions.ordered.OrderedEventProcessorResult<KeyT,ResultT,EventT>

Type Parameters:

KeyT -

ResultT -

All Implemented Interfaces:

org.apache.beam.sdk.values.POutput

public class OrderedEventProcessorResult<KeyT,ResultT,EventT>
extends java.lang.Object
implements org.apache.beam.sdk.values.POutput

The result of the ordered processing. Three PCollections are returned:

output - the key/value of the mutated states unprocessedEvents - the key/value of the events that failed to be processed and the failure reason processingStatuses - the key/value of the status of processing for a particular key

In case of global sequence processing, the result also contains PCollectionView of the latest contiguous sequence range

Method Summary

Modifier and Type	Method	Description
java.util.Map<org.apache.beam.sdk.values.TupleTag<?>,org.apache.beam.sdk.values.PValue>	expand()
void	finishSpecifyingOutput(java.lang.String transformName, org.apache.beam.sdk.values.PInput input, org.apache.beam.sdk.transforms.PTransform<?,?> transform)
org.apache.beam.sdk.Pipeline	getPipeline()
org.apache.beam.sdk.values.PCollectionView<java.lang.Iterable<ContiguousSequenceRange>>	latestContiguousRange()	Returns a view to a calculated side input with the last contiguous range.
org.apache.beam.sdk.values.PCollection<org.apache.beam.sdk.values.KV<KeyT,ResultT>>	output()	Returns processed states keyed by the original key.
org.apache.beam.sdk.values.PCollection<org.apache.beam.sdk.values.KV<KeyT,OrderedProcessingStatus>>	processingStatuses()	Returns processing status for a particular key.
org.apache.beam.sdk.values.PCollection<org.apache.beam.sdk.values.KV<KeyT,org.apache.beam.sdk.values.KV<java.lang.Long,UnprocessedEvent<EventT>>>>	unprocessedEvents()	Returns events which failed to process, including the reasons for failure.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Detail

getPipeline

public org.apache.beam.sdk.Pipeline getPipeline()

Specified by:

getPipeline in interface org.apache.beam.sdk.values.POutput

expand

public java.util.Map<org.apache.beam.sdk.values.TupleTag<?>,org.apache.beam.sdk.values.PValue> expand()

Specified by:

expand in interface org.apache.beam.sdk.values.POutput

finishSpecifyingOutput

public void finishSpecifyingOutput(java.lang.String transformName,
                                   org.apache.beam.sdk.values.PInput input,
                                   org.apache.beam.sdk.transforms.PTransform<?,?> transform)

Specified by:

finishSpecifyingOutput in interface org.apache.beam.sdk.values.POutput

processingStatuses

public org.apache.beam.sdk.values.PCollection<org.apache.beam.sdk.values.KV<KeyT,OrderedProcessingStatus>> processingStatuses()

Returns processing status for a particular key. The elements will have the timestamp of the instant the status was emitted.

output

public org.apache.beam.sdk.values.PCollection<org.apache.beam.sdk.values.KV<KeyT,ResultT>> output()

Returns processed states keyed by the original key.

unprocessedEvents

public org.apache.beam.sdk.values.PCollection<org.apache.beam.sdk.values.KV<KeyT,org.apache.beam.sdk.values.KV<java.lang.Long,UnprocessedEvent<EventT>>>> unprocessedEvents()

Returns events which failed to process, including the reasons for failure.

latestContiguousRange

@Nullable
public org.apache.beam.sdk.values.PCollectionView<java.lang.Iterable<ContiguousSequenceRange>> latestContiguousRange()

Returns a view to a calculated side input with the last contiguous range. Note: an iterator is returned instead of a single value. Use ContiguousSequenceRange.largestRange(Iterable) to get the largest range.