Package org.apache.beam.runners.spark.translation

Class TranslationUtils.CombineGroupedValues<K,InputT,OutputT>

java.lang.Object

org.apache.beam.runners.spark.translation.TranslationUtils.CombineGroupedValues<K,InputT,OutputT>

Type Parameters:

K - Grouped key type.

InputT - Grouped values type.

OutputT - Output type.

All Implemented Interfaces:

Serializable, org.apache.spark.api.java.function.Function<org.apache.beam.sdk.values.WindowedValue<org.apache.beam.sdk.values.KV<K,Iterable<InputT>>>,org.apache.beam.sdk.values.WindowedValue<org.apache.beam.sdk.values.KV<K,OutputT>>>

Enclosing class:

TranslationUtils

public static class TranslationUtils.CombineGroupedValues<K,InputT,OutputT>
extends Object
implements org.apache.spark.api.java.function.Function<org.apache.beam.sdk.values.WindowedValue<org.apache.beam.sdk.values.KV<K,Iterable<InputT>>>,org.apache.beam.sdk.values.WindowedValue<org.apache.beam.sdk.values.KV<K,OutputT>>>

A SparkCombineFn function applied to grouped KVs.

See Also:

• Serialized Form

Constructor Summary

Constructors

Constructor	Description
CombineGroupedValues(SparkCombineFn<org.apache.beam.sdk.values.KV<K,InputT>,InputT,?,OutputT> fn)

Method Summary

Modifier and Type	Method	Description
org.apache.beam.sdk.values.WindowedValue<org.apache.beam.sdk.values.KV<K,OutputT>>	call(org.apache.beam.sdk.values.WindowedValue<org.apache.beam.sdk.values.KV<K,Iterable<InputT>>> windowedKv)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

CombineGroupedValues

public CombineGroupedValues(SparkCombineFn<org.apache.beam.sdk.values.KV<K,InputT>,InputT,?,OutputT> fn)

Method Details

call

public org.apache.beam.sdk.values.WindowedValue<org.apache.beam.sdk.values.KV<K,OutputT>> call(org.apache.beam.sdk.values.WindowedValue<org.apache.beam.sdk.values.KV<K,Iterable<InputT>>> windowedKv)
                                                                                        throws Exception

Specified by:

call in interface org.apache.spark.api.java.function.Function<K,InputT>

Throws:

Exception