Package org.apache.beam.runners.spark.structuredstreaming.translation.batch.functions

Class GroupAlsoByWindowViaOutputBufferFn<K,InputT,W extends org.apache.beam.sdk.transforms.windowing.BoundedWindow>

java.lang.Object

org.apache.beam.runners.spark.structuredstreaming.translation.batch.functions.GroupAlsoByWindowViaOutputBufferFn<K,InputT,W>

All Implemented Interfaces:

Serializable, org.apache.spark.api.java.function.FlatMapGroupsFunction<K,org.apache.beam.sdk.values.WindowedValue<org.apache.beam.sdk.values.KV<K,InputT>>,org.apache.beam.sdk.values.WindowedValue<org.apache.beam.sdk.values.KV<K,Iterable<InputT>>>>

public class GroupAlsoByWindowViaOutputBufferFn<K,InputT,W extends org.apache.beam.sdk.transforms.windowing.BoundedWindow>
extends Object
implements org.apache.spark.api.java.function.FlatMapGroupsFunction<K,org.apache.beam.sdk.values.WindowedValue<org.apache.beam.sdk.values.KV<K,InputT>>,org.apache.beam.sdk.values.WindowedValue<org.apache.beam.sdk.values.KV<K,Iterable<InputT>>>>

A FlatMap function that groups by windows in batch mode using ReduceFnRunner.

See Also:

• Serialized Form

Constructor Summary

Constructors

Constructor	Description
GroupAlsoByWindowViaOutputBufferFn(org.apache.beam.sdk.values.WindowingStrategy<?,W> windowingStrategy, org.apache.beam.runners.core.StateInternalsFactory<K> stateInternalsFactory, org.apache.beam.runners.core.SystemReduceFn<K,InputT,Iterable<InputT>,Iterable<InputT>,W> reduceFn, Supplier<org.apache.beam.sdk.options.PipelineOptions> options)

Method Summary

Modifier and Type	Method	Description
Iterator<org.apache.beam.sdk.values.WindowedValue<org.apache.beam.sdk.values.KV<K,Iterable<InputT>>>>	call(K key, Iterator<org.apache.beam.sdk.values.WindowedValue<org.apache.beam.sdk.values.KV<K,InputT>>> iterator)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

GroupAlsoByWindowViaOutputBufferFn

public GroupAlsoByWindowViaOutputBufferFn(org.apache.beam.sdk.values.WindowingStrategy<?,W> windowingStrategy,
 org.apache.beam.runners.core.StateInternalsFactory<K> stateInternalsFactory,
 org.apache.beam.runners.core.SystemReduceFn<K,InputT,Iterable<InputT>,Iterable<InputT>,W> reduceFn,
 Supplier<org.apache.beam.sdk.options.PipelineOptions> options)

Method Details

call

public Iterator<org.apache.beam.sdk.values.WindowedValue<org.apache.beam.sdk.values.KV<K,Iterable<InputT>>>> call(K key,
 Iterator<org.apache.beam.sdk.values.WindowedValue<org.apache.beam.sdk.values.KV<K,InputT>>> iterator)
                                                                                                           throws Exception

Specified by:

call in interface org.apache.spark.api.java.function.FlatMapGroupsFunction<K,InputT,W extends org.apache.beam.sdk.transforms.windowing.BoundedWindow>

Throws:

Exception