Package org.apache.beam.runners.spark.translation

Class SideInputMetadata

java.lang.Object

org.apache.beam.runners.spark.translation.SideInputMetadata

All Implemented Interfaces:

java.io.Serializable

public class SideInputMetadata
extends java.lang.Object
implements java.io.Serializable

Metadata class for side inputs in Spark runner. Contains serialized data, type information and coder for side input processing.

See Also:

Serialized Form

Method Summary

Modifier and Type	Method	Description
static SideInputMetadata	create(byte[] data, SparkPCollectionView.Type type, org.apache.beam.sdk.coders.Coder<java.lang.Iterable<org.apache.beam.sdk.values.WindowedValue<?>>> coder)	Creates a new instance of SideInputMetadata.
SideInputBroadcast	toSideInputBroadcast()	Converts this metadata to a SideInputBroadcast instance.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Detail

create

public static SideInputMetadata create(byte[] data,
                                       SparkPCollectionView.Type type,
                                       org.apache.beam.sdk.coders.Coder<java.lang.Iterable<org.apache.beam.sdk.values.WindowedValue<?>>> coder)

Creates a new instance of SideInputMetadata.

Parameters:

data - The serialized side input data as byte array

type - The type of the SparkPCollectionView

coder - The coder for iterables of windowed values

Returns:

A new SideInputMetadata instance

toSideInputBroadcast

public SideInputBroadcast toSideInputBroadcast()

Converts this metadata to a SideInputBroadcast instance.

Returns:

A new SideInputBroadcast instance created from this metadata