Package org.apache.beam.runners.spark.translation

Class SideInputMetadata

java.lang.Object

org.apache.beam.runners.spark.translation.SideInputMetadata

All Implemented Interfaces:

Serializable

public class SideInputMetadata
extends Object
implements Serializable

Metadata class for side inputs in Spark runner. Contains serialized data, type information and coder for side input processing.

See Also:

• Serialized Form

Method Summary

Modifier and Type	Method	Description
static SideInputMetadata	create(byte[] data, SparkPCollectionView.Type type, org.apache.beam.sdk.coders.Coder<Iterable<org.apache.beam.sdk.values.WindowedValue<?>>> coder)	Creates a new instance of SideInputMetadata.
SideInputBroadcast	toSideInputBroadcast()	Converts this metadata to a SideInputBroadcast instance.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Details

create

public static SideInputMetadata create(byte[] data,
 SparkPCollectionView.Type type,
 org.apache.beam.sdk.coders.Coder<Iterable<org.apache.beam.sdk.values.WindowedValue<?>>> coder)

Creates a new instance of SideInputMetadata.

Parameters:

data - The serialized side input data as byte array

type - The type of the SparkPCollectionView

coder - The coder for iterables of windowed values

Returns:

A new SideInputMetadata instance

toSideInputBroadcast

public SideInputBroadcast toSideInputBroadcast()

Converts this metadata to a SideInputBroadcast instance.

Returns:

A new SideInputBroadcast instance created from this metadata