Package org.apache.beam.runners.spark.translation

Class BoundedDataset<T>

java.lang.Object

org.apache.beam.runners.spark.translation.BoundedDataset<T>

All Implemented Interfaces:

Serializable, Dataset

public class BoundedDataset<T>
extends Object
implements Dataset

Holds an RDD or values for deferred conversion to an RDD if needed. PCollections are sometimes created from a collection of objects (using RDD parallelize) and then only used to create View objects; in which case they do not need to be converted to bytes since they are not transferred across the network until they are broadcast.

See Also:

• Serialized Form

Method Summary

Modifier and Type	Method	Description
void	action()
void	cache(String storageLevel, org.apache.beam.sdk.coders.Coder<?> coder)
org.apache.spark.api.java.JavaRDD<org.apache.beam.sdk.values.WindowedValue<T>>	getRDD()
void	setName(String name)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Details

getRDD

public org.apache.spark.api.java.JavaRDD<org.apache.beam.sdk.values.WindowedValue<T>> getRDD()

cache

public void cache(String storageLevel,
 org.apache.beam.sdk.coders.Coder<?> coder)

Specified by:

cache in interface Dataset

action

public void action()

Specified by:

action in interface Dataset

setName

public void setName(String name)

Specified by:

setName in interface Dataset