Package org.apache.beam.runners.spark.translation.streaming

Class UnboundedDataset<T>

java.lang.Object
org.apache.beam.runners.spark.translation.streaming.UnboundedDataset<T>
All Implemented Interfaces:
Serializable, Dataset
public class UnboundedDataset<T> extends Object implements Dataset
DStream holder Can also crate a DStream from a supplied queue of values, but mainly for testing.
See Also:

  • Constructor Details

    • UnboundedDataset

      public UnboundedDataset(org.apache.spark.streaming.api.java.JavaDStream<org.apache.beam.sdk.values.WindowedValue<T>> dStream, List<Integer> streamSources)

  • Method Details

    • getDStream

      public org.apache.spark.streaming.api.java.JavaDStream<org.apache.beam.sdk.values.WindowedValue<T>> getDStream()

    • getStreamSources

      public List<Integer> getStreamSources()

    • cache

      public void cache(String storageLevel, org.apache.beam.sdk.coders.Coder<?> coder)
      Specified by:
      cache in interface Dataset

    • action

      public void action()
      Specified by:
      action in interface Dataset

    • setName

      public void setName(String name)
      Specified by:
      setName in interface Dataset