Package org.apache.beam.runners.spark.util

Class SparkSideInputReader

java.lang.Object
org.apache.beam.runners.spark.util.SparkSideInputReader
All Implemented Interfaces:
org.apache.beam.runners.core.SideInputReader
public class SparkSideInputReader extends Object implements org.apache.beam.runners.core.SideInputReader
A SideInputReader for the SparkRunner.

  • Constructor Summary

    Constructors
    Constructor
    Description
    SparkSideInputReader(Map<org.apache.beam.sdk.values.TupleTag<?>,org.apache.beam.sdk.values.KV<org.apache.beam.sdk.values.WindowingStrategy<?,?>,SideInputBroadcast<?>>> sideInputs)
     

  • Method Summary

    Modifier and Type
    Method
    Description
    <T> boolean
    contains(org.apache.beam.sdk.values.PCollectionView<T> view)
     
    <T> @Nullable T
    get(org.apache.beam.sdk.values.PCollectionView<T> view, org.apache.beam.sdk.transforms.windowing.BoundedWindow window)
     
    boolean
    isEmpty()
     

    Methods inherited from class java.lang.Object

    clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

  • Constructor Details

    • SparkSideInputReader

      public SparkSideInputReader(Map<org.apache.beam.sdk.values.TupleTag<?>,org.apache.beam.sdk.values.KV<org.apache.beam.sdk.values.WindowingStrategy<?,?>,SideInputBroadcast<?>>> sideInputs)

  • Method Details

    • get

      public <T> @Nullable T get(org.apache.beam.sdk.values.PCollectionView<T> view, org.apache.beam.sdk.transforms.windowing.BoundedWindow window)
      Specified by:
      get in interface org.apache.beam.runners.core.SideInputReader

    • contains

      public <T> boolean contains(org.apache.beam.sdk.values.PCollectionView<T> view)
      Specified by:
      contains in interface org.apache.beam.runners.core.SideInputReader

    • isEmpty

      public boolean isEmpty()
      Specified by:
      isEmpty in interface org.apache.beam.runners.core.SideInputReader