Package org.apache.beam.runners.spark.translation.streaming

Class CreateStreamingSparkView<ElemT,ViewT>

java.lang.Object
org.apache.beam.sdk.transforms.PTransform<org.apache.beam.sdk.values.PCollection<ElemT>,org.apache.beam.sdk.values.PCollection<ElemT>>
org.apache.beam.runners.spark.translation.streaming.CreateStreamingSparkView<ElemT,ViewT>
All Implemented Interfaces:
Serializable, org.apache.beam.sdk.transforms.display.HasDisplayData
public class CreateStreamingSparkView<ElemT,ViewT> extends org.apache.beam.sdk.transforms.PTransform<org.apache.beam.sdk.values.PCollection<ElemT>,org.apache.beam.sdk.values.PCollection<ElemT>>
Spark streaming overrides for various view (side input) transforms.
See Also:

  • Nested Class Summary

    Nested Classes
    Modifier and Type
    Class
    Description
    static class 
    CreateStreamingSparkView.CreateSparkPCollectionView<ElemT,ViewT>
    Creates a primitive PCollectionView.
    static class 
    CreateStreamingSparkView.Factory<ElemT,ViewT>
     

  • Field Summary

    Fields
    Modifier and Type
    Field
    Description
    static final String
    CREATE_STREAMING_SPARK_VIEW_URN
     

    Fields inherited from class org.apache.beam.sdk.transforms.PTransform

    annotations, displayData, name, resourceHints

  • Constructor Summary

    Constructors
    Constructor
    Description
    CreateStreamingSparkView(org.apache.beam.sdk.values.PCollectionView<ViewT> view)
     

  • Method Summary

    Modifier and Type
    Method
    Description
    org.apache.beam.sdk.values.PCollection<ElemT>
    expand(org.apache.beam.sdk.values.PCollection<ElemT> input)
     

    Methods inherited from class org.apache.beam.sdk.transforms.PTransform

    addAnnotation, compose, compose, getAdditionalInputs, getAnnotations, getDefaultOutputCoder, getDefaultOutputCoder, getDefaultOutputCoder, getKindString, getName, getResourceHints, populateDisplayData, setDisplayData, setResourceHints, toString, validate, validate

    Methods inherited from class java.lang.Object

    clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

  • Field Details

  • Constructor Details

    • CreateStreamingSparkView

      public CreateStreamingSparkView(org.apache.beam.sdk.values.PCollectionView<ViewT> view)

  • Method Details

    • expand

      public org.apache.beam.sdk.values.PCollection<ElemT> expand(org.apache.beam.sdk.values.PCollection<ElemT> input)
      Specified by:
      expand in class org.apache.beam.sdk.transforms.PTransform<org.apache.beam.sdk.values.PCollection<ElemT>,org.apache.beam.sdk.values.PCollection<ElemT>>