Package org.apache.beam.runners.spark.translation

Interface SparkPipelineTranslator

All Known Implementing Classes:
StreamingTransformTranslator.Translator, TransformTranslator.Translator
public interface SparkPipelineTranslator
Translator to support translation between Beam transformations and Spark transformations.

  • Method Summary

    Modifier and Type
    Method
    Description
    boolean
    hasTranslation(org.apache.beam.sdk.transforms.PTransform<?,?> transform)
     
    <TransformT extends org.apache.beam.sdk.transforms.PTransform<?, ?>>
    TransformEvaluator<TransformT>
    translateBounded(org.apache.beam.sdk.transforms.PTransform<?,?> transform)
     
    <TransformT extends org.apache.beam.sdk.transforms.PTransform<?, ?>>
    TransformEvaluator<TransformT>
    translateUnbounded(org.apache.beam.sdk.transforms.PTransform<?,?> transform)
     

  • Method Details

    • hasTranslation

      boolean hasTranslation(org.apache.beam.sdk.transforms.PTransform<?,?> transform)

    • translateBounded

      <TransformT extends org.apache.beam.sdk.transforms.PTransform<?, ?>> TransformEvaluator<TransformT> translateBounded(org.apache.beam.sdk.transforms.PTransform<?,?> transform)

    • translateUnbounded

      <TransformT extends org.apache.beam.sdk.transforms.PTransform<?, ?>> TransformEvaluator<TransformT> translateUnbounded(org.apache.beam.sdk.transforms.PTransform<?,?> transform)