Package org.apache.beam.runners.spark.structuredstreaming.translation.batch

Class PipelineTranslatorBatch

java.lang.Object

org.apache.beam.runners.spark.structuredstreaming.translation.PipelineTranslator

org.apache.beam.runners.spark.structuredstreaming.translation.batch.PipelineTranslatorBatch

@Internal
public class PipelineTranslatorBatch
extends PipelineTranslator

PipelineTranslator for executing a Pipeline in Spark in batch mode. This contains only the components specific to batch: registry of batch TransformTranslator and registry lookup code.

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.beam.runners.spark.structuredstreaming.translation.PipelineTranslator

PipelineTranslator.TranslationState, PipelineTranslator.UnresolvedTranslation<InT,T>

Constructor Summary

Constructors

Constructor	Description
PipelineTranslatorBatch()

Method Summary

Modifier and Type	Method	Description
protected <InT extends org.apache.beam.sdk.values.PInput, OutT extends org.apache.beam.sdk.values.POutput, TransformT extends org.apache.beam.sdk.transforms.PTransform<InT, OutT>> @Nullable TransformTranslator<InT,OutT,TransformT>	getTransformTranslator(TransformT transform)	Returns a TransformTranslator for the given PTransform if known.

Methods inherited from class org.apache.beam.runners.spark.structuredstreaming.translation.PipelineTranslator

detectStreamingMode, replaceTransforms, translate

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

PipelineTranslatorBatch

public PipelineTranslatorBatch()

Method Details

getTransformTranslator

protected <InT extends org.apache.beam.sdk.values.PInput,
OutT extends org.apache.beam.sdk.values.POutput,
TransformT extends org.apache.beam.sdk.transforms.PTransform<InT,
OutT>>
@Nullable TransformTranslator<InT,OutT,TransformT> getTransformTranslator(TransformT transform)

Returns a TransformTranslator for the given PTransform if known.

Specified by:

getTransformTranslator in class PipelineTranslator