Package org.apache.beam.runners.spark.translation

Class GroupByKeyVisitor

java.lang.Object

org.apache.beam.sdk.Pipeline.PipelineVisitor.Defaults

org.apache.beam.runners.spark.translation.GroupByKeyVisitor

All Implemented Interfaces:

org.apache.beam.sdk.Pipeline.PipelineVisitor

public class GroupByKeyVisitor
extends org.apache.beam.sdk.Pipeline.PipelineVisitor.Defaults

Traverses the pipeline to populate the candidates for group by key.

Nested Class Summary

Nested classes/interfaces inherited from interface org.apache.beam.sdk.Pipeline.PipelineVisitor

org.apache.beam.sdk.Pipeline.PipelineVisitor.CompositeBehavior, org.apache.beam.sdk.Pipeline.PipelineVisitor.Defaults

Field Summary

Fields

Modifier and Type	Field	Description
protected final EvaluationContext	ctxt
protected final SparkPipelineTranslator	translator

Constructor Summary

Constructors

Constructor	Description
GroupByKeyVisitor(SparkPipelineTranslator translator, EvaluationContext evaluationContext)

Method Summary

Modifier and Type	Method	Description
org.apache.beam.sdk.Pipeline.PipelineVisitor.CompositeBehavior	enterCompositeTransform(org.apache.beam.sdk.runners.TransformHierarchy.Node node)
void	leaveCompositeTransform(org.apache.beam.sdk.runners.TransformHierarchy.Node node)
void	visitPrimitiveTransform(org.apache.beam.sdk.runners.TransformHierarchy.Node node)

Methods inherited from class org.apache.beam.sdk.Pipeline.PipelineVisitor.Defaults

enterPipeline, getPipeline, leavePipeline, visitValue

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

ctxt

protected final EvaluationContext ctxt

translator

protected final SparkPipelineTranslator translator

Constructor Details

GroupByKeyVisitor

public GroupByKeyVisitor(SparkPipelineTranslator translator,
 EvaluationContext evaluationContext)

Method Details

enterCompositeTransform

public org.apache.beam.sdk.Pipeline.PipelineVisitor.CompositeBehavior enterCompositeTransform(org.apache.beam.sdk.runners.TransformHierarchy.Node node)

Specified by:

enterCompositeTransform in interface org.apache.beam.sdk.Pipeline.PipelineVisitor

Overrides:

enterCompositeTransform in class org.apache.beam.sdk.Pipeline.PipelineVisitor.Defaults

leaveCompositeTransform

public void leaveCompositeTransform(org.apache.beam.sdk.runners.TransformHierarchy.Node node)

Specified by:

leaveCompositeTransform in interface org.apache.beam.sdk.Pipeline.PipelineVisitor

Overrides:

leaveCompositeTransform in class org.apache.beam.sdk.Pipeline.PipelineVisitor.Defaults

visitPrimitiveTransform

public void visitPrimitiveTransform(org.apache.beam.sdk.runners.TransformHierarchy.Node node)

Specified by:

visitPrimitiveTransform in interface org.apache.beam.sdk.Pipeline.PipelineVisitor

Overrides:

visitPrimitiveTransform in class org.apache.beam.sdk.Pipeline.PipelineVisitor.Defaults