Package org.apache.beam.sdk.extensions.sql.impl.rel

Class BeamIOSinkRel

  • All Implemented Interfaces:
    java.lang.Cloneable, BeamRelNode, org.apache.beam.vendor.calcite.v1_40_0.org.apache.calcite.plan.RelOptNode, org.apache.beam.vendor.calcite.v1_40_0.org.apache.calcite.rel.RelNode, org.apache.beam.vendor.calcite.v1_40_0.org.apache.calcite.sql2rel.RelStructuredTypeFlattener.SelfFlatteningRel
    public class BeamIOSinkRel
extends org.apache.beam.vendor.calcite.v1_40_0.org.apache.calcite.rel.core.TableModify
implements BeamRelNode, org.apache.beam.vendor.calcite.v1_40_0.org.apache.calcite.sql2rel.RelStructuredTypeFlattener.SelfFlatteningRel
    BeamRelNode to replace a TableModify node.

    • Nested Class Summary

      • Nested classes/interfaces inherited from class org.apache.beam.vendor.calcite.v1_40_0.org.apache.calcite.rel.core.TableModify

        org.apache.beam.vendor.calcite.v1_40_0.org.apache.calcite.rel.core.TableModify.Operation

      • Nested classes/interfaces inherited from interface org.apache.beam.vendor.calcite.v1_40_0.org.apache.calcite.rel.RelNode

        org.apache.beam.vendor.calcite.v1_40_0.org.apache.calcite.rel.RelNode.Context

    • Field Summary

      • Fields inherited from class org.apache.beam.vendor.calcite.v1_40_0.org.apache.calcite.rel.core.TableModify

        catalogReader, table

      • Fields inherited from class org.apache.beam.vendor.calcite.v1_40_0.org.apache.calcite.rel.SingleRel

        input

      • Fields inherited from class org.apache.beam.vendor.calcite.v1_40_0.org.apache.calcite.rel.AbstractRelNode

        digest, id, rowType, traitSet

    • Constructor Summary

      Constructors 
      Constructor Description
      BeamIOSinkRel​(org.apache.beam.vendor.calcite.v1_40_0.org.apache.calcite.plan.RelOptCluster cluster, org.apache.beam.vendor.calcite.v1_40_0.org.apache.calcite.plan.RelOptTable table, org.apache.beam.vendor.calcite.v1_40_0.org.apache.calcite.prepare.Prepare.CatalogReader catalogReader, org.apache.beam.vendor.calcite.v1_40_0.org.apache.calcite.rel.RelNode child, org.apache.beam.vendor.calcite.v1_40_0.org.apache.calcite.rel.core.TableModify.Operation operation, @Nullable java.util.List<java.lang.String> updateColumnList, @Nullable java.util.List<org.apache.beam.vendor.calcite.v1_40_0.org.apache.calcite.rex.RexNode> sourceExpressionList, boolean flattened, BeamSqlTable sqlTable, java.util.Map<java.lang.String,​java.lang.String> pipelineOptions)  

    • Method Summary

      All Methods Instance Methods Concrete Methods 
      Modifier and Type Method Description
      BeamCostModel beamComputeSelfCost​(org.apache.beam.vendor.calcite.v1_40_0.org.apache.calcite.plan.RelOptPlanner planner, BeamRelMetadataQuery mq)
      This method is called by org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner.NonCumulativeCostImpl.
      org.apache.beam.sdk.transforms.PTransform<org.apache.beam.sdk.values.PCollectionList<org.apache.beam.sdk.values.Row>,​org.apache.beam.sdk.values.PCollection<org.apache.beam.sdk.values.Row>> buildPTransform()  
      org.apache.beam.vendor.calcite.v1_40_0.org.apache.calcite.rel.RelNode copy​(org.apache.beam.vendor.calcite.v1_40_0.org.apache.calcite.plan.RelTraitSet traitSet, java.util.List<org.apache.beam.vendor.calcite.v1_40_0.org.apache.calcite.rel.RelNode> inputs)  
      NodeStats estimateNodeStats​(BeamRelMetadataQuery mq)
      This method is called by org.apache.beam.sdk.extensions.sql.impl.planner.RelMdNodeStats.
      void flattenRel​(org.apache.beam.vendor.calcite.v1_40_0.org.apache.calcite.sql2rel.RelStructuredTypeFlattener flattener)  
      java.util.Map<java.lang.String,​java.lang.String> getPipelineOptions()
      Perform a DFS(Depth-First-Search) to find the PipelineOptions config.
      void register​(org.apache.beam.vendor.calcite.v1_40_0.org.apache.calcite.plan.RelOptPlanner planner)  

      • Methods inherited from class org.apache.beam.vendor.calcite.v1_40_0.org.apache.calcite.rel.core.TableModify

        computeSelfCost, deriveRowType, explainTerms, getCatalogReader, getExpectedInputRowType, getOperation, getSourceExpressionList, getTable, getUpdateColumnList, isDelete, isFlattened, isInsert, isMerge, isUpdate

      • Methods inherited from class org.apache.beam.vendor.calcite.v1_40_0.org.apache.calcite.rel.SingleRel

        childrenAccept, estimateRowCount, getInput, getInputs, replaceInput

      • Methods inherited from class org.apache.beam.vendor.calcite.v1_40_0.org.apache.calcite.rel.AbstractRelNode

        accept, accept, collectVariablesSet, collectVariablesUsed, deepEquals, deepHashCode, equals, explain, getCluster, getConvention, getCorrelVariable, getDescription, getDigest, getId, getInput, getRelDigest, getRelTypeName, getRowType, getTraitSet, getVariablesSet, hashCode, isEnforcer, isValid, metadata, onRegister, recomputeDigest, sole, toString

      • Methods inherited from class java.lang.Object

        clone, finalize, getClass, notify, notifyAll, wait, wait, wait

      • Methods inherited from interface org.apache.beam.vendor.calcite.v1_40_0.org.apache.calcite.rel.RelNode

        accept, accept, childrenAccept, collectVariablesSet, collectVariablesUsed, computeSelfCost, deepEquals, deepHashCode, estimateRowCount, explain, explain, fieldIsNullable, getConvention, getCorrelVariable, getDigest, getExpectedInputRowType, getInput, getInputs, getRelDigest, getRelTypeName, getRowType, getTable, getVariablesSet, isEnforcer, isValid, metadata, onRegister, recomputeDigest, replaceInput, stripped

      • Methods inherited from interface org.apache.beam.vendor.calcite.v1_40_0.org.apache.calcite.plan.RelOptNode

        getCluster, getDescription, getId, getTraitSet

    • Constructor Detail

      • BeamIOSinkRel

        public BeamIOSinkRel​(org.apache.beam.vendor.calcite.v1_40_0.org.apache.calcite.plan.RelOptCluster cluster,
                     org.apache.beam.vendor.calcite.v1_40_0.org.apache.calcite.plan.RelOptTable table,
                     org.apache.beam.vendor.calcite.v1_40_0.org.apache.calcite.prepare.Prepare.CatalogReader catalogReader,
                     org.apache.beam.vendor.calcite.v1_40_0.org.apache.calcite.rel.RelNode child,
                     org.apache.beam.vendor.calcite.v1_40_0.org.apache.calcite.rel.core.TableModify.Operation operation,
                     @Nullable java.util.List<java.lang.String> updateColumnList,
                     @Nullable java.util.List<org.apache.beam.vendor.calcite.v1_40_0.org.apache.calcite.rex.RexNode> sourceExpressionList,
                     boolean flattened,
                     BeamSqlTable sqlTable,
                     java.util.Map<java.lang.String,​java.lang.String> pipelineOptions)

    • Method Detail

      • estimateNodeStats

        public NodeStats estimateNodeStats​(BeamRelMetadataQuery mq)
        Description copied from interface: BeamRelNode
        This method is called by org.apache.beam.sdk.extensions.sql.impl.planner.RelMdNodeStats. This is currently only used in SQLTransform Path (and not JDBC path). When a RelNode wants to calculate its BeamCost or estimate its NodeStats, it may need NodeStat of its inputs. However, it should not call this directly (because maybe its inputs are not physical yet). It should call org.apache.beam.sdk.extensions.sql.impl.rel.BeamSqlRelUtils#getNodeStats( org.apache.beam.vendor.calcite.v1_40_0.org.apache.calcite.rel.RelNode, org.apache.beam.vendor.calcite.v1_40_0.org.apache.calcite.rel.metadata.RelMetadataQuery) instead.
        Specified by:
        estimateNodeStats in interface BeamRelNode

      • beamComputeSelfCost

        public BeamCostModel beamComputeSelfCost​(org.apache.beam.vendor.calcite.v1_40_0.org.apache.calcite.plan.RelOptPlanner planner,
                                         BeamRelMetadataQuery mq)
        Description copied from interface: BeamRelNode
        This method is called by org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner.NonCumulativeCostImpl. This is currently only used in SQLTransform Path (and not JDBC path). This is needed when Calcite Query Planner wants to get the cost of a plan. Instead of calling this directly for a node, if we needed that it should be obtained by calling mq.getNonCumulativeCost. This way RelMetadataQuery will call this method instead of ComputeSelfCost if the handler is set correctly (see org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner#convertToBeamRel(String))
        Specified by:
        beamComputeSelfCost in interface BeamRelNode

      • copy

        public org.apache.beam.vendor.calcite.v1_40_0.org.apache.calcite.rel.RelNode copy​(org.apache.beam.vendor.calcite.v1_40_0.org.apache.calcite.plan.RelTraitSet traitSet,
                                                                                  java.util.List<org.apache.beam.vendor.calcite.v1_40_0.org.apache.calcite.rel.RelNode> inputs)
        Specified by:
        copy in interface org.apache.beam.vendor.calcite.v1_40_0.org.apache.calcite.rel.RelNode
        Overrides:
        copy in class org.apache.beam.vendor.calcite.v1_40_0.org.apache.calcite.rel.AbstractRelNode

      • flattenRel

        public void flattenRel​(org.apache.beam.vendor.calcite.v1_40_0.org.apache.calcite.sql2rel.RelStructuredTypeFlattener flattener)
        Specified by:
        flattenRel in interface org.apache.beam.vendor.calcite.v1_40_0.org.apache.calcite.sql2rel.RelStructuredTypeFlattener.SelfFlatteningRel

      • register

        public void register​(org.apache.beam.vendor.calcite.v1_40_0.org.apache.calcite.plan.RelOptPlanner planner)
        Specified by:
        register in interface org.apache.beam.vendor.calcite.v1_40_0.org.apache.calcite.rel.RelNode
        Overrides:
        register in class org.apache.beam.vendor.calcite.v1_40_0.org.apache.calcite.rel.AbstractRelNode

      • buildPTransform

        public org.apache.beam.sdk.transforms.PTransform<org.apache.beam.sdk.values.PCollectionList<org.apache.beam.sdk.values.Row>,​org.apache.beam.sdk.values.PCollection<org.apache.beam.sdk.values.Row>> buildPTransform()
        Specified by:
        buildPTransform in interface BeamRelNode

      • getPipelineOptions

        public java.util.Map<java.lang.String,​java.lang.String> getPipelineOptions()
        Description copied from interface: BeamRelNode
        Perform a DFS(Depth-First-Search) to find the PipelineOptions config.
        Specified by:
        getPipelineOptions in interface BeamRelNode