Package org.apache.beam.sdk.extensions.sql.meta.provider.datagen

Class DataGeneratorTable

java.lang.Object

org.apache.beam.sdk.extensions.sql.meta.BaseBeamTable

org.apache.beam.sdk.extensions.sql.meta.SchemaBaseBeamTable

org.apache.beam.sdk.extensions.sql.meta.provider.datagen.DataGeneratorTable

All Implemented Interfaces:

java.io.Serializable, BeamSqlTable

public class DataGeneratorTable
extends SchemaBaseBeamTable

Represents a 'datagen' table within a Beam SQL pipeline. This class extends SchemaBaseBeamTable to correctly implement the full BeamSqlTable interface.

See Also:

Serialized Form

Field Summary

Fields inherited from class org.apache.beam.sdk.extensions.sql.meta.SchemaBaseBeamTable

schema

Constructor Summary

Constructors

Constructor	Description
DataGeneratorTable(org.apache.beam.sdk.schemas.Schema schema, com.fasterxml.jackson.databind.node.ObjectNode properties)

Method Summary

Modifier and Type	Method	Description
org.apache.beam.sdk.values.PCollection<org.apache.beam.sdk.values.Row>	buildIOReader(org.apache.beam.sdk.values.PBegin begin)	create a PCollection<Row> from source.
org.apache.beam.sdk.values.PCollection<org.apache.beam.sdk.values.Row>	buildIOReader(org.apache.beam.sdk.values.PBegin begin, BeamSqlTableFilter filters, java.util.List<java.lang.String> fieldNames)	create a PCollection<Row> from source with predicate and/or project pushed-down.
org.apache.beam.sdk.values.POutput	buildIOWriter(org.apache.beam.sdk.values.PCollection<org.apache.beam.sdk.values.Row> input)	create a IO.write() instance to write to target.
BeamTableStatistics	getTableStatistics(org.apache.beam.sdk.options.PipelineOptions options)	Estimates the number of rows or the rate for unbounded Tables.
org.apache.beam.sdk.values.PCollection.IsBounded	isBounded()	Whether this table is bounded (known to be finite) or unbounded (may or may not be finite).

Methods inherited from class org.apache.beam.sdk.extensions.sql.meta.SchemaBaseBeamTable

getSchema

Methods inherited from class org.apache.beam.sdk.extensions.sql.meta.BaseBeamTable

constructFilter, supportsProjects

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

DataGeneratorTable

public DataGeneratorTable(org.apache.beam.sdk.schemas.Schema schema,
                          com.fasterxml.jackson.databind.node.ObjectNode properties)

Method Detail

isBounded

public org.apache.beam.sdk.values.PCollection.IsBounded isBounded()

Description copied from interface: BeamSqlTable

Whether this table is bounded (known to be finite) or unbounded (may or may not be finite).

buildIOReader

public org.apache.beam.sdk.values.PCollection<org.apache.beam.sdk.values.Row> buildIOReader(org.apache.beam.sdk.values.PBegin begin)

Description copied from interface: BeamSqlTable

create a PCollection<Row> from source.

buildIOReader

public org.apache.beam.sdk.values.PCollection<org.apache.beam.sdk.values.Row> buildIOReader(org.apache.beam.sdk.values.PBegin begin,
                                                                                            BeamSqlTableFilter filters,
                                                                                            java.util.List<java.lang.String> fieldNames)

Description copied from interface: BeamSqlTable

create a PCollection<Row> from source with predicate and/or project pushed-down.

Specified by:

buildIOReader in interface BeamSqlTable

Overrides:

buildIOReader in class BaseBeamTable

buildIOWriter

public org.apache.beam.sdk.values.POutput buildIOWriter(org.apache.beam.sdk.values.PCollection<org.apache.beam.sdk.values.Row> input)

Description copied from interface: BeamSqlTable

create a IO.write() instance to write to target.

getTableStatistics

public BeamTableStatistics getTableStatistics(org.apache.beam.sdk.options.PipelineOptions options)

Description copied from interface: BeamSqlTable

Estimates the number of rows or the rate for unbounded Tables. If it is not possible to estimate the row count or rate it will return BeamTableStatistics.BOUNDED_UNKNOWN.

Specified by:

getTableStatistics in interface BeamSqlTable

Overrides:

getTableStatistics in class BaseBeamTable