Type Members

1.  case class DataSourceV2Relation(table: Table, output: Seq[AttributeReference], catalog: Option[CatalogPlugin], identifier: Option[Identifier], options: CaseInsensitiveStringMap) extends DataSourceV2RelationBase with ExposesMetadataColumns with Product with Serializable

   A specialization of DataSourceV2RelationBase that supports batch scan.

2.  abstract class DataSourceV2RelationBase extends LogicalPlan with LeafNode with MultiInstanceRelation with NamedRelation

   A logical plan representing a data source v2 table.

3.  case class DataSourceV2ScanRelation(relation: DataSourceV2Relation, scan: Scan, output: Seq[AttributeReference], keyGroupedPartitioning: Option[Seq[Expression]] = None, ordering: Option[Seq[SortOrder]] = None) extends LogicalPlan with LeafNode with NamedRelation with Product with Serializable

   A logical plan for a DSv2 table with a scan already created.

   A logical plan for a DSv2 table with a scan already created.

   This is used in the optimizer to push filters and projection down before conversion to physical plan. This ensures that the stats that are used by the optimizer account for the filters and projection that will be pushed down.

   relation

   a DataSourceV2Relation

   scan

   a DSv2 Scan

   output

   the output attributes of this relation

   keyGroupedPartitioning

   if set, the partitioning expressions that are used to split the rows in the scan across different partitions

   ordering

   if set, the ordering provided by the scan

4.  case class StreamingDataSourceV2Relation(table: Table, output: Seq[AttributeReference], catalog: Option[CatalogPlugin], identifier: Option[Identifier], options: CaseInsensitiveStringMap, metadataPath: String) extends DataSourceV2RelationBase with Product with Serializable

   A specialization of DataSourceV2RelationBase that supports streaming scan.

   A specialization of DataSourceV2RelationBase that supports streaming scan. It will be transformed to StreamingDataSourceV2ScanRelation during the planning phase of MicrobatchExecution.

5.  case class StreamingDataSourceV2ScanRelation(relation: StreamingDataSourceV2Relation, scan: Scan, output: Seq[AttributeReference], stream: SparkDataStream, startOffset: Option[Offset] = None, endOffset: Option[Offset] = None) extends LogicalPlan with LeafNode with MultiInstanceRelation with NamedRelation with Product with Serializable

   A specialization of DataSourceV2ScanRelation with the streaming bit set to true, as well as start and end offsets for Microbatch processing.