package connector
Type Members
- case class ColumnImpl(name: String, dataType: DataType, nullable: Boolean, comment: String, defaultValue: ColumnDefaultValue, generationExpression: String, identityColumnSpec: IdentityColumnSpec, metadataInJSON: String) extends connector.catalog.Column with Product with Serializable
- abstract class ExpressionWithToString extends Expression with Serializable
- case class ProcedureParameterImpl(mode: Mode, name: String, dataType: DataType, defaultValue: DefaultValue, comment: String) extends ProcedureParameter with Product with Serializable
- trait SimpleTableProvider extends TableProvider
- trait SupportsMetadata extends AnyRef
A mix-in interface for
FileScan.A mix-in interface for
FileScan. This can be used to report metadata for a file based scan operator. This is currently used for supporting formatted explain. - trait SupportsPushDownCatalystFilters extends ScanBuilder
A mix-in interface for
ScanBuilder.A mix-in interface for
ScanBuilder. Data sources can implement this interface to push down filters to the data source. The pushed down filters will be separated into partition filters and data filters. Partition filters are used for partition pruning and data filters are used to reduce the size of the data to be read. - trait SupportsStreamingUpdateAsAppend extends WriteBuilder
An internal
WriteBuildermixin to support UPDATE streaming output mode.An internal
WriteBuildermixin to support UPDATE streaming output mode. Now there's no good way to pass thekeysto upsert or replace (delete -> append), we do the same with append writes and let end users to deal with.This approach may be still valid for streaming writers which can't do the upsert or replace. We can promote the API to the official API along with the new API for upsert/replace.
- class ToStringSQLBuilder extends V2ExpressionSQLBuilder with Serializable
The builder to generate
toStringinformation of V2 expressions. - case class V1Function(info: ExpressionInfo) extends UnboundFunction with Product with Serializable
- case class VariantExtractionImpl(columnName: Array[String], metadata: Metadata, expectedDataType: DataType) extends VariantExtraction with Product with Serializable
Implementation of VariantExtraction.
Implementation of VariantExtraction.
- columnName
Path to the variant column (e.g., Array("v") for top-level, Array("struct1", "v") for nested)
- metadata
The metadata for extraction including JSON path, failOnError, and timeZoneId
- expectedDataType
The expected data type for the extracted value