Packages

t

org.apache.spark.sql.delta.commands

CreateDeltaTableLike

trait CreateDeltaTableLike extends SQLConfHelper

A common trait implementing utility functions (e.g. catalog operations) for all commands that create a Delta table.

Linear Supertypes
SQLConfHelper, AnyRef, Any
Known Subclasses
CreateDeltaTableCommand
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. CreateDeltaTableLike
  2. SQLConfHelper
  3. AnyRef
  4. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. Protected

Abstract Value Members

  1. abstract val existingTableOpt: Option[CatalogTable]
  2. abstract val mode: SaveMode
  3. abstract val operation: CreationMode
  4. abstract val table: CatalogTable

Concrete Value Members

  1. final def !=(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  2. final def ##: Int
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  4. final def asInstanceOf[T0]: T0
    Definition Classes
    Any
  5. def clone(): AnyRef
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.CloneNotSupportedException]) @IntrinsicCandidate() @native()
  6. def conf: SQLConf
    Definition Classes
    SQLConfHelper
  7. final def eq(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  8. def equals(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef → Any
  9. def getCatalogTableWithLocation(sparkSession: SparkSession): CatalogTable

    Generates a CatalogTable with its locationUri set appropriately, depending on whether the table already exists or is newly created.

    Generates a CatalogTable with its locationUri set appropriately, depending on whether the table already exists or is newly created.

    Attributes
    protected
  10. final def getClass(): Class[_ <: AnyRef]
    Definition Classes
    AnyRef → Any
    Annotations
    @IntrinsicCandidate() @native()
  11. def hashCode(): Int
    Definition Classes
    AnyRef → Any
    Annotations
    @IntrinsicCandidate() @native()
  12. final def isInstanceOf[T0]: Boolean
    Definition Classes
    Any
  13. def isV1Writer: Boolean

    Horrible hack to differentiate between DataFrameWriterV1 and V2 so that we can decide what to do with table metadata.

    Horrible hack to differentiate between DataFrameWriterV1 and V2 so that we can decide what to do with table metadata. In DataFrameWriterV1, mode("overwrite").saveAsTable, behaves as a CreateOrReplace table, but we have asked for "overwriteSchema" as an explicit option to overwrite partitioning or schema information. With DataFrameWriterV2, the behavior asked for by the user is clearer: .createOrReplace(), which means that we should overwrite schema and/or partitioning. Therefore we have this hack.

    Attributes
    protected
  14. final def ne(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  15. final def notify(): Unit
    Definition Classes
    AnyRef
    Annotations
    @IntrinsicCandidate() @native()
  16. final def notifyAll(): Unit
    Definition Classes
    AnyRef
    Annotations
    @IntrinsicCandidate() @native()
  17. final def synchronized[T0](arg0: => T0): T0
    Definition Classes
    AnyRef
  18. val tableByPath: Boolean
  19. def toString(): String
    Definition Classes
    AnyRef → Any
  20. def updateCatalog(spark: SparkSession, table: CatalogTable, snapshot: Snapshot, query: Option[LogicalPlan], didNotChangeMetadata: Boolean, createTableFunc: Option[(CatalogTable) => Unit] = None): Unit

    Here we disambiguate the catalog alterations we need to do based on the table operation, and whether we have reached here through legacy code or DataSourceV2 code paths.

    Here we disambiguate the catalog alterations we need to do based on the table operation, and whether we have reached here through legacy code or DataSourceV2 code paths.

    Attributes
    protected
  21. final def wait(arg0: Long, arg1: Int): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.InterruptedException])
  22. final def wait(arg0: Long): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.InterruptedException]) @native()
  23. final def wait(): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.InterruptedException])
  24. def withSQLConf[T](pairs: (String, String)*)(f: => T): T
    Attributes
    protected
    Definition Classes
    SQLConfHelper

Deprecated Value Members

  1. def finalize(): Unit
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.Throwable]) @Deprecated
    Deprecated

    (Since version 9)

Inherited from SQLConfHelper

Inherited from AnyRef

Inherited from Any

Ungrouped