Packages

class SnowflakeSqlDataLoader extends JdbcConnector

This is used for Snowflake data source JDBC connector

Linear Supertypes
JdbcConnector, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. SnowflakeSqlDataLoader
  2. JdbcConnector
  3. AnyRef
  4. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new SnowflakeSqlDataLoader(ss: SparkSession)

Value Members

  1. final def !=(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  4. val AUTH_FLAG_CONF: String
    Definition Classes
    JdbcConnector
  5. val SNOWFLAKE_SOURCE_NAME: String
  6. val TOKEN_CONF: String
    Definition Classes
    JdbcConnector
  7. val TOKEN_FLAG: String
    Definition Classes
    JdbcConnector
  8. lazy val _ss: SparkSession
    Definition Classes
    JdbcConnector
  9. final def asInstanceOf[T0]: T0
    Definition Classes
    Any
  10. def clone(): AnyRef
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native()
  11. final def eq(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  12. def equals(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  13. def extractJdbcOptions(ss: SparkSession, url: String): Map[String, String]
    Definition Classes
    SnowflakeSqlDataLoader → JdbcConnector
  14. def finalize(): Unit
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  15. val format: String
    Definition Classes
    JdbcConnector
  16. final def getClass(): Class[_]
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  17. def getDFReader(jdbcOptions: Map[String, String], url: String): DataFrameReader

    jdbc Options needs to contain necessary information except jdbc url, include: driver option, authentication options, dbTable option, etc.

    jdbc Options needs to contain necessary information except jdbc url, include: driver option, authentication options, dbTable option, etc. extend a new class when new JDBC data connector is added.

    Definition Classes
    SnowflakeSqlDataLoader → JdbcConnector
  18. def getDFWriter(df: DataFrame, jdbcOptions: Map[String, String]): DataFrameWriter[Row]
    Definition Classes
    JdbcConnector
  19. def getJdbcAuth(ss: SparkSession): Map[String, String]
  20. def getJdbcParams(ss: SparkSession): Map[String, String]
  21. def hashCode(): Int
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  22. final def isInstanceOf[T0]: Boolean
    Definition Classes
    Any
  23. def loadDataFrame(url: String, jdbcOptions: Map[String, String] = Map[String, String]()): DataFrame
    Definition Classes
    SnowflakeSqlDataLoader → JdbcConnector
  24. final def ne(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  25. final def notify(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  26. final def notifyAll(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  27. final def synchronized[T0](arg0: ⇒ T0): T0
    Definition Classes
    AnyRef
  28. def toString(): String
    Definition Classes
    AnyRef → Any
  29. final def wait(): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  30. final def wait(arg0: Long, arg1: Int): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  31. final def wait(arg0: Long): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native()

Inherited from JdbcConnector

Inherited from AnyRef

Inherited from Any

Ungrouped