Packages

package location

Ordering
  1. Alphabetic
Visibility
  1. Public
  2. All

Type Members

  1. trait DataLocation extends AnyRef

    An InputLocation is a data source definition, it can either be HDFS files or a JDBC database connection

    An InputLocation is a data source definition, it can either be HDFS files or a JDBC database connection

    Annotations
    @JsonTypeInfo() @JsonSubTypes()
  2. case class GenericLocation(format: String, mode: Option[String] = None) extends DataLocation with Product with Serializable
    Annotations
    @CaseClassDeserialize()
  3. case class Jdbc(url: String, dbtable: String, user: String = "", password: String = "", token: String = "") extends DataLocation with Product with Serializable
    Annotations
    @CaseClassDeserialize() @JsonIgnoreProperties()
  4. case class KafkaEndpoint(brokers: List[String], topics: List[String], schema: KafkaSchema) extends DataLocation with Product with Serializable
    Annotations
    @CaseClassDeserialize()
  5. case class KafkaSchema(type: String, avroJson: String) extends Product with Serializable

    Kafka source config.

    Kafka source config. Example: kafkaStreamingSource: { type: KAFKA config: { brokers: ["feathrazureci.servicebus.windows.net:9093"] topics: [feathrcieventhub] schema: { type = "avro" avroJson:"......" } } }

    Annotations
    @CaseClassDeserialize()
  6. case class PathList(paths: List[String]) extends DataLocation with Product with Serializable
  7. case class SimplePath(path: String) extends DataLocation with Product with Serializable
    Annotations
    @CaseClassDeserialize()

Value Members

  1. object DataLocation
  2. object GenericLocationAdHocPatches

    Some Spark connectors need extra actions before read or write, namely CosmosDb and ElasticSearch Need to run specific ad-hoc patch base on format

  3. object Jdbc extends Serializable
  4. object LocationUtils
  5. object PathList extends Serializable

Ungrouped