package location
- Alphabetic
- Public
- All
Type Members
-
trait
DataLocation extends AnyRef
An InputLocation is a data source definition, it can either be HDFS files or a JDBC database connection
An InputLocation is a data source definition, it can either be HDFS files or a JDBC database connection
- Annotations
- @JsonTypeInfo() @JsonSubTypes()
-
case class
GenericLocation(format: String, mode: Option[String] = None) extends DataLocation with Product with Serializable
- Annotations
- @CaseClassDeserialize()
-
case class
Jdbc(url: String, dbtable: String, user: String = "", password: String = "", token: String = "") extends DataLocation with Product with Serializable
- Annotations
- @CaseClassDeserialize() @JsonIgnoreProperties()
-
case class
KafkaEndpoint(brokers: List[String], topics: List[String], schema: KafkaSchema) extends DataLocation with Product with Serializable
- Annotations
- @CaseClassDeserialize()
-
case class
KafkaSchema(type: String, avroJson: String) extends Product with Serializable
Kafka source config.
Kafka source config. Example: kafkaStreamingSource: { type: KAFKA config: { brokers: ["feathrazureci.servicebus.windows.net:9093"] topics: [feathrcieventhub] schema: { type = "avro" avroJson:"......" } } }
- Annotations
- @CaseClassDeserialize()
- case class PathList(paths: List[String]) extends DataLocation with Product with Serializable
-
case class
SimplePath(path: String) extends DataLocation with Product with Serializable
- Annotations
- @CaseClassDeserialize()
Value Members
- object DataLocation
-
object
GenericLocationAdHocPatches
Some Spark connectors need extra actions before read or write, namely CosmosDb and ElasticSearch Need to run specific ad-hoc patch base on
format - object Jdbc extends Serializable
- object LocationUtils
- object PathList extends Serializable