< Back

Packages

package root

Definition Classes
root
package com

Definition Classes
root
package linkedin

Definition Classes
com
package feathr

Definition Classes
linkedin
package offline
This type alias describes feature data structure for feature join process, which can be shared externally.
This type alias describes feature data structure for feature join process, which can be shared externally.
Sample data : (List(sourceId), nice_a_summary, DateParam(None, None,None, None)) Note that "nice_a_summary" is the feature name

Definition Classes
feathr
package source

Definition Classes
offline
package dataloader

Definition Classes
source
package hdfs
package jdbc
package stream
DataLoaderHandler

p

com.linkedin.feathr.offline.source

dataloader

package dataloader

Type Members

case class DataLoaderHandler(validatePath: (String) ⇒ Boolean, createDataFrame: (String, Map[String, String], JobConf) ⇒ DataFrame, createUnionDataFrame: (Seq[String], Map[String, String], JobConf) ⇒ DataFrame, writeDataFrame: (DataFrame, String, Map[String, String]) ⇒ Unit) extends Product with Serializable
Class that encloses hooks for creating/writing data frames depends on the data/path type.
Class that encloses hooks for creating/writing data frames depends on the data/path type.
validatePath
used to validate if path should be routed to data handler
createDataFrame
used to create a data frame given a path.
createUnionDataFrame
used to create a data frame given multiple paths
writeDataFrame
used to write a data frame to a path

Ungrouped