Packages

o

com.linkedin.feathr.offline.client

DataFrameColName

object DataFrameColName

Utility class to create compliant column names for Spark DataFrames

Linear Supertypes
AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. DataFrameColName
  2. AnyRef
  3. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Value Members

  1. final def !=(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  4. val FEATURE_REF_DELIM_IN_COLNAME: String

    Delimiter between parts of a Feature Ref as used in a DataFrame column name.

  5. val FEATURE_REF_KEYTAG_DELIM_IN_COLNAME: String
  6. val KEYTAG_DELIM_IN_COLNAME: String

    Delimiter between key tags as used in a DataFrame column name.

  7. val UidColumnName: String
  8. final def asInstanceOf[T0]: T0
    Definition Classes
    Any
  9. def clone(): AnyRef
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native()
  10. final def eq(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  11. def equals(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  12. def finalize(): Unit
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  13. def generateHeader(featureToColumnNameMap: Map[TaggedFeatureName, String], allAnchoredFeatures: Map[String, FeatureAnchorWithSource], allDerivedFeatures: Map[String, DerivedFeature], inferredFeatureTypeConfigs: Map[String, FeatureTypeConfig]): Header

    generate header info (e.g, feature type, feature column name map) for output dataframe of feature join or feature generation

    generate header info (e.g, feature type, feature column name map) for output dataframe of feature join or feature generation

    featureToColumnNameMap

    map of feature to its column name in the dataframe

    inferredFeatureTypeConfigs

    feature name to inferred feature types

    returns

    header info for a dataframe that contains the features in featureToColumnNameMap

    Annotations
    @VisibleForTesting()
  14. final def getClass(): Class[_]
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  15. def getFeatureOutputColumnName(featureRefStr: String, tags: Seq[String]): String

    get column name in the output dataframe of feathr join output This function should be only used when a feature is requested with multiple key tags in a feathr join, i.e.

    get column name in the output dataframe of feathr join output This function should be only used when a feature is requested with multiple key tags in a feathr join, i.e. caller should be aware that this function will always preppend the key tags passed in, the current output feature column should skip the key tag if a feature is only requested using one set of key tags, so they should not use this function to create feature column name in this case, or should pass in empty key tags

    featureRefStr

    feature ref

    tags

    string tags of the feature

  16. def getFeatureRefStrInColName(featureRefStr: String): String

    Gets the column name representation(without encoding) of the specified FeatureRef string

    Gets the column name representation(without encoding) of the specified FeatureRef string

    featureRefStr

    FeatureRef string

    returns

    Representation of FeatureRef string as used in DataFrame column name.

    Annotations
    @Experimental()
  17. def hashCode(): Int
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  18. final def isInstanceOf[T0]: Boolean
    Definition Classes
    Any
  19. final def ne(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  20. final def notify(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  21. final def notifyAll(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  22. final def synchronized[T0](arg0: ⇒ T0): T0
    Definition Classes
    AnyRef
  23. def toString(): String
    Definition Classes
    AnyRef → Any
  24. final def wait(): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  25. final def wait(arg0: Long, arg1: Int): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  26. final def wait(arg0: Long): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native()

Inherited from AnyRef

Inherited from Any

Ungrouped