object DataFrameColName
Utility class to create compliant column names for Spark DataFrames
- Alphabetic
- By Inheritance
- DataFrameColName
- AnyRef
- Any
- Hide All
- Show All
- Public
- All
Value Members
-
final
def
!=(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
-
final
def
##(): Int
- Definition Classes
- AnyRef → Any
-
final
def
==(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
-
val
FEATURE_REF_DELIM_IN_COLNAME: String
Delimiter between parts of a Feature Ref as used in a DataFrame column name.
- val FEATURE_REF_KEYTAG_DELIM_IN_COLNAME: String
-
val
KEYTAG_DELIM_IN_COLNAME: String
Delimiter between key tags as used in a DataFrame column name.
- val UidColumnName: String
-
final
def
asInstanceOf[T0]: T0
- Definition Classes
- Any
-
def
clone(): AnyRef
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws( ... ) @native()
-
final
def
eq(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
-
def
equals(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
-
def
finalize(): Unit
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws( classOf[java.lang.Throwable] )
-
def
generateHeader(featureToColumnNameMap: Map[TaggedFeatureName, String], allAnchoredFeatures: Map[String, FeatureAnchorWithSource], allDerivedFeatures: Map[String, DerivedFeature], inferredFeatureTypeConfigs: Map[String, FeatureTypeConfig]): Header
generate header info (e.g, feature type, feature column name map) for output dataframe of feature join or feature generation
generate header info (e.g, feature type, feature column name map) for output dataframe of feature join or feature generation
- featureToColumnNameMap
map of feature to its column name in the dataframe
- inferredFeatureTypeConfigs
feature name to inferred feature types
- returns
header info for a dataframe that contains the features in featureToColumnNameMap
- Annotations
- @VisibleForTesting()
-
final
def
getClass(): Class[_]
- Definition Classes
- AnyRef → Any
- Annotations
- @native()
-
def
getFeatureOutputColumnName(featureRefStr: String, tags: Seq[String]): String
get column name in the output dataframe of feathr join output This function should be only used when a feature is requested with multiple key tags in a feathr join, i.e.
get column name in the output dataframe of feathr join output This function should be only used when a feature is requested with multiple key tags in a feathr join, i.e. caller should be aware that this function will always preppend the key tags passed in, the current output feature column should skip the key tag if a feature is only requested using one set of key tags, so they should not use this function to create feature column name in this case, or should pass in empty key tags
- featureRefStr
feature ref
- tags
string tags of the feature
-
def
getFeatureRefStrInColName(featureRefStr: String): String
Gets the column name representation(without encoding) of the specified FeatureRef string
Gets the column name representation(without encoding) of the specified FeatureRef string
- featureRefStr
FeatureRef string
- returns
Representation of FeatureRef string as used in DataFrame column name.
- Annotations
- @Experimental()
-
def
hashCode(): Int
- Definition Classes
- AnyRef → Any
- Annotations
- @native()
-
final
def
isInstanceOf[T0]: Boolean
- Definition Classes
- Any
-
final
def
ne(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
-
final
def
notify(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native()
-
final
def
notifyAll(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native()
-
final
def
synchronized[T0](arg0: ⇒ T0): T0
- Definition Classes
- AnyRef
-
def
toString(): String
- Definition Classes
- AnyRef → Any
-
final
def
wait(): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... )
-
final
def
wait(arg0: Long, arg1: Int): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... )
-
final
def
wait(arg0: Long): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... ) @native()