class SumPoolingAggregate extends AggregationWithDeaggBase
SUM_POOLING aggregation implementation.
- Alphabetic
- By Inheritance
- SumPoolingAggregate
- AggregationWithDeaggBase
- AggregationSpec
- Serializable
- Serializable
- AnyRef
- Any
- Hide All
- Show All
- Public
- All
Instance Constructors
-
new
SumPoolingAggregate(valueCol: String, countCol: String = "1")
- valueCol
Name of the metric column or a Spark SQL column expression for derived metric that will be aggregated using SUM_POOLING. This operation differs from SUM in that this applies the SUM operation across an entire Seq of Numerics instead of a single value
- countCol
Name of the column that keeps track of the count which is required for all aggregation functions that support deagg in order to identify when all records have been deagged out. This is needed for pre-aggregated fact dataset. For non-aggregated dataset, if the column name is not provided, use the default column expression lit(1).
Value Members
-
final
def
!=(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
-
final
def
##(): Int
- Definition Classes
- AnyRef → Any
-
final
def
==(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
-
val
CountAggregate: CountAggregate
- Definition Classes
- AggregationWithDeaggBase
-
def
agg(aggregate: Any, record: Any, dataType: DataType): Any
- Definition Classes
- AggregationWithDeaggBase → AggregationSpec
-
def
aggValue(aggregate: Any, valueRecord: Any, valueDataType: DataType): Any
Analogous to AggregationSpec.agg(), we aggregate the parsed value record to the intermediate aggregate value
Analogous to AggregationSpec.agg(), we aggregate the parsed value record to the intermediate aggregate value
- aggregate
The intermediate aggregate value
- valueRecord
Parsed value record to aggregate
- valueDataType
The value record datatype
- returns
The result of aggregating the value record to the intermediate aggregate value
- Definition Classes
- SumPoolingAggregate → AggregationWithDeaggBase
-
def
aggregation: AggregationType
<invalid inheritdoc annotation>
<invalid inheritdoc annotation>
- Definition Classes
- SumPoolingAggregate → AggregationWithDeaggBase → AggregationSpec
-
final
def
asInstanceOf[T0]: T0
- Definition Classes
- Any
-
def
calculateAggregate(aggregate: Any, dataType: DataType): Any
- Definition Classes
- AggregationWithDeaggBase → AggregationSpec
-
def
calculateAggregateWithCount(aggregate: Any, valueDataType: DataType, count: Any, countDataType: DataType): Any
Analogous to AggregationSpec.calculateAggregate(), perform an additional step to calculate the final aggregate value.
Analogous to AggregationSpec.calculateAggregate(), perform an additional step to calculate the final aggregate value. This method has access to the current running count if needed for the calculation (e.g. AVG). Default implementation is to return the aggregate value as is.
- aggregate
The intermediate aggregate value
- valueDataType
The value record datatype
- count
The intermediate count value
- countDataType
The count record datatype
- returns
The calculated aggregate value
- Definition Classes
- SumPoolingAggregate → AggregationWithDeaggBase
-
def
clone(): AnyRef
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws( ... ) @native()
-
val
countCol: String
Name of the column that keeps track of the count which is required for all aggregation functions that support deagg in order to identify when all records have been deagged out
Name of the column that keeps track of the count which is required for all aggregation functions that support deagg in order to identify when all records have been deagged out
- Definition Classes
- SumPoolingAggregate → AggregationWithDeaggBase
-
def
deagg(aggregate: Any, record: Any, dataType: DataType): Any
- Definition Classes
- AggregationWithDeaggBase → AggregationSpec
-
def
deaggValue(aggregate: Any, valueRecord: Any, valueDataType: DataType): Any
Analogous to AggregationSpec.deagg(), we deagg the parsed value record from the intermediate aggregate value
Analogous to AggregationSpec.deagg(), we deagg the parsed value record from the intermediate aggregate value
- aggregate
The intermediate aggregate value
- valueRecord
Parsed value record to deagg
- valueDataType
The value record datatype
- returns
The result of deagging the value record from the intermediate aggregate value
- Definition Classes
- SumPoolingAggregate → AggregationWithDeaggBase
-
final
def
eq(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
-
def
equals(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
-
def
finalize(): Unit
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws( classOf[java.lang.Throwable] )
-
final
def
getClass(): Class[_]
- Definition Classes
- AnyRef → Any
- Annotations
- @native()
-
def
hashCode(): Int
- Definition Classes
- AnyRef → Any
- Annotations
- @native()
-
def
isCalculateAggregateNeeded: Boolean
- Definition Classes
- SumPoolingAggregate → AggregationSpec
-
def
isIncrementalAgg: Boolean
- Definition Classes
- AggregationWithDeaggBase → AggregationSpec
-
final
def
isInstanceOf[T0]: Boolean
- Definition Classes
- Any
-
def
metricCol: String
- Definition Classes
- AggregationWithDeaggBase → AggregationSpec
-
def
metricName: String
<invalid inheritdoc annotation>
<invalid inheritdoc annotation>
- Definition Classes
- SumPoolingAggregate → AggregationWithDeaggBase → AggregationSpec
-
final
def
ne(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
-
final
def
notify(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native()
-
final
def
notifyAll(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native()
-
final
def
synchronized[T0](arg0: ⇒ T0): T0
- Definition Classes
- AnyRef
-
def
toString(): String
- Definition Classes
- AnyRef → Any
-
def
updateAggDataType(featureColumnMetaData: FeatureColumnMetaData): Unit
- Definition Classes
- AggregationWithDeaggBase → AggregationSpec
-
val
valueCol: String
Name of the metric column or a Spark SQL column expression for derived metric that will be aggregated
Name of the metric column or a Spark SQL column expression for derived metric that will be aggregated
- Definition Classes
- SumPoolingAggregate → AggregationWithDeaggBase
-
final
def
wait(): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... )
-
final
def
wait(arg0: Long, arg1: Int): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... )
-
final
def
wait(arg0: Long): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... ) @native()