org.apache.flink.table.runtime.operators.window.tvf.common

类 WindowAggOperator<K,W>

java.lang.Object

org.apache.flink.streaming.api.operators.AbstractStreamOperator<OUT>

org.apache.flink.table.runtime.operators.TableStreamOperator<org.apache.flink.table.data.RowData>

org.apache.flink.table.runtime.operators.window.tvf.common.WindowAggOperator<K,W>

所有已实现的接口:

Serializable, org.apache.flink.api.common.state.CheckpointListener, org.apache.flink.streaming.api.operators.Input<org.apache.flink.table.data.RowData>, org.apache.flink.streaming.api.operators.KeyContext, org.apache.flink.streaming.api.operators.KeyContextHandler, org.apache.flink.streaming.api.operators.OneInputStreamOperator<org.apache.flink.table.data.RowData,org.apache.flink.table.data.RowData>, org.apache.flink.streaming.api.operators.SetupableStreamOperator<org.apache.flink.table.data.RowData>, org.apache.flink.streaming.api.operators.StreamOperator<org.apache.flink.table.data.RowData>, org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.CheckpointedStreamOperator, org.apache.flink.streaming.api.operators.Triggerable<K,W>, org.apache.flink.streaming.api.operators.YieldingOperator<org.apache.flink.table.data.RowData>

@Internal
public final class WindowAggOperator<K,W>
extends TableStreamOperator<org.apache.flink.table.data.RowData>
implements org.apache.flink.streaming.api.operators.OneInputStreamOperator<org.apache.flink.table.data.RowData,org.apache.flink.table.data.RowData>, org.apache.flink.streaming.api.operators.Triggerable<K,W>, org.apache.flink.streaming.api.operators.KeyContext

We divide windows into 2 categories: Aligned Windows and Unaligned Windows.

Concept of Aligned Window and Unaligned Window

Aligned Windows are windows have predetermined window boundaries and windows can be divided into finite number of non-overlapping chunks. The boundary of an aligned window is determined independently from the time characteristic of the data stream, or messages it receives. For example, hopping (sliding) window is an aligned window as the window boundaries are predetermined based on the window size and slide. Aligned windows include tumbling, hopping, cumulative windows.

Unaligned Windows are windows determined dynamically based on elements. For example, session window is an unaligned window as the window boundaries are determined based on the messages timestamps and their correlations. Currently, unaligned windows include session window only.

Because aligned windows can be divided into finite number of non-overlapping chunks (a.k.a. slices), which can apply efficient processing to share intermediate results.

 Window
 |
 +-- Aligned Window (Slicing Window)
 |    |
 |    +-- Tumble (Slice Unshared Window)
 |    |
 |    +-- Hop (Slice Shared Window)
 |    |
 |    +-- Cumulate (Slice Shared Window)
 |
 +-- Unaligned Window (Unslice Window)
      |
      +-- Session

 

Note: currently, WindowAggOperator doesn't support early-fire and late-arrival. Thus late elements (elements belong to emitted windows) will be simply dropped.

See more in SlicingWindowProcessor and UnslicingWindowProcessor.

另请参阅:

序列化表格

嵌套类概要

从类继承的嵌套类/接口 org.apache.flink.table.runtime.operators.TableStreamOperator

TableStreamOperator.ContextImpl

字段概要

字段

限定符和类型	字段和说明
protected org.apache.flink.streaming.api.operators.TimestampedCollector<org.apache.flink.table.data.RowData>	collector This is used for emitting elements with a given timestamp.
protected org.apache.flink.streaming.api.operators.InternalTimerService<W>	internalTimerService The service to register timers.
protected long	lastTriggeredProcessingTime The tracked processing time triggered last time.
protected org.apache.flink.metrics.Meter	lateRecordsDroppedRate
protected org.apache.flink.metrics.Counter	numLateRecordsDropped
protected org.apache.flink.metrics.Gauge<Long>	watermarkLatency
protected org.apache.flink.api.common.state.ListState<Long>	watermarkState The operator state to store watermark.
protected WindowProcessor<W>	windowProcessor The concrete window operator implementation.

从类继承的字段 org.apache.flink.table.runtime.operators.TableStreamOperator

ctx, currentWatermark

从类继承的字段 org.apache.flink.streaming.api.operators.AbstractStreamOperator

chainingStrategy, config, lastRecordAttributes1, lastRecordAttributes2, latencyStats, LOG, metrics, output, processingTimeService, stateHandler, stateKeySelector1, stateKeySelector2, timeServiceManager

构造器概要

构造器

构造器和说明
WindowAggOperator(WindowProcessor<W> windowProcessor)

方法概要

限定符和类型	方法和说明
void	close()
org.apache.flink.metrics.Counter	getNumLateRecordsDropped()
org.apache.flink.metrics.Gauge<Long>	getWatermarkLatency()
void	initializeState(org.apache.flink.runtime.state.StateInitializationContext context)
void	onEventTime(org.apache.flink.streaming.api.operators.InternalTimer<K,W> timer)
void	onProcessingTime(org.apache.flink.streaming.api.operators.InternalTimer<K,W> timer)
void	open()
void	prepareSnapshotPreBarrier(long checkpointId)
void	processElement(org.apache.flink.streaming.runtime.streamrecord.StreamRecord<org.apache.flink.table.data.RowData> element)
void	processWatermark(org.apache.flink.streaming.api.watermark.Watermark mark)
void	snapshotState(org.apache.flink.runtime.state.StateSnapshotContext context)

从类继承的方法 org.apache.flink.table.runtime.operators.TableStreamOperator

computeMemorySize, useSplittableTimers

从类继承的方法 org.apache.flink.streaming.api.operators.AbstractStreamOperator

finish, getChainingStrategy, getContainingTask, getCurrentKey, getExecutionConfig, getInternalTimerService, getKeyedStateBackend, getKeyedStateStore, getMetricGroup, getOperatorConfig, getOperatorID, getOperatorName, getOperatorStateBackend, getOrCreateKeyedState, getPartitionedState, getPartitionedState, getProcessingTimeService, getRuntimeContext, getStateKeySelector1, getStateKeySelector2, getTimeServiceManager, getUserCodeClassloader, hasKeyContext1, hasKeyContext2, initializeState, isUsingCustomRawKeyedState, notifyCheckpointAborted, notifyCheckpointComplete, processLatencyMarker, processLatencyMarker1, processLatencyMarker2, processRecordAttributes, processRecordAttributes1, processRecordAttributes2, processWatermark1, processWatermark2, processWatermarkStatus, processWatermarkStatus1, processWatermarkStatus2, reportOrForwardLatencyMarker, setChainingStrategy, setCurrentKey, setKeyContextElement1, setKeyContextElement2, setMailboxExecutor, setProcessingTimeService, setup, snapshotState

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

从接口继承的方法 org.apache.flink.streaming.api.operators.OneInputStreamOperator

setKeyContextElement

从接口继承的方法 org.apache.flink.streaming.api.operators.StreamOperator

finish, getMetricGroup, getOperatorAttributes, getOperatorID, initializeState, setKeyContextElement1, setKeyContextElement2, snapshotState

从接口继承的方法 org.apache.flink.api.common.state.CheckpointListener

notifyCheckpointAborted, notifyCheckpointComplete

从接口继承的方法 org.apache.flink.streaming.api.operators.KeyContext

getCurrentKey, setCurrentKey

从接口继承的方法 org.apache.flink.streaming.api.operators.Input

processLatencyMarker, processRecordAttributes, processWatermarkStatus

从接口继承的方法 org.apache.flink.streaming.api.operators.KeyContextHandler

hasKeyContext

字段详细资料

windowProcessor

protected final WindowProcessor<W> windowProcessor

The concrete window operator implementation.

collector

protected transient org.apache.flink.streaming.api.operators.TimestampedCollector<org.apache.flink.table.data.RowData> collector

This is used for emitting elements with a given timestamp.

internalTimerService

protected transient org.apache.flink.streaming.api.operators.InternalTimerService<W> internalTimerService

The service to register timers.

lastTriggeredProcessingTime

protected transient long lastTriggeredProcessingTime

The tracked processing time triggered last time.

watermarkState

protected transient org.apache.flink.api.common.state.ListState<Long> watermarkState

The operator state to store watermark.

numLateRecordsDropped

protected transient org.apache.flink.metrics.Counter numLateRecordsDropped

lateRecordsDroppedRate

protected transient org.apache.flink.metrics.Meter lateRecordsDroppedRate

watermarkLatency

protected transient org.apache.flink.metrics.Gauge<Long> watermarkLatency

构造器详细资料

WindowAggOperator

public WindowAggOperator(WindowProcessor<W> windowProcessor)

方法详细资料

open

public void open()
          throws Exception

指定者:

open 在接口中 org.apache.flink.streaming.api.operators.StreamOperator<org.apache.flink.table.data.RowData>

覆盖:

open 在类中 TableStreamOperator<org.apache.flink.table.data.RowData>

抛出:

Exception

initializeState

public void initializeState(org.apache.flink.runtime.state.StateInitializationContext context)
                     throws Exception

指定者:

initializeState 在接口中 org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.CheckpointedStreamOperator

覆盖:

initializeState 在类中 org.apache.flink.streaming.api.operators.AbstractStreamOperator<org.apache.flink.table.data.RowData>

抛出:

Exception

snapshotState

public void snapshotState(org.apache.flink.runtime.state.StateSnapshotContext context)
                   throws Exception

指定者:

snapshotState 在接口中 org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.CheckpointedStreamOperator

覆盖:

snapshotState 在类中 org.apache.flink.streaming.api.operators.AbstractStreamOperator<org.apache.flink.table.data.RowData>

抛出:

Exception

close

public void close()
           throws Exception

指定者:

close 在接口中 org.apache.flink.streaming.api.operators.StreamOperator<org.apache.flink.table.data.RowData>

覆盖:

close 在类中 org.apache.flink.streaming.api.operators.AbstractStreamOperator<org.apache.flink.table.data.RowData>

抛出:

Exception

processElement

public void processElement(org.apache.flink.streaming.runtime.streamrecord.StreamRecord<org.apache.flink.table.data.RowData> element)
                    throws Exception

指定者:

processElement 在接口中 org.apache.flink.streaming.api.operators.Input<org.apache.flink.table.data.RowData>

抛出:

Exception

processWatermark

public void processWatermark(org.apache.flink.streaming.api.watermark.Watermark mark)
                      throws Exception

指定者:

processWatermark 在接口中 org.apache.flink.streaming.api.operators.Input<org.apache.flink.table.data.RowData>

覆盖:

processWatermark 在类中 TableStreamOperator<org.apache.flink.table.data.RowData>

抛出:

Exception

onEventTime

public void onEventTime(org.apache.flink.streaming.api.operators.InternalTimer<K,W> timer)
                 throws Exception

指定者:

onEventTime 在接口中 org.apache.flink.streaming.api.operators.Triggerable<K,W>

抛出:

Exception

onProcessingTime

public void onProcessingTime(org.apache.flink.streaming.api.operators.InternalTimer<K,W> timer)
                      throws Exception

指定者:

onProcessingTime 在接口中 org.apache.flink.streaming.api.operators.Triggerable<K,W>

抛出:

Exception

prepareSnapshotPreBarrier

public void prepareSnapshotPreBarrier(long checkpointId)
                               throws Exception

指定者:

prepareSnapshotPreBarrier 在接口中 org.apache.flink.streaming.api.operators.StreamOperator<org.apache.flink.table.data.RowData>

覆盖:

prepareSnapshotPreBarrier 在类中 org.apache.flink.streaming.api.operators.AbstractStreamOperator<org.apache.flink.table.data.RowData>

抛出:

Exception

getNumLateRecordsDropped

@VisibleForTesting
public org.apache.flink.metrics.Counter getNumLateRecordsDropped()

getWatermarkLatency

@VisibleForTesting
public org.apache.flink.metrics.Gauge<Long> getWatermarkLatency()