org.apache.flink.streaming.api.operators.sortpartition

类 KeyedSortPartitionOperator<INPUT,KEY>

java.lang.Object

org.apache.flink.streaming.api.operators.AbstractStreamOperator<INPUT>

org.apache.flink.streaming.api.operators.sortpartition.KeyedSortPartitionOperator<INPUT,KEY>

类型参数:

INPUT - The type of input record.

KEY - The type of record key, which has already been defined in KeyedStream.

所有已实现的接口:

Serializable, org.apache.flink.api.common.state.CheckpointListener, BoundedOneInput, Input<INPUT>, KeyContext, KeyContextHandler, OneInputStreamOperator<INPUT,INPUT>, SetupableStreamOperator<INPUT>, StreamOperator<INPUT>, StreamOperatorStateHandler.CheckpointedStreamOperator, YieldingOperator<INPUT>

@Internal
public class KeyedSortPartitionOperator<INPUT,KEY>
extends AbstractStreamOperator<INPUT>
implements OneInputStreamOperator<INPUT,INPUT>, BoundedOneInput

The KeyedSortPartitionOperator sorts records of a partition on KeyedStream. It ensures that all records with the same key are sorted in a user-defined order.

To sort the record key first and then record at the same time, both the record key and the record will be written to ExternalSorter directly. However, if the record is sorted according to the selected key by KeySelector, the selected sort key should also be written with the record key and the record to ExternalSorter to avoid repeated key selections.

另请参阅:

序列化表格

字段概要

字段

限定符和类型	字段和说明
protected org.apache.flink.api.common.typeinfo.TypeInformation<INPUT>	inputType The type information of input records.
protected org.apache.flink.api.java.functions.KeySelector<INPUT,?>	sortFieldSelector The selector to create the sort key for records, which will be null if it's not used.

从类继承的字段 org.apache.flink.streaming.api.operators.AbstractStreamOperator

chainingStrategy, config, lastRecordAttributes1, lastRecordAttributes2, latencyStats, LOG, metrics, output, processingTimeService, stateHandler, stateKeySelector1, stateKeySelector2, timeServiceManager

构造器概要

构造器

构造器和说明
KeyedSortPartitionOperator(org.apache.flink.api.common.typeinfo.TypeInformation<INPUT> inputType, int positionSortField, org.apache.flink.api.common.operators.Order sortOrder)
KeyedSortPartitionOperator(org.apache.flink.api.common.typeinfo.TypeInformation<INPUT> inputType, org.apache.flink.api.java.functions.KeySelector<INPUT,K> sortFieldSelector, org.apache.flink.api.common.operators.Order sortOrder)
KeyedSortPartitionOperator(org.apache.flink.api.common.typeinfo.TypeInformation<INPUT> inputType, String stringSortField, org.apache.flink.api.common.operators.Order sortOrder)

方法概要

限定符和类型	方法和说明
void	endInput() It is notified that no more data will arrive from the input.
OperatorAttributes	getOperatorAttributes() Called to get the OperatorAttributes of the operator.
void	processElement(StreamRecord<INPUT> element) Processes one element that arrived on this input of the MultipleInputStreamOperator.
void	setup(StreamTask<?,?> containingTask, StreamConfig config, Output<StreamRecord<INPUT>> output) Initializes the operator.

从类继承的方法 org.apache.flink.streaming.api.operators.AbstractStreamOperator

close, finish, getChainingStrategy, getContainingTask, getCurrentKey, getExecutionConfig, getInternalTimerService, getKeyedStateBackend, getKeyedStateStore, getMetricGroup, getOperatorConfig, getOperatorID, getOperatorName, getOperatorStateBackend, getOrCreateKeyedState, getPartitionedState, getPartitionedState, getProcessingTimeService, getRuntimeContext, getStateKeySelector1, getStateKeySelector2, getTimeServiceManager, getUserCodeClassloader, hasKeyContext1, hasKeyContext2, initializeState, initializeState, isUsingCustomRawKeyedState, notifyCheckpointAborted, notifyCheckpointComplete, open, prepareSnapshotPreBarrier, processLatencyMarker, processLatencyMarker1, processLatencyMarker2, processRecordAttributes, processRecordAttributes1, processRecordAttributes2, processWatermark, processWatermark1, processWatermark2, processWatermarkStatus, processWatermarkStatus1, processWatermarkStatus2, reportOrForwardLatencyMarker, setChainingStrategy, setCurrentKey, setKeyContextElement1, setKeyContextElement2, setMailboxExecutor, setProcessingTimeService, snapshotState, snapshotState, useSplittableTimers

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

从接口继承的方法 org.apache.flink.streaming.api.operators.OneInputStreamOperator

setKeyContextElement

从接口继承的方法 org.apache.flink.streaming.api.operators.StreamOperator

close, finish, getMetricGroup, getOperatorID, initializeState, open, prepareSnapshotPreBarrier, setKeyContextElement1, setKeyContextElement2, snapshotState

从接口继承的方法 org.apache.flink.api.common.state.CheckpointListener

notifyCheckpointAborted, notifyCheckpointComplete

从接口继承的方法 org.apache.flink.streaming.api.operators.KeyContext

getCurrentKey, setCurrentKey

从接口继承的方法 org.apache.flink.streaming.api.operators.Input

processLatencyMarker, processRecordAttributes, processWatermark, processWatermarkStatus

从接口继承的方法 org.apache.flink.streaming.api.operators.KeyContextHandler

hasKeyContext

字段详细资料

inputType

protected final org.apache.flink.api.common.typeinfo.TypeInformation<INPUT> inputType

The type information of input records.

sortFieldSelector

protected final org.apache.flink.api.java.functions.KeySelector<INPUT,?> sortFieldSelector

The selector to create the sort key for records, which will be null if it's not used.

构造器详细资料

KeyedSortPartitionOperator

public KeyedSortPartitionOperator(org.apache.flink.api.common.typeinfo.TypeInformation<INPUT> inputType,
                                  int positionSortField,
                                  org.apache.flink.api.common.operators.Order sortOrder)

KeyedSortPartitionOperator

public KeyedSortPartitionOperator(org.apache.flink.api.common.typeinfo.TypeInformation<INPUT> inputType,
                                  String stringSortField,
                                  org.apache.flink.api.common.operators.Order sortOrder)

KeyedSortPartitionOperator

public KeyedSortPartitionOperator(org.apache.flink.api.common.typeinfo.TypeInformation<INPUT> inputType,
                                  org.apache.flink.api.java.functions.KeySelector<INPUT,K> sortFieldSelector,
                                  org.apache.flink.api.common.operators.Order sortOrder)

方法详细资料

setup

public void setup(StreamTask<?,?> containingTask,
                  StreamConfig config,
                  Output<StreamRecord<INPUT>> output)

从接口复制的说明: SetupableStreamOperator

Initializes the operator. Sets access to the context and the output.

指定者:

setup 在接口中 SetupableStreamOperator<INPUT>

覆盖:

setup 在类中 AbstractStreamOperator<INPUT>

processElement

public void processElement(StreamRecord<INPUT> element)
                    throws Exception

从接口复制的说明: Input

Processes one element that arrived on this input of the MultipleInputStreamOperator. This method is guaranteed to not be called concurrently with other methods of the operator.

指定者:

processElement 在接口中 Input<INPUT>

抛出:

Exception

endInput

public void endInput()
              throws Exception

从接口复制的说明: BoundedOneInput

It is notified that no more data will arrive from the input.

WARNING: It is not safe to use this method to commit any transactions or other side effects! You can use this method to flush any buffered data that can later on be committed e.g. in a CheckpointListener.notifyCheckpointComplete(long).

NOTE: Given it is semantically very similar to the StreamOperator.finish() method. It might be dropped in favour of the other method at some point in time.

指定者:

endInput 在接口中 BoundedOneInput

抛出:

Exception

getOperatorAttributes

public OperatorAttributes getOperatorAttributes()

从接口复制的说明: StreamOperator

Called to get the OperatorAttributes of the operator. If there is no defined attribute, a default OperatorAttributes is built.

指定者:

getOperatorAttributes 在接口中 StreamOperator<INPUT>

返回:

OperatorAttributes of the operator.