org.apache.flink.streaming.api.operators.sortpartition

类 SortPartitionOperator<INPUT>

java.lang.Object

org.apache.flink.streaming.api.operators.AbstractStreamOperator<INPUT>

org.apache.flink.streaming.api.operators.sortpartition.SortPartitionOperator<INPUT>

类型参数:

INPUT - The type of input record.

所有已实现的接口:

Serializable, org.apache.flink.api.common.state.CheckpointListener, BoundedOneInput, Input<INPUT>, KeyContext, KeyContextHandler, OneInputStreamOperator<INPUT,INPUT>, SetupableStreamOperator<INPUT>, StreamOperator<INPUT>, StreamOperatorStateHandler.CheckpointedStreamOperator, YieldingOperator<INPUT>

@Internal
public class SortPartitionOperator<INPUT>
extends AbstractStreamOperator<INPUT>
implements OneInputStreamOperator<INPUT,INPUT>, BoundedOneInput

The SortPartitionOperator sorts records of a partition on non-keyed data stream. It ensures that all records within the same task are sorted in a user-defined order.

To sort the records, the record will be written to ExternalSorter directly. However, if the record is sorted according to the selected key by KeySelector, the selected key should also be written with the record to ExternalSorter to avoid repeated key selections.

另请参阅:

序列化表格

字段概要

字段

限定符和类型	字段和说明
protected org.apache.flink.api.common.typeinfo.TypeInformation<INPUT>	inputType The type information of input records.
protected org.apache.flink.api.java.functions.KeySelector<INPUT,?>	sortFieldSelector The selector to create the sort key for records, which will be null if it's not used.

从类继承的字段 org.apache.flink.streaming.api.operators.AbstractStreamOperator

chainingStrategy, config, lastRecordAttributes1, lastRecordAttributes2, latencyStats, LOG, metrics, output, processingTimeService, stateHandler, stateKeySelector1, stateKeySelector2, timeServiceManager

构造器概要

构造器

构造器和说明
SortPartitionOperator(org.apache.flink.api.common.typeinfo.TypeInformation<INPUT> inputType, int positionSortField, org.apache.flink.api.common.operators.Order sortOrder)
SortPartitionOperator(org.apache.flink.api.common.typeinfo.TypeInformation<INPUT> inputType, org.apache.flink.api.java.functions.KeySelector<INPUT,K> sortFieldSelector, org.apache.flink.api.common.operators.Order sortOrder)
SortPartitionOperator(org.apache.flink.api.common.typeinfo.TypeInformation<INPUT> inputType, String stringSortField, org.apache.flink.api.common.operators.Order sortOrder)

方法概要

限定符和类型	方法和说明
void	endInput() It is notified that no more data will arrive from the input.
OperatorAttributes	getOperatorAttributes() Called to get the OperatorAttributes of the operator.
void	processElement(StreamRecord<INPUT> element) Processes one element that arrived on this input of the MultipleInputStreamOperator.
void	setup(StreamTask<?,?> containingTask, StreamConfig config, Output<StreamRecord<INPUT>> output) Initializes the operator.

从类继承的方法 org.apache.flink.streaming.api.operators.AbstractStreamOperator

close, finish, getChainingStrategy, getContainingTask, getCurrentKey, getExecutionConfig, getInternalTimerService, getKeyedStateBackend, getKeyedStateStore, getMetricGroup, getOperatorConfig, getOperatorID, getOperatorName, getOperatorStateBackend, getOrCreateKeyedState, getPartitionedState, getPartitionedState, getProcessingTimeService, getRuntimeContext, getStateKeySelector1, getStateKeySelector2, getTimeServiceManager, getUserCodeClassloader, hasKeyContext1, hasKeyContext2, initializeState, initializeState, isUsingCustomRawKeyedState, notifyCheckpointAborted, notifyCheckpointComplete, open, prepareSnapshotPreBarrier, processLatencyMarker, processLatencyMarker1, processLatencyMarker2, processRecordAttributes, processRecordAttributes1, processRecordAttributes2, processWatermark, processWatermark1, processWatermark2, processWatermarkStatus, processWatermarkStatus1, processWatermarkStatus2, reportOrForwardLatencyMarker, setChainingStrategy, setCurrentKey, setKeyContextElement1, setKeyContextElement2, setMailboxExecutor, setProcessingTimeService, snapshotState, snapshotState, useSplittableTimers

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

从接口继承的方法 org.apache.flink.streaming.api.operators.OneInputStreamOperator

setKeyContextElement

从接口继承的方法 org.apache.flink.streaming.api.operators.StreamOperator

close, finish, getMetricGroup, getOperatorID, initializeState, open, prepareSnapshotPreBarrier, setKeyContextElement1, setKeyContextElement2, snapshotState

从接口继承的方法 org.apache.flink.api.common.state.CheckpointListener

notifyCheckpointAborted, notifyCheckpointComplete

从接口继承的方法 org.apache.flink.streaming.api.operators.KeyContext

getCurrentKey, setCurrentKey

从接口继承的方法 org.apache.flink.streaming.api.operators.Input

processLatencyMarker, processRecordAttributes, processWatermark, processWatermarkStatus

从接口继承的方法 org.apache.flink.streaming.api.operators.KeyContextHandler

hasKeyContext

字段详细资料

inputType

protected final org.apache.flink.api.common.typeinfo.TypeInformation<INPUT> inputType

The type information of input records.

sortFieldSelector

protected final org.apache.flink.api.java.functions.KeySelector<INPUT,?> sortFieldSelector

The selector to create the sort key for records, which will be null if it's not used.

构造器详细资料

SortPartitionOperator

public SortPartitionOperator(org.apache.flink.api.common.typeinfo.TypeInformation<INPUT> inputType,
                             int positionSortField,
                             org.apache.flink.api.common.operators.Order sortOrder)

SortPartitionOperator

public SortPartitionOperator(org.apache.flink.api.common.typeinfo.TypeInformation<INPUT> inputType,
                             String stringSortField,
                             org.apache.flink.api.common.operators.Order sortOrder)

SortPartitionOperator

public SortPartitionOperator(org.apache.flink.api.common.typeinfo.TypeInformation<INPUT> inputType,
                             org.apache.flink.api.java.functions.KeySelector<INPUT,K> sortFieldSelector,
                             org.apache.flink.api.common.operators.Order sortOrder)

方法详细资料

setup

public void setup(StreamTask<?,?> containingTask,
                  StreamConfig config,
                  Output<StreamRecord<INPUT>> output)

从接口复制的说明: SetupableStreamOperator

Initializes the operator. Sets access to the context and the output.

指定者:

setup 在接口中 SetupableStreamOperator<INPUT>

覆盖:

setup 在类中 AbstractStreamOperator<INPUT>

processElement

public void processElement(StreamRecord<INPUT> element)
                    throws Exception

从接口复制的说明: Input

Processes one element that arrived on this input of the MultipleInputStreamOperator. This method is guaranteed to not be called concurrently with other methods of the operator.

指定者:

processElement 在接口中 Input<INPUT>

抛出:

Exception

endInput

public void endInput()
              throws Exception

从接口复制的说明: BoundedOneInput

It is notified that no more data will arrive from the input.

WARNING: It is not safe to use this method to commit any transactions or other side effects! You can use this method to flush any buffered data that can later on be committed e.g. in a CheckpointListener.notifyCheckpointComplete(long).

NOTE: Given it is semantically very similar to the StreamOperator.finish() method. It might be dropped in favour of the other method at some point in time.

指定者:

endInput 在接口中 BoundedOneInput

抛出:

Exception

getOperatorAttributes

public OperatorAttributes getOperatorAttributes()

从接口复制的说明: StreamOperator

Called to get the OperatorAttributes of the operator. If there is no defined attribute, a default OperatorAttributes is built.

指定者:

getOperatorAttributes 在接口中 StreamOperator<INPUT>

返回:

OperatorAttributes of the operator.