| Package | Description |
|---|---|
| org.apache.flink.streaming.api.connector.sink2 | |
| org.apache.flink.streaming.api.functions.query | |
| org.apache.flink.streaming.api.functions.source | |
| org.apache.flink.streaming.api.operators | |
| org.apache.flink.streaming.api.operators.async | |
| org.apache.flink.streaming.api.operators.co | |
| org.apache.flink.streaming.api.operators.sortpartition | |
| org.apache.flink.streaming.runtime.io | |
| org.apache.flink.streaming.runtime.operators |
This package contains the operators that perform the stream transformations.
|
| org.apache.flink.streaming.runtime.operators.asyncprocessing | |
| org.apache.flink.streaming.runtime.operators.windowing |
This package contains the operators that implement the various window operations on data streams.
|
| org.apache.flink.streaming.runtime.partitioner | |
| org.apache.flink.streaming.runtime.streamrecord | |
| org.apache.flink.streaming.runtime.tasks |
This package contains classes that realize streaming tasks.
|
| org.apache.flink.streaming.runtime.translators |
| Modifier and Type | Method and Description |
|---|---|
void |
GlobalCommitterOperator.processElement(StreamRecord<CommittableMessage<CommT>> element) |
| Modifier and Type | Method and Description |
|---|---|
void |
GlobalCommitterOperator.setup(StreamTask<?,?> containingTask,
StreamConfig config,
Output<StreamRecord<Void>> output) |
| Modifier and Type | Method and Description |
|---|---|
void |
QueryableValueStateOperator.processElement(StreamRecord<IN> element) |
void |
QueryableAppendingStateOperator.processElement(StreamRecord<IN> element) |
| Modifier and Type | Method and Description |
|---|---|
void |
ContinuousFileReaderOperator.processElement(StreamRecord<T> element) |
| Modifier and Type | Field and Description |
|---|---|
protected Output<StreamRecord<OUT>> |
AbstractStreamOperator.output |
protected Output<StreamRecord<OUT>> |
AbstractInput.output |
protected Output<StreamRecord<OUT>> |
AbstractStreamOperatorV2.output |
| Modifier and Type | Method and Description |
|---|---|
Output<StreamRecord<OUT>> |
StreamOperatorParameters.getOutput() |
org.apache.flink.util.function.ThrowingConsumer<StreamRecord<IN>,Exception> |
AbstractInput.getRecordProcessor(int inputId) |
| Modifier and Type | Method and Description |
|---|---|
<X> void |
Output.collect(org.apache.flink.util.OutputTag<X> outputTag,
StreamRecord<X> record)
Emits a record to the side output identified by the given
OutputTag. |
<X> void |
TimestampedCollector.collect(org.apache.flink.util.OutputTag<X> outputTag,
StreamRecord<X> record) |
<X> void |
CountingOutput.collect(org.apache.flink.util.OutputTag<X> outputTag,
StreamRecord<X> record) |
void |
CountingOutput.collect(StreamRecord<OUT> record) |
protected <T> void |
AbstractStreamOperatorV2.internalSetKeyContextElement(StreamRecord<T> record,
org.apache.flink.api.java.functions.KeySelector<T,?> selector) |
void |
StreamFlatMap.processElement(StreamRecord<IN> element) |
void |
BatchGroupedReduceOperator.processElement(StreamRecord<IN> element) |
void |
StreamProject.processElement(StreamRecord<IN> element) |
void |
Input.processElement(StreamRecord<IN> element)
Processes one element that arrived on this input of the
MultipleInputStreamOperator. |
void |
ProcessOperator.processElement(StreamRecord<IN> element) |
void |
MapPartitionOperator.processElement(StreamRecord<IN> element) |
void |
StreamFilter.processElement(StreamRecord<IN> element) |
void |
KeyedProcessOperator.processElement(StreamRecord<IN> element) |
void |
StreamGroupedReduceOperator.processElement(StreamRecord<IN> element) |
void |
LegacyKeyedProcessOperator.processElement(StreamRecord<IN> element)
Deprecated.
|
void |
PartitionReduceOperator.processElement(StreamRecord<IN> element) |
void |
StreamSink.processElement(StreamRecord<IN> element) |
void |
StreamMap.processElement(StreamRecord<IN> element) |
void |
PartitionAggregateOperator.processElement(StreamRecord<IN> element) |
void |
TwoInputStreamOperator.processElement1(StreamRecord<IN1> element)
Processes one element that arrived on the first input of this two-input operator.
|
void |
TwoInputStreamOperator.processElement2(StreamRecord<IN2> element)
Processes one element that arrived on the second input of this two-input operator.
|
void |
AbstractInput.setKeyContextElement(StreamRecord record) |
void |
Input.setKeyContextElement(StreamRecord<IN> record)
Set the correct key context before processing the
record. |
default void |
OneInputStreamOperator.setKeyContextElement(StreamRecord<IN> record) |
void |
AbstractStreamOperator.setKeyContextElement1(StreamRecord record) |
void |
AbstractStreamOperatorV2.setKeyContextElement1(StreamRecord<?> record) |
void |
StreamOperator.setKeyContextElement1(StreamRecord<?> record) |
void |
AbstractStreamOperator.setKeyContextElement2(StreamRecord record) |
void |
AbstractStreamOperatorV2.setKeyContextElement2(StreamRecord<?> record) |
void |
StreamOperator.setKeyContextElement2(StreamRecord<?> record) |
void |
TimestampedCollector.setTimestamp(StreamRecord<?> timestampBase) |
| Modifier and Type | Method and Description |
|---|---|
static <OUT,OP extends StreamOperator<OUT>> |
StreamOperatorFactoryUtil.createOperator(StreamOperatorFactory<OUT> operatorFactory,
StreamTask<OUT,?> containingTask,
StreamConfig configuration,
Output<StreamRecord<OUT>> output,
org.apache.flink.runtime.operators.coordination.OperatorEventDispatcher operatorEventDispatcher)
Creates a new operator using a factory and makes sure that all special factory traits are
properly handled.
|
static <OUT> SourceFunction.SourceContext<OUT> |
StreamSourceContexts.getSourceContext(TimeCharacteristic timeCharacteristic,
ProcessingTimeService processingTimeService,
Object checkpointLock,
Output<StreamRecord<OUT>> output,
long watermarkInterval,
long idleTimeout,
boolean emitProgressiveWatermarks)
Deprecated.
Depending on the
TimeCharacteristic, this method will return the adequate SourceFunction.SourceContext. |
void |
StreamSource.run(Object lockingObject,
Output<StreamRecord<OUT>> collector,
OperatorChain<?,?> operatorChain)
Deprecated.
|
void |
SourceOperator.setup(StreamTask<?,?> containingTask,
StreamConfig config,
Output<StreamRecord<OUT>> output) |
void |
AbstractUdfStreamOperator.setup(StreamTask<?,?> containingTask,
StreamConfig config,
Output<StreamRecord<OUT>> output) |
void |
AbstractStreamOperator.setup(StreamTask<?,?> containingTask,
StreamConfig config,
Output<StreamRecord<OUT>> output) |
void |
SetupableStreamOperator.setup(StreamTask<?,?> containingTask,
StreamConfig config,
Output<StreamRecord<OUT>> output)
Deprecated.
Initializes the operator.
|
| Constructor and Description |
|---|
CountingOutput(WatermarkGaugeExposingOutput<StreamRecord<OUT>> output,
org.apache.flink.metrics.Counter numRecordsOut) |
MailboxWatermarkProcessor(Output<StreamRecord<OUT>> output,
org.apache.flink.api.common.operators.MailboxExecutor mailboxExecutor,
InternalTimeServiceManager<?> internalTimeServiceManager) |
StreamOperatorParameters(StreamTask<?,?> containingTask,
StreamConfig config,
Output<StreamRecord<OUT>> output,
Supplier<ProcessingTimeService> processingTimeServiceFactory,
org.apache.flink.runtime.operators.coordination.OperatorEventDispatcher operatorEventDispatcher,
org.apache.flink.api.common.operators.MailboxExecutor mailboxExecutor) |
TimestampedCollector(Output<StreamRecord<T>> output)
Creates a new
TimestampedCollector that wraps the given Output. |
| Modifier and Type | Method and Description |
|---|---|
void |
AsyncWaitOperator.processElement(StreamRecord<IN> record) |
| Modifier and Type | Method and Description |
|---|---|
void |
AsyncWaitOperator.setup(StreamTask<?,?> containingTask,
StreamConfig config,
Output<StreamRecord<OUT>> output) |
| Modifier and Type | Method and Description |
|---|---|
void |
BatchCoBroadcastWithKeyedOperator.processElement1(StreamRecord<IN1> element) |
void |
CoProcessOperator.processElement1(StreamRecord<IN1> element) |
void |
LegacyKeyedCoProcessOperator.processElement1(StreamRecord<IN1> element)
Deprecated.
|
void |
CoBroadcastWithNonKeyedOperator.processElement1(StreamRecord<IN1> element) |
void |
CoBroadcastWithKeyedOperator.processElement1(StreamRecord<IN1> element) |
void |
KeyedCoProcessOperator.processElement1(StreamRecord<IN1> element) |
void |
BatchCoBroadcastWithNonKeyedOperator.processElement1(StreamRecord<IN1> element) |
void |
CoStreamMap.processElement1(StreamRecord<IN1> element) |
void |
CoStreamFlatMap.processElement1(StreamRecord<IN1> element) |
void |
IntervalJoinOperator.processElement1(StreamRecord<T1> record)
Process a
StreamRecord from the left stream. |
void |
CoProcessOperator.processElement2(StreamRecord<IN2> element) |
void |
LegacyKeyedCoProcessOperator.processElement2(StreamRecord<IN2> element)
Deprecated.
|
void |
CoBroadcastWithNonKeyedOperator.processElement2(StreamRecord<IN2> element) |
void |
CoBroadcastWithKeyedOperator.processElement2(StreamRecord<IN2> element) |
void |
KeyedCoProcessOperator.processElement2(StreamRecord<IN2> element) |
void |
CoStreamMap.processElement2(StreamRecord<IN2> element) |
void |
CoStreamFlatMap.processElement2(StreamRecord<IN2> element) |
void |
IntervalJoinOperator.processElement2(StreamRecord<T2> record)
Process a
StreamRecord from the right stream. |
| Modifier and Type | Method and Description |
|---|---|
void |
KeyedSortPartitionOperator.processElement(StreamRecord<INPUT> element) |
void |
SortPartitionOperator.processElement(StreamRecord<INPUT> element) |
| Modifier and Type | Method and Description |
|---|---|
void |
KeyedSortPartitionOperator.setup(StreamTask<?,?> containingTask,
StreamConfig config,
Output<StreamRecord<INPUT>> output) |
void |
SortPartitionOperator.setup(StreamTask<?,?> containingTask,
StreamConfig config,
Output<StreamRecord<INPUT>> output) |
| Modifier and Type | Method and Description |
|---|---|
static <T> org.apache.flink.util.function.ThrowingConsumer<StreamRecord<T>,Exception> |
RecordProcessorUtils.getRecordProcessor(Input<T> input)
Get record processor for
Input, which will omit call of Input.setKeyContextElement(org.apache.flink.streaming.runtime.streamrecord.StreamRecord<IN>) if it doesn't have key context. |
static <T> org.apache.flink.util.function.ThrowingConsumer<StreamRecord<T>,Exception> |
RecordProcessorUtils.getRecordProcessor1(TwoInputStreamOperator<T,?,?> operator)
Get record processor for the first input of
TwoInputStreamOperator, which will omit
call of StreamOperator.setKeyContextElement1(org.apache.flink.streaming.runtime.streamrecord.StreamRecord<?>) if it doesn't have key context. |
static <T> org.apache.flink.util.function.ThrowingConsumer<StreamRecord<T>,Exception> |
RecordProcessorUtils.getRecordProcessor2(TwoInputStreamOperator<?,T,?> operator)
Get record processor for the second input of
TwoInputStreamOperator, which will omit
call of StreamOperator.setKeyContextElement2(org.apache.flink.streaming.runtime.streamrecord.StreamRecord<?>) if it doesn't have key context. |
| Modifier and Type | Method and Description |
|---|---|
<X> void |
RecordWriterOutput.collect(org.apache.flink.util.OutputTag<X> outputTag,
StreamRecord<X> record) |
void |
RecordWriterOutput.collect(StreamRecord<OUT> record) |
<X> boolean |
RecordWriterOutput.collectAndCheckIfChained(org.apache.flink.util.OutputTag<X> outputTag,
StreamRecord<X> record) |
boolean |
RecordWriterOutput.collectAndCheckIfChained(StreamRecord<OUT> record) |
void |
FinishedDataOutput.emitRecord(StreamRecord<IN> streamRecord) |
void |
PushingAsyncDataInput.DataOutput.emitRecord(StreamRecord<T> streamRecord) |
| Constructor and Description |
|---|
RecordWriterOutput(org.apache.flink.runtime.io.network.api.writer.RecordWriter<org.apache.flink.runtime.plugable.SerializationDelegate<StreamRecord<OUT>>> recordWriter,
org.apache.flink.api.common.typeutils.TypeSerializer<OUT> outSerializer,
org.apache.flink.util.OutputTag outputTag,
boolean supportsUnalignedCheckpoints) |
| Modifier and Type | Method and Description |
|---|---|
void |
GenericWriteAheadSink.processElement(StreamRecord<IN> element) |
void |
TimestampsAndWatermarksOperator.processElement(StreamRecord<T> element) |
| Modifier and Type | Method and Description |
|---|---|
<T> org.apache.flink.util.function.ThrowingConsumer<StreamRecord<T>,Exception> |
AsyncStateProcessing.getRecordProcessor(int inputId)
Get the record processor that could process record from input, which is the only entry for
async processing.
|
<T> org.apache.flink.util.function.ThrowingConsumer<StreamRecord<T>,Exception> |
AbstractAsyncStateStreamOperator.getRecordProcessor(int inputId) |
<T> org.apache.flink.util.function.ThrowingConsumer<StreamRecord<T>,Exception> |
AbstractAsyncStateStreamOperatorV2.getRecordProcessor(int inputId) |
static <T> org.apache.flink.util.function.ThrowingConsumer<StreamRecord<T>,Exception> |
AsyncStateProcessing.makeRecordProcessor(AsyncStateProcessingOperator asyncOperator,
org.apache.flink.api.java.functions.KeySelector<T,?> keySelector,
org.apache.flink.util.function.ThrowingConsumer<StreamRecord<T>,Exception> processor)
Static method helper to make a record processor with given infos.
|
| Modifier and Type | Method and Description |
|---|---|
<T> void |
AbstractAsyncStateStreamOperator.setAsyncKeyedContextElement(StreamRecord<T> record,
org.apache.flink.api.java.functions.KeySelector<T,?> keySelector) |
<T> void |
AbstractAsyncStateStreamOperatorV2.setAsyncKeyedContextElement(StreamRecord<T> record,
org.apache.flink.api.java.functions.KeySelector<T,?> keySelector) |
<T> void |
AsyncStateProcessingOperator.setAsyncKeyedContextElement(StreamRecord<T> record,
org.apache.flink.api.java.functions.KeySelector<T,?> keySelector)
Set key context for async state processing.
|
void |
AbstractAsyncStateStreamOperator.setKeyContextElement1(StreamRecord record) |
void |
AbstractAsyncStateStreamOperator.setKeyContextElement2(StreamRecord record) |
| Modifier and Type | Method and Description |
|---|---|
static <T> org.apache.flink.util.function.ThrowingConsumer<StreamRecord<T>,Exception> |
AsyncStateProcessing.makeRecordProcessor(AsyncStateProcessingOperator asyncOperator,
org.apache.flink.api.java.functions.KeySelector<T,?> keySelector,
org.apache.flink.util.function.ThrowingConsumer<StreamRecord<T>,Exception> processor)
Static method helper to make a record processor with given infos.
|
void |
AbstractAsyncStateUdfStreamOperator.setup(StreamTask<?,?> containingTask,
StreamConfig config,
Output<StreamRecord<OUT>> output) |
| Modifier and Type | Method and Description |
|---|---|
StreamRecord<T> |
TimestampedValue.getStreamRecord()
Creates a
StreamRecord from this TimestampedValue. |
| Modifier and Type | Method and Description |
|---|---|
static <T> TimestampedValue<T> |
TimestampedValue.from(StreamRecord<T> streamRecord)
Creates a TimestampedValue from given
StreamRecord. |
protected boolean |
WindowOperator.isElementLate(StreamRecord<IN> element)
Decide if a record is currently late, based on current watermark and allowed lateness.
|
TriggerResult |
WindowOperator.Context.onElement(StreamRecord<IN> element) |
void |
EvictingWindowOperator.processElement(StreamRecord<IN> element) |
void |
WindowOperator.processElement(StreamRecord<IN> element) |
protected void |
WindowOperator.sideOutput(StreamRecord<IN> element)
Write skipped late arriving element to SideOutput.
|
| Constructor and Description |
|---|
EvictingWindowOperator(WindowAssigner<? super IN,W> windowAssigner,
org.apache.flink.api.common.typeutils.TypeSerializer<W> windowSerializer,
org.apache.flink.api.java.functions.KeySelector<IN,K> keySelector,
org.apache.flink.api.common.typeutils.TypeSerializer<K> keySerializer,
org.apache.flink.api.common.state.StateDescriptor<? extends org.apache.flink.api.common.state.ListState<StreamRecord<IN>>,?> windowStateDescriptor,
InternalWindowFunction<Iterable<IN>,OUT,K,W> windowFunction,
Trigger<? super IN,? super W> trigger,
Evictor<? super IN,? super W> evictor,
long allowedLateness,
org.apache.flink.util.OutputTag<IN> lateDataOutputTag) |
| Modifier and Type | Method and Description |
|---|---|
int |
BroadcastPartitioner.selectChannel(org.apache.flink.runtime.plugable.SerializationDelegate<StreamRecord<T>> record)
Note: Broadcast mode could be handled directly for all the output channels in record writer,
so it is no need to select channels via this method.
|
int |
ForwardPartitioner.selectChannel(org.apache.flink.runtime.plugable.SerializationDelegate<StreamRecord<T>> record) |
int |
CustomPartitionerWrapper.selectChannel(org.apache.flink.runtime.plugable.SerializationDelegate<StreamRecord<T>> record) |
int |
RebalancePartitioner.selectChannel(org.apache.flink.runtime.plugable.SerializationDelegate<StreamRecord<T>> record) |
int |
ForwardForConsecutiveHashPartitioner.selectChannel(org.apache.flink.runtime.plugable.SerializationDelegate<StreamRecord<T>> record) |
int |
ForwardForUnspecifiedPartitioner.selectChannel(org.apache.flink.runtime.plugable.SerializationDelegate<StreamRecord<T>> record) |
int |
GlobalPartitioner.selectChannel(org.apache.flink.runtime.plugable.SerializationDelegate<StreamRecord<T>> record) |
int |
KeyGroupStreamPartitioner.selectChannel(org.apache.flink.runtime.plugable.SerializationDelegate<StreamRecord<T>> record) |
int |
ShufflePartitioner.selectChannel(org.apache.flink.runtime.plugable.SerializationDelegate<StreamRecord<T>> record) |
int |
RescalePartitioner.selectChannel(org.apache.flink.runtime.plugable.SerializationDelegate<StreamRecord<T>> record) |
| Modifier and Type | Method and Description |
|---|---|
<E> StreamRecord<E> |
StreamElement.asRecord()
Casts this element into a StreamRecord.
|
StreamRecord<T> |
StreamRecord.copy(T valueCopy)
Creates a copy of this stream record.
|
StreamRecord<T> |
StreamElementSerializer.createInstance() |
<X> StreamRecord<X> |
StreamRecord.replace(X element)
Replace the currently stored value by the given new value.
|
<X> StreamRecord<X> |
StreamRecord.replace(X value,
long timestamp)
Replace the currently stored value by the given new value and the currently stored timestamp
with the new timestamp.
|
| Modifier and Type | Method and Description |
|---|---|
void |
StreamRecord.copyTo(T valueCopy,
StreamRecord<T> target)
Copies this record into the new stream record.
|
| Modifier and Type | Field and Description |
|---|---|
protected WatermarkGaugeExposingOutput<StreamRecord<OUT>> |
OperatorChain.mainOperatorOutput |
protected org.apache.flink.runtime.io.network.api.writer.RecordWriterDelegate<org.apache.flink.runtime.plugable.SerializationDelegate<StreamRecord<OUT>>> |
StreamTask.recordWriter |
| Modifier and Type | Method and Description |
|---|---|
static <OUT> org.apache.flink.runtime.io.network.api.writer.RecordWriterDelegate<org.apache.flink.runtime.plugable.SerializationDelegate<StreamRecord<OUT>>> |
StreamTask.createRecordWriterDelegate(StreamConfig configuration,
org.apache.flink.runtime.execution.Environment environment) |
List<Output<StreamRecord<?>>> |
OperatorChain.getChainedSourceOutputs() |
WatermarkGaugeExposingOutput<StreamRecord<OUT>> |
FinishedOperatorChain.getMainOperatorOutput() |
WatermarkGaugeExposingOutput<StreamRecord<OUT>> |
OperatorChain.getMainOperatorOutput() |
WatermarkGaugeExposingOutput<StreamRecord<?>> |
OperatorChain.ChainedSource.getSourceOutput() |
| Modifier and Type | Method and Description |
|---|---|
<X> void |
FinishedOnRestoreMainOperatorOutput.collect(org.apache.flink.util.OutputTag<X> outputTag,
StreamRecord<X> record) |
<X> boolean |
OutputWithChainingCheck.collectAndCheckIfChained(org.apache.flink.util.OutputTag<X> outputTag,
StreamRecord<X> record) |
void |
SourceOperatorStreamTask.AsyncDataOutputToOutput.emitRecord(StreamRecord<T> streamRecord) |
void |
FinishedOnRestoreInput.processElement(StreamRecord<IN> element) |
void |
FinishedOnRestoreInput.setKeyContextElement(StreamRecord<IN> record) |
| Constructor and Description |
|---|
AsyncDataOutputToOutput(Output<StreamRecord<T>> output,
org.apache.flink.runtime.metrics.groups.InternalSourceReaderMetricGroup metricGroup,
WatermarkGauge inputWatermarkGauge) |
ChainedSource(WatermarkGaugeExposingOutput<StreamRecord<?>> chainedSourceOutput,
StreamTaskSourceInput<?> sourceTaskInput) |
FinishedOperatorChain(StreamTask<OUT,OP> containingTask,
org.apache.flink.runtime.io.network.api.writer.RecordWriterDelegate<org.apache.flink.runtime.plugable.SerializationDelegate<StreamRecord<OUT>>> recordWriterDelegate) |
OperatorChain(StreamTask<OUT,OP> containingTask,
org.apache.flink.runtime.io.network.api.writer.RecordWriterDelegate<org.apache.flink.runtime.plugable.SerializationDelegate<StreamRecord<OUT>>> recordWriterDelegate) |
RegularOperatorChain(StreamTask<OUT,OP> containingTask,
org.apache.flink.runtime.io.network.api.writer.RecordWriterDelegate<org.apache.flink.runtime.plugable.SerializationDelegate<StreamRecord<OUT>>> recordWriterDelegate) |
| Modifier and Type | Method and Description |
|---|---|
void |
CacheTransformationTranslator.NoOpStreamOperator.processElement(StreamRecord<T> element) |
void |
CacheTransformationTranslator.IdentityStreamOperator.processElement(StreamRecord<T> element) |
Copyright © 2014–2025 The Apache Software Foundation. All rights reserved.