org.apache.flink.datastream.impl.stream

Class KeyedPartitionStreamImpl<K,V>

java.lang.Object

org.apache.flink.datastream.impl.stream.AbstractDataStream<V>

org.apache.flink.datastream.impl.stream.KeyedPartitionStreamImpl<K,V>

All Implemented Interfaces:

org.apache.flink.datastream.api.stream.DataStream, org.apache.flink.datastream.api.stream.KeyedPartitionStream<K,V>

public class KeyedPartitionStreamImpl<K,V>
extends AbstractDataStream<V>
implements org.apache.flink.datastream.api.stream.KeyedPartitionStream<K,V>

The implementation of KeyedPartitionStream.

Nested Class Summary

Nested classes/interfaces inherited from interface org.apache.flink.datastream.api.stream.KeyedPartitionStream

org.apache.flink.datastream.api.stream.KeyedPartitionStream.ProcessConfigurableAndKeyedPartitionStream<K,T>, org.apache.flink.datastream.api.stream.KeyedPartitionStream.TwoKeyedPartitionStreams<K,T1,T2>

Field Summary

Fields inherited from class org.apache.flink.datastream.impl.stream.AbstractDataStream

environment, requestedSideOutputs, transformation

Constructor Summary

Constructors

Constructor and Description
KeyedPartitionStreamImpl(AbstractDataStream<V> dataStream, org.apache.flink.api.java.functions.KeySelector<V,K> keySelector)
KeyedPartitionStreamImpl(AbstractDataStream<V> dataStream, org.apache.flink.api.java.functions.KeySelector<V,K> keySelector, org.apache.flink.api.common.typeinfo.TypeInformation<K> keyType)
KeyedPartitionStreamImpl(AbstractDataStream<V> dataStream, org.apache.flink.api.dag.Transformation<V> partitionTransformation, org.apache.flink.api.java.functions.KeySelector<V,K> keySelector, org.apache.flink.api.common.typeinfo.TypeInformation<K> keyType) This can construct a keyed stream directly without partitionTransformation to avoid shuffle.

Method Summary

Modifier and Type	Method and Description
org.apache.flink.datastream.api.stream.BroadcastStream<V>	broadcast()
<T_OTHER,OUT> org.apache.flink.datastream.api.stream.NonKeyedPartitionStream.ProcessConfigurableAndNonKeyedPartitionStream<OUT>	connectAndProcess(org.apache.flink.datastream.api.stream.BroadcastStream<T_OTHER> other, org.apache.flink.datastream.api.function.TwoInputBroadcastStreamProcessFunction<V,T_OTHER,OUT> processFunction)
<T_OTHER,OUT> org.apache.flink.datastream.api.stream.KeyedPartitionStream.ProcessConfigurableAndKeyedPartitionStream<K,OUT>	connectAndProcess(org.apache.flink.datastream.api.stream.BroadcastStream<T_OTHER> other, org.apache.flink.datastream.api.function.TwoInputBroadcastStreamProcessFunction<V,T_OTHER,OUT> processFunction, org.apache.flink.api.java.functions.KeySelector<OUT,K> newKeySelector)
<T_OTHER,OUT> org.apache.flink.datastream.api.stream.NonKeyedPartitionStream.ProcessConfigurableAndNonKeyedPartitionStream<OUT>	connectAndProcess(org.apache.flink.datastream.api.stream.KeyedPartitionStream<K,T_OTHER> other, org.apache.flink.datastream.api.function.TwoInputNonBroadcastStreamProcessFunction<V,T_OTHER,OUT> processFunction)
<T_OTHER,OUT> org.apache.flink.datastream.api.stream.KeyedPartitionStream.ProcessConfigurableAndKeyedPartitionStream<K,OUT>	connectAndProcess(org.apache.flink.datastream.api.stream.KeyedPartitionStream<K,T_OTHER> other, org.apache.flink.datastream.api.function.TwoInputNonBroadcastStreamProcessFunction<V,T_OTHER,OUT> processFunction, org.apache.flink.api.java.functions.KeySelector<OUT,K> newKeySelector)
org.apache.flink.api.java.functions.KeySelector<V,K>	getKeySelector()
org.apache.flink.api.common.typeinfo.TypeInformation<K>	getKeyType()
org.apache.flink.datastream.api.stream.GlobalStream<V>	global()
<NEW_KEY> org.apache.flink.datastream.api.stream.KeyedPartitionStream<NEW_KEY,V>	keyBy(org.apache.flink.api.java.functions.KeySelector<V,NEW_KEY> keySelector)
<OUT> org.apache.flink.datastream.api.stream.NonKeyedPartitionStream.ProcessConfigurableAndNonKeyedPartitionStream<OUT>	process(org.apache.flink.datastream.api.function.OneInputStreamProcessFunction<V,OUT> processFunction)
<OUT> org.apache.flink.datastream.api.stream.KeyedPartitionStream.ProcessConfigurableAndKeyedPartitionStream<K,OUT>	process(org.apache.flink.datastream.api.function.OneInputStreamProcessFunction<V,OUT> processFunction, org.apache.flink.api.java.functions.KeySelector<OUT,K> newKeySelector)
<OUT1,OUT2> org.apache.flink.datastream.api.stream.NonKeyedPartitionStream.TwoNonKeyedPartitionStreams<OUT1,OUT2>	process(org.apache.flink.datastream.api.function.TwoOutputStreamProcessFunction<V,OUT1,OUT2> processFunction)
<OUT1,OUT2> org.apache.flink.datastream.api.stream.KeyedPartitionStream.TwoKeyedPartitionStreams<K,OUT1,OUT2>	process(org.apache.flink.datastream.api.function.TwoOutputStreamProcessFunction<V,OUT1,OUT2> processFunction, org.apache.flink.api.java.functions.KeySelector<OUT1,K> keySelector1, org.apache.flink.api.java.functions.KeySelector<OUT2,K> keySelector2)
org.apache.flink.datastream.api.stream.NonKeyedPartitionStream<V>	shuffle()
org.apache.flink.datastream.api.stream.ProcessConfigurable<?>	toSink(org.apache.flink.api.connector.dsv2.Sink<V> sink)

Methods inherited from class org.apache.flink.datastream.impl.stream.AbstractDataStream

getEnvironment, getSideOutputTransform, getTransformation, getType

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

KeyedPartitionStreamImpl

public KeyedPartitionStreamImpl(AbstractDataStream<V> dataStream,
                                org.apache.flink.api.java.functions.KeySelector<V,K> keySelector)

KeyedPartitionStreamImpl

public KeyedPartitionStreamImpl(AbstractDataStream<V> dataStream,
                                org.apache.flink.api.java.functions.KeySelector<V,K> keySelector,
                                org.apache.flink.api.common.typeinfo.TypeInformation<K> keyType)

KeyedPartitionStreamImpl

public KeyedPartitionStreamImpl(AbstractDataStream<V> dataStream,
                                org.apache.flink.api.dag.Transformation<V> partitionTransformation,
                                org.apache.flink.api.java.functions.KeySelector<V,K> keySelector,
                                org.apache.flink.api.common.typeinfo.TypeInformation<K> keyType)

This can construct a keyed stream directly without partitionTransformation to avoid shuffle.

Method Detail

process

public <OUT> org.apache.flink.datastream.api.stream.NonKeyedPartitionStream.ProcessConfigurableAndNonKeyedPartitionStream<OUT> process(org.apache.flink.datastream.api.function.OneInputStreamProcessFunction<V,OUT> processFunction)

Specified by:

process in interface org.apache.flink.datastream.api.stream.KeyedPartitionStream<K,V>

process

public <OUT> org.apache.flink.datastream.api.stream.KeyedPartitionStream.ProcessConfigurableAndKeyedPartitionStream<K,OUT> process(org.apache.flink.datastream.api.function.OneInputStreamProcessFunction<V,OUT> processFunction,
                                                                                                                                   org.apache.flink.api.java.functions.KeySelector<OUT,K> newKeySelector)

Specified by:

process in interface org.apache.flink.datastream.api.stream.KeyedPartitionStream<K,V>

process

public <OUT1,OUT2> org.apache.flink.datastream.api.stream.KeyedPartitionStream.TwoKeyedPartitionStreams<K,OUT1,OUT2> process(org.apache.flink.datastream.api.function.TwoOutputStreamProcessFunction<V,OUT1,OUT2> processFunction,
                                                                                                                             org.apache.flink.api.java.functions.KeySelector<OUT1,K> keySelector1,
                                                                                                                             org.apache.flink.api.java.functions.KeySelector<OUT2,K> keySelector2)

Specified by:

process in interface org.apache.flink.datastream.api.stream.KeyedPartitionStream<K,V>

process

public <OUT1,OUT2> org.apache.flink.datastream.api.stream.NonKeyedPartitionStream.TwoNonKeyedPartitionStreams<OUT1,OUT2> process(org.apache.flink.datastream.api.function.TwoOutputStreamProcessFunction<V,OUT1,OUT2> processFunction)

Specified by:

process in interface org.apache.flink.datastream.api.stream.KeyedPartitionStream<K,V>

connectAndProcess

public <T_OTHER,OUT> org.apache.flink.datastream.api.stream.NonKeyedPartitionStream.ProcessConfigurableAndNonKeyedPartitionStream<OUT> connectAndProcess(org.apache.flink.datastream.api.stream.KeyedPartitionStream<K,T_OTHER> other,
                                                                                                                                                         org.apache.flink.datastream.api.function.TwoInputNonBroadcastStreamProcessFunction<V,T_OTHER,OUT> processFunction)

Specified by:

connectAndProcess in interface org.apache.flink.datastream.api.stream.KeyedPartitionStream<K,V>

connectAndProcess

public <T_OTHER,OUT> org.apache.flink.datastream.api.stream.KeyedPartitionStream.ProcessConfigurableAndKeyedPartitionStream<K,OUT> connectAndProcess(org.apache.flink.datastream.api.stream.KeyedPartitionStream<K,T_OTHER> other,
                                                                                                                                                     org.apache.flink.datastream.api.function.TwoInputNonBroadcastStreamProcessFunction<V,T_OTHER,OUT> processFunction,
                                                                                                                                                     org.apache.flink.api.java.functions.KeySelector<OUT,K> newKeySelector)

Specified by:

connectAndProcess in interface org.apache.flink.datastream.api.stream.KeyedPartitionStream<K,V>

connectAndProcess

public <T_OTHER,OUT> org.apache.flink.datastream.api.stream.NonKeyedPartitionStream.ProcessConfigurableAndNonKeyedPartitionStream<OUT> connectAndProcess(org.apache.flink.datastream.api.stream.BroadcastStream<T_OTHER> other,
                                                                                                                                                         org.apache.flink.datastream.api.function.TwoInputBroadcastStreamProcessFunction<V,T_OTHER,OUT> processFunction)

Specified by:

connectAndProcess in interface org.apache.flink.datastream.api.stream.KeyedPartitionStream<K,V>

connectAndProcess

public <T_OTHER,OUT> org.apache.flink.datastream.api.stream.KeyedPartitionStream.ProcessConfigurableAndKeyedPartitionStream<K,OUT> connectAndProcess(org.apache.flink.datastream.api.stream.BroadcastStream<T_OTHER> other,
                                                                                                                                                     org.apache.flink.datastream.api.function.TwoInputBroadcastStreamProcessFunction<V,T_OTHER,OUT> processFunction,
                                                                                                                                                     org.apache.flink.api.java.functions.KeySelector<OUT,K> newKeySelector)

Specified by:

connectAndProcess in interface org.apache.flink.datastream.api.stream.KeyedPartitionStream<K,V>

getKeyType

public org.apache.flink.api.common.typeinfo.TypeInformation<K> getKeyType()

getKeySelector

public org.apache.flink.api.java.functions.KeySelector<V,K> getKeySelector()

toSink

public org.apache.flink.datastream.api.stream.ProcessConfigurable<?> toSink(org.apache.flink.api.connector.dsv2.Sink<V> sink)

Specified by:

toSink in interface org.apache.flink.datastream.api.stream.KeyedPartitionStream<K,V>

global

public org.apache.flink.datastream.api.stream.GlobalStream<V> global()

Specified by:

global in interface org.apache.flink.datastream.api.stream.KeyedPartitionStream<K,V>

keyBy

public <NEW_KEY> org.apache.flink.datastream.api.stream.KeyedPartitionStream<NEW_KEY,V> keyBy(org.apache.flink.api.java.functions.KeySelector<V,NEW_KEY> keySelector)

Specified by:

keyBy in interface org.apache.flink.datastream.api.stream.KeyedPartitionStream<K,V>

shuffle

public org.apache.flink.datastream.api.stream.NonKeyedPartitionStream<V> shuffle()

Specified by:

shuffle in interface org.apache.flink.datastream.api.stream.KeyedPartitionStream<K,V>

broadcast

public org.apache.flink.datastream.api.stream.BroadcastStream<V> broadcast()

Specified by:

broadcast in interface org.apache.flink.datastream.api.stream.KeyedPartitionStream<K,V>