| Modifier and Type | Method and Description |
|---|---|
protected KinesisDataFetcher<T> |
FlinkKinesisConsumer.createFetcher(List<String> streams,
org.apache.flink.streaming.api.functions.source.SourceFunction.SourceContext<T> sourceContext,
org.apache.flink.api.common.functions.RuntimeContext runtimeContext,
Properties configProps,
KinesisDeserializationSchema<T> deserializationSchema)
This method is exposed for tests that need to mock the KinesisDataFetcher in the consumer.
|
protected KinesisDataFetcher<T> |
FlinkDynamoDBStreamsConsumer.createFetcher(List<String> streams,
org.apache.flink.streaming.api.functions.source.SourceFunction.SourceContext<T> sourceContext,
org.apache.flink.api.common.functions.RuntimeContext runtimeContext,
Properties configProps,
KinesisDeserializationSchema<T> deserializationSchema) |
| Constructor and Description |
|---|
FlinkDynamoDBStreamsConsumer(List<String> streams,
KinesisDeserializationSchema deserializer,
Properties config)
Constructor of FlinkDynamodbStreamConsumer.
|
FlinkKinesisConsumer(List<String> streams,
KinesisDeserializationSchema<T> deserializer,
Properties configProps)
Creates a new Flink Kinesis Consumer.
|
FlinkKinesisConsumer(String stream,
KinesisDeserializationSchema<T> deserializer,
Properties configProps)
Creates a new Flink Kinesis Consumer.
|
| Modifier and Type | Method and Description |
|---|---|
protected ShardConsumer<T> |
KinesisDataFetcher.createShardConsumer(Integer subscribedShardStateIndex,
StreamShardHandle subscribedShard,
SequenceNumber lastSequenceNum,
org.apache.flink.metrics.MetricGroup metricGroup,
KinesisDeserializationSchema<T> shardDeserializer)
Create a new shard consumer.
|
| Constructor and Description |
|---|
DynamoDBStreamsDataFetcher(List<String> streams,
org.apache.flink.streaming.api.functions.source.SourceFunction.SourceContext<T> sourceContext,
org.apache.flink.api.common.functions.RuntimeContext runtimeContext,
Properties configProps,
KinesisDeserializationSchema<T> deserializationSchema,
KinesisShardAssigner shardAssigner)
Constructor.
|
KinesisDataFetcher(List<String> streams,
org.apache.flink.streaming.api.functions.source.SourceFunction.SourceContext<T> sourceContext,
Object checkpointLock,
org.apache.flink.api.common.functions.RuntimeContext runtimeContext,
Properties configProps,
KinesisDeserializationSchema<T> deserializationSchema,
KinesisShardAssigner shardAssigner,
org.apache.flink.streaming.api.functions.AssignerWithPeriodicWatermarks<T> periodicWatermarkAssigner,
WatermarkTracker watermarkTracker,
AtomicReference<Throwable> error,
List<KinesisStreamShardState> subscribedShardsState,
HashMap<String,String> subscribedStreamsToLastDiscoveredShardIds,
KinesisDataFetcher.FlinkKinesisProxyFactory kinesisProxyFactory,
KinesisDataFetcher.FlinkKinesisProxyV2Factory kinesisProxyV2Factory) |
KinesisDataFetcher(List<String> streams,
org.apache.flink.streaming.api.functions.source.SourceFunction.SourceContext<T> sourceContext,
org.apache.flink.api.common.functions.RuntimeContext runtimeContext,
Properties configProps,
KinesisDeserializationSchema<T> deserializationSchema,
KinesisShardAssigner shardAssigner,
org.apache.flink.streaming.api.functions.AssignerWithPeriodicWatermarks<T> periodicWatermarkAssigner,
WatermarkTracker watermarkTracker)
Creates a Kinesis Data Fetcher.
|
ShardConsumer(KinesisDataFetcher<T> fetcherRef,
RecordPublisher recordPublisher,
Integer subscribedShardStateIndex,
StreamShardHandle subscribedShard,
SequenceNumber lastSequenceNum,
ShardConsumerMetricsReporter shardConsumerMetricsReporter,
KinesisDeserializationSchema<T> shardDeserializer)
Creates a shard consumer.
|
| Modifier and Type | Class and Description |
|---|---|
class |
DynamoDBStreamsSchema
Schema used for deserializing DynamoDB streams records.
|
class |
KinesisDeserializationSchemaWrapper<T>
A simple wrapper for using the
DeserializationSchema with the KinesisDeserializationSchema interface. |
| Modifier and Type | Class and Description |
|---|---|
class |
RowDataKinesisDeserializationSchema
A
KinesisDeserializationSchema adaptor for RowData records that delegates
physical data deserialization to an inner DeserializationSchema and appends requested
metadata to the end of the deserialized RowData record. |
Copyright © 2014–2022 The Apache Software Foundation. All rights reserved.