| Modifier and Type | Method and Description |
|---|---|
int |
KinesisShardAssigner.assign(StreamShardHandle shard,
int numParallelSubtasks)
Returns the index of the target subtask that a specific shard should be
assigned to.
|
| Modifier and Type | Method and Description |
|---|---|
static StreamShardHandle |
KinesisDataFetcher.convertToStreamShardHandle(StreamShardMetadata streamShardMetadata)
Utility function to convert
StreamShardMetadata into StreamShardHandle. |
| Modifier and Type | Method and Description |
|---|---|
List<StreamShardHandle> |
KinesisDataFetcher.discoverNewShardsToSubscribe()
A utility function that does the following:
|
| Modifier and Type | Method and Description |
|---|---|
static StreamShardMetadata |
KinesisDataFetcher.convertToStreamShardMetadata(StreamShardHandle streamShardHandle)
Utility function to convert
StreamShardHandle into StreamShardMetadata. |
protected RecordPublisher |
DynamoDBStreamsDataFetcher.createRecordPublisher(SequenceNumber sequenceNumber,
Properties configProps,
org.apache.flink.metrics.MetricGroup metricGroup,
StreamShardHandle subscribedShard) |
protected RecordPublisher |
KinesisDataFetcher.createRecordPublisher(SequenceNumber sequenceNumber,
Properties configProps,
org.apache.flink.metrics.MetricGroup metricGroup,
StreamShardHandle subscribedShard) |
protected ShardConsumer<T> |
KinesisDataFetcher.createShardConsumer(Integer subscribedShardStateIndex,
StreamShardHandle subscribedShard,
SequenceNumber lastSequenceNum,
org.apache.flink.metrics.MetricGroup metricGroup,
KinesisDeserializationSchema<T> shardDeserializer)
Create a new shard consumer.
|
| Constructor and Description |
|---|
ShardConsumer(KinesisDataFetcher<T> fetcherRef,
RecordPublisher recordPublisher,
Integer subscribedShardStateIndex,
StreamShardHandle subscribedShard,
SequenceNumber lastSequenceNum,
ShardConsumerMetricsReporter shardConsumerMetricsReporter,
KinesisDeserializationSchema<T> shardDeserializer)
Creates a shard consumer.
|
| Modifier and Type | Method and Description |
|---|---|
RecordPublisher |
RecordPublisherFactory.create(StartingPosition startingPosition,
Properties consumerConfig,
org.apache.flink.metrics.MetricGroup metricGroup,
StreamShardHandle streamShardHandle)
Create a
RecordPublisher. |
| Constructor and Description |
|---|
RecordBatch(List<com.amazonaws.services.kinesis.model.Record> records,
StreamShardHandle subscribedShard,
Long millisBehindLatest) |
| Modifier and Type | Method and Description |
|---|---|
FanOutRecordPublisher |
FanOutRecordPublisherFactory.create(StartingPosition startingPosition,
Properties consumerConfig,
org.apache.flink.metrics.MetricGroup metricGroup,
StreamShardHandle streamShardHandle)
Create a
FanOutRecordPublisher. |
| Constructor and Description |
|---|
FanOutRecordPublisher(StartingPosition startingPosition,
String consumerArn,
StreamShardHandle subscribedShard,
KinesisProxyV2Interface kinesisProxy,
FanOutRecordPublisherConfiguration configuration,
FullJitterBackoff backoff)
Instantiate a new FanOutRecordPublisher.
|
| Modifier and Type | Method and Description |
|---|---|
PollingRecordPublisher |
PollingRecordPublisherFactory.create(StartingPosition startingPosition,
Properties consumerConfig,
org.apache.flink.metrics.MetricGroup metricGroup,
StreamShardHandle streamShardHandle)
Create a
PollingRecordPublisher. |
| Modifier and Type | Class and Description |
|---|---|
class |
DynamoDBStreamsShardHandle
DynamoDB streams shard handle format and utilities.
|
| Modifier and Type | Method and Description |
|---|---|
StreamShardHandle |
KinesisStreamShardState.getStreamShardHandle() |
| Constructor and Description |
|---|
KinesisStreamShardState(StreamShardMetadata streamShardMetadata,
StreamShardHandle streamShardHandle,
SequenceNumber lastProcessedSequenceNum) |
| Modifier and Type | Method and Description |
|---|---|
StreamShardHandle |
GetShardListResult.getLastSeenShardOfStream(String stream) |
| Modifier and Type | Method and Description |
|---|---|
List<StreamShardHandle> |
GetShardListResult.getRetrievedShardListOfStream(String stream) |
| Modifier and Type | Method and Description |
|---|---|
void |
GetShardListResult.addRetrievedShardToStream(String stream,
StreamShardHandle retrievedShard) |
String |
KinesisProxyInterface.getShardIterator(StreamShardHandle shard,
String shardIteratorType,
Object startingMarker)
Get a shard iterator from the specified position in a shard.
|
String |
KinesisProxy.getShardIterator(StreamShardHandle shard,
String shardIteratorType,
Object startingMarker) |
| Modifier and Type | Method and Description |
|---|---|
void |
GetShardListResult.addRetrievedShardsToStream(String stream,
List<StreamShardHandle> retrievedShards) |
Copyright © 2014–2022 The Apache Software Foundation. All rights reserved.