software.amazon.kinesis.connectors.flink.internals.publisher.fanout

Class FanOutRecordPublisher

java.lang.Object

software.amazon.kinesis.connectors.flink.internals.publisher.fanout.FanOutRecordPublisher

All Implemented Interfaces:

RecordPublisher

@Internal
public class FanOutRecordPublisher
extends Object
implements RecordPublisher

A RecordPublisher that will read and forward records from Kinesis using EFO, to the subscriber. Records are consumed via Enhanced Fan Out subscriptions using SubscribeToShard API.

Nested Class Summary

Nested classes/interfaces inherited from interface software.amazon.kinesis.connectors.flink.internals.publisher.RecordPublisher

RecordPublisher.RecordBatchConsumer, RecordPublisher.RecordPublisherRunResult

Constructor Summary

Constructors

Constructor and Description
FanOutRecordPublisher(StartingPosition startingPosition, String consumerArn, StreamShardHandle subscribedShard, KinesisProxyV2Interface kinesisProxy, FanOutRecordPublisherConfiguration configuration, FullJitterBackoff backoff) Instantiate a new FanOutRecordPublisher.

Method Summary

Modifier and Type	Method and Description
RecordPublisher.RecordPublisherRunResult	run(RecordPublisher.RecordBatchConsumer recordConsumer) Run the record publisher.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

FanOutRecordPublisher

public FanOutRecordPublisher(StartingPosition startingPosition,
                             String consumerArn,
                             StreamShardHandle subscribedShard,
                             KinesisProxyV2Interface kinesisProxy,
                             FanOutRecordPublisherConfiguration configuration,
                             FullJitterBackoff backoff)

Instantiate a new FanOutRecordPublisher. Consumes data from KDS using EFO SubscribeToShard over AWS SDK V2.x

Parameters:

startingPosition - the position in the shard to start consuming from

consumerArn - the consumer ARN of the stream consumer

subscribedShard - the shard to consumer from

kinesisProxy - the proxy used to talk to Kinesis services

configuration - the record publisher configuration

Method Detail

run

public RecordPublisher.RecordPublisherRunResult run(RecordPublisher.RecordBatchConsumer recordConsumer)
                                             throws InterruptedException

Description copied from interface: RecordPublisher

Run the record publisher. Records will be consumed from the stream and published to the consumer. The number of batches retrieved by a single invocation will vary based on implementation.

Specified by:

run in interface RecordPublisher

Parameters:

recordConsumer - the record batch consumer in which to output records

Returns:

a status enum to represent whether a shard has been fully consumed

Throws:

InterruptedException