A B C D E F G H I J K L M N O P R S T U V W

A

accept(RecordBatch) - Method in interface software.amazon.kinesis.connectors.flink.internals.publisher.RecordPublisher.RecordBatchConsumer

accessKeyId(String) - Static method in class software.amazon.kinesis.connectors.flink.config.AWSConfigConstants

AdaptivePollingRecordPublisher - Class in software.amazon.kinesis.connectors.flink.internals.publisher.polling

An adaptive record publisher to add a dynamic batch read size for PollingRecordPublisher.

addRetrievedShardsToStream(String, List<StreamShardHandle>) - Method in class software.amazon.kinesis.connectors.flink.proxy.GetShardListResult

addRetrievedShardToStream(String, StreamShardHandle) - Method in class software.amazon.kinesis.connectors.flink.proxy.GetShardListResult

advanceLastDiscoveredShardOfStream(String, String) - Method in class software.amazon.kinesis.connectors.flink.internals.KinesisDataFetcher

Updates the last discovered shard of a subscribed stream; only updates if the update is valid.

AGGREGATION_MAX_COUNT - Static variable in class software.amazon.kinesis.connectors.flink.config.ProducerConfigConstants

Deprecated.

This is deprecated in favor of the official AWS Kinesis producer configuration keys. Please use AggregationMaxCount instead.

AGGREGATION_MAX_COUNT - Static variable in class software.amazon.kinesis.connectors.flink.util.KinesisConfigUtil

Maximum number of items to pack into an aggregated record.

applyStaticPartition(Map<String, String>) - Method in class software.amazon.kinesis.connectors.flink.table.KinesisDynamicSink

assign(StreamShardHandle, int) - Method in interface software.amazon.kinesis.connectors.flink.KinesisShardAssigner

Returns the index of the target subtask that a specific shard should be assigned to.

asSummaryString() - Method in class software.amazon.kinesis.connectors.flink.table.KinesisDynamicSink

asSummaryString() - Method in class software.amazon.kinesis.connectors.flink.table.KinesisDynamicSource

AVG_RECORD_SIZE_BYTES - Static variable in class software.amazon.kinesis.connectors.flink.metrics.KinesisConsumerMetricConstants

await(long) - Method in class software.amazon.kinesis.connectors.flink.util.TimeoutLatch

awaitTermination() - Method in class software.amazon.kinesis.connectors.flink.internals.KinesisDataFetcher

After calling KinesisDataFetcher.shutdownFetcher(), this can be called to await the fetcher shutdown.

AWS_ACCESS_KEY_ID - Static variable in class software.amazon.kinesis.connectors.flink.config.AWSConfigConstants

The AWS access key ID to use when setting credentials provider type to BASIC.

AWS_CLIENT_CONFIG_PREFIX - Static variable in class software.amazon.kinesis.connectors.flink.util.AWSUtil

The prefix used for properties that should be applied to ClientConfiguration.

AWS_CREDENTIALS_PROVIDER - Static variable in class software.amazon.kinesis.connectors.flink.config.AWSConfigConstants

The credential provider type to use when AWS credentials are required (BASIC is used if not set).

AWS_ENDPOINT - Static variable in class software.amazon.kinesis.connectors.flink.config.AWSConfigConstants

The AWS endpoint for Kinesis (derived from the AWS region setting if not set).

AWS_PROFILE_NAME - Static variable in class software.amazon.kinesis.connectors.flink.config.AWSConfigConstants

Optional configuration for profile name if credential provider type is set to be PROFILE.

AWS_PROFILE_PATH - Static variable in class software.amazon.kinesis.connectors.flink.config.AWSConfigConstants

Optional configuration for profile path if credential provider type is set to be PROFILE.

AWS_PROPERTIES_PREFIX - Static variable in class software.amazon.kinesis.connectors.flink.table.KinesisOptions

Prefix for properties defined in AWSConfigConstants that are delegated to FlinkKinesisConsumer and FlinkKinesisProducer.

AWS_REGION - Static variable in class software.amazon.kinesis.connectors.flink.config.AWSConfigConstants

The AWS region of the Kinesis streams to be pulled ("us-east-1" is used if not set).

AWS_ROLE_ARN - Static variable in class software.amazon.kinesis.connectors.flink.config.AWSConfigConstants

The role ARN to use when credential provider type is set to ASSUME_ROLE or WEB_IDENTITY_TOKEN.

AWS_ROLE_CREDENTIALS_PROVIDER - Static variable in class software.amazon.kinesis.connectors.flink.config.AWSConfigConstants

The credentials provider that provides credentials for assuming the role when credential provider type is set to ASSUME_ROLE.

AWS_ROLE_EXTERNAL_ID - Static variable in class software.amazon.kinesis.connectors.flink.config.AWSConfigConstants

The external ID to use when credential provider type is set to ASSUME_ROLE.

AWS_ROLE_SESSION_NAME - Static variable in class software.amazon.kinesis.connectors.flink.config.AWSConfigConstants

The role session name to use when credential provider type is set to ASSUME_ROLE or WEB_IDENTITY_TOKEN.

AWS_SECRET_ACCESS_KEY - Static variable in class software.amazon.kinesis.connectors.flink.config.AWSConfigConstants

The AWS secret key to use when setting credentials provider type to BASIC.

AWS_WEB_IDENTITY_TOKEN_FILE - Static variable in class software.amazon.kinesis.connectors.flink.config.AWSConfigConstants

The absolute path to the web identity token file that should be used if provider type is set to WEB_IDENTITY_TOKEN.

AWSConfigConstants - Class in software.amazon.kinesis.connectors.flink.config

Configuration keys for AWS service usage.

AWSConfigConstants() - Constructor for class software.amazon.kinesis.connectors.flink.config.AWSConfigConstants

AWSConfigConstants.CredentialProvider - Enum in software.amazon.kinesis.connectors.flink.config

Possible configuration values for the type of credential provider to use when accessing AWS Kinesis.

AWSUtil - Class in software.amazon.kinesis.connectors.flink.util

Some utilities specific to Amazon Web Service.

AWSUtil() - Constructor for class software.amazon.kinesis.connectors.flink.util.AWSUtil

AwsV2Util - Class in software.amazon.kinesis.connectors.flink.util

Utility methods specific to Amazon Web Service SDK v2.x.

AwsV2Util() - Constructor for class software.amazon.kinesis.connectors.flink.util.AwsV2Util

B

backfillConsumerKeys(Properties) - Static method in class software.amazon.kinesis.connectors.flink.util.KinesisConfigUtil

A set of configuration paremeters associated with the describeStreams API may be used if: 1) an legacy client wants to consume from Kinesis 2) a current client wants to consumer from DynamoDB streams In the context of 1), the set of configurations needs to be translated to the corresponding configurations in the Kinesis listShards API.

BeanDeserializerModifierForIgnorables - Class in software.amazon.kinesis.connectors.flink.util

Jackson bean deserializer utility that allows skipping of properties, for example because they cannot be handled by the default serializer or should be ignored for other reason.

BeanDeserializerModifierForIgnorables(Class, String...) - Constructor for class software.amazon.kinesis.connectors.flink.util.BeanDeserializerModifierForIgnorables

BYTES_PER_READ - Static variable in class software.amazon.kinesis.connectors.flink.metrics.KinesisConsumerMetricConstants

C

calculateFullJitterBackoff(long, long, double, int) - Method in class software.amazon.kinesis.connectors.flink.proxy.FullJitterBackoff

Calculates the sleep time for full jitter based on the given parameters.

cancel() - Method in class software.amazon.kinesis.connectors.flink.FlinkKinesisConsumer

close() - Method in class software.amazon.kinesis.connectors.flink.FlinkKinesisConsumer

close() - Method in class software.amazon.kinesis.connectors.flink.FlinkKinesisProducer

close() - Method in class software.amazon.kinesis.connectors.flink.internals.publisher.fanout.FanOutRecordPublisherFactory

close() - Method in class software.amazon.kinesis.connectors.flink.internals.publisher.fanout.StreamConsumerRegistrar

Destroy any open resources used by the factory.

close() - Method in interface software.amazon.kinesis.connectors.flink.internals.publisher.RecordPublisherFactory

Destroy any open resources used by the factory.

close() - Method in class software.amazon.kinesis.connectors.flink.proxy.KinesisProxyV2

close() - Method in interface software.amazon.kinesis.connectors.flink.proxy.KinesisProxyV2Interface

Destroy any open resources used by the factory.

close() - Method in class software.amazon.kinesis.connectors.flink.util.WatermarkTracker

closeRecordPublisherFactory() - Method in class software.amazon.kinesis.connectors.flink.internals.KinesisDataFetcher

Closes recordRecordPublisherFactory.

COLLECTION_MAX_COUNT - Static variable in class software.amazon.kinesis.connectors.flink.config.ProducerConfigConstants

Deprecated.

This is deprecated in favor of the official AWS Kinesis producer configuration keys. Please use CollectionMaxCount instead.

COLLECTION_MAX_COUNT - Static variable in class software.amazon.kinesis.connectors.flink.util.KinesisConfigUtil

Maximum number of items to pack into an PutRecords request.

compareShardIds(String, String) - Static method in class software.amazon.kinesis.connectors.flink.model.DynamoDBStreamsShardHandle

compareShardIds(String, String) - Static method in class software.amazon.kinesis.connectors.flink.model.StreamShardHandle

Utility function to compare two shard ids.

CONSUMER_PREFIX - Static variable in class software.amazon.kinesis.connectors.flink.table.KinesisOptions

Prefix for properties defined in ConsumerConfigConstants that are delegated to FlinkKinesisConsumer.

ConsumerConfigConstants - Class in software.amazon.kinesis.connectors.flink.config

Optional consumer specific configuration keys and default values for FlinkKinesisConsumer.

ConsumerConfigConstants() - Constructor for class software.amazon.kinesis.connectors.flink.config.ConsumerConfigConstants

ConsumerConfigConstants.EFORegistrationType - Enum in software.amazon.kinesis.connectors.flink.config

The EFO registration type reprsents how we are going to de-/register EFO consumer.

ConsumerConfigConstants.InitialPosition - Enum in software.amazon.kinesis.connectors.flink.config

The initial position to start reading shards from.

ConsumerConfigConstants.RecordPublisherType - Enum in software.amazon.kinesis.connectors.flink.config

The record publisher type represents the record-consume style.

continueFromSequenceNumber(SequenceNumber) - Static method in class software.amazon.kinesis.connectors.flink.model.StartingPosition

Returns the starting position for the next record to consume from the given sequence number.

convertToStreamShardHandle(StreamShardMetadata) - Static method in class software.amazon.kinesis.connectors.flink.internals.KinesisDataFetcher

Utility function to convert StreamShardMetadata into StreamShardHandle.

convertToStreamShardMetadata(StreamShardHandle) - Static method in class software.amazon.kinesis.connectors.flink.internals.KinesisDataFetcher

Utility function to convert StreamShardHandle into StreamShardMetadata.

convertToStreamShardMetadata(KinesisStreamShard) - Static method in class software.amazon.kinesis.connectors.flink.model.KinesisStreamShard

Deprecated.

Utility function to convert KinesisStreamShard into the new StreamShardMetadata model.

copy() - Method in class software.amazon.kinesis.connectors.flink.table.KinesisDynamicSink

copy() - Method in class software.amazon.kinesis.connectors.flink.table.KinesisDynamicSource

create(Properties) - Method in interface software.amazon.kinesis.connectors.flink.internals.KinesisDataFetcher.FlinkKinesisProxyFactory

create(Properties) - Method in interface software.amazon.kinesis.connectors.flink.internals.KinesisDataFetcher.FlinkKinesisProxyV2Factory

create(StartingPosition, Properties, MetricGroup, StreamShardHandle) - Method in class software.amazon.kinesis.connectors.flink.internals.publisher.fanout.FanOutRecordPublisherFactory

Create a FanOutRecordPublisher.

create(StartingPosition, Properties, MetricGroup, StreamShardHandle) - Method in class software.amazon.kinesis.connectors.flink.internals.publisher.polling.PollingRecordPublisherFactory

Create a PollingRecordPublisher.

create(StartingPosition, Properties, MetricGroup, StreamShardHandle) - Method in interface software.amazon.kinesis.connectors.flink.internals.publisher.RecordPublisherFactory

Create a RecordPublisher.

create(Properties) - Static method in class software.amazon.kinesis.connectors.flink.proxy.DynamoDBStreamsProxy

Creates a DynamoDB streams proxy.

create(Properties) - Static method in class software.amazon.kinesis.connectors.flink.proxy.KinesisProxy

Creates a Kinesis proxy.

createDynamicTableSink(DynamicTableFactory.Context) - Method in class software.amazon.kinesis.connectors.flink.table.KinesisDynamicTableFactory

createDynamicTableSource(DynamicTableFactory.Context) - Method in class software.amazon.kinesis.connectors.flink.table.KinesisDynamicTableFactory

createFetcher(List<String>, SourceFunction.SourceContext<T>, RuntimeContext, Properties, KinesisDeserializationSchema<T>) - Method in class software.amazon.kinesis.connectors.flink.FlinkDynamoDBStreamsConsumer

createFetcher(List<String>, SourceFunction.SourceContext<T>, RuntimeContext, Properties, KinesisDeserializationSchema<T>) - Method in class software.amazon.kinesis.connectors.flink.FlinkKinesisConsumer

This method is exposed for tests that need to mock the KinesisDataFetcher in the consumer.

createHttpClient(ClientConfiguration, NettyNioAsyncHttpClient.Builder, Properties) - Static method in class software.amazon.kinesis.connectors.flink.util.AwsV2Util

createInitialSubscribedStreamsToLastDiscoveredShardsState(List<String>) - Static method in class software.amazon.kinesis.connectors.flink.internals.KinesisDataFetcher

Utility function to create an initial map of the last discovered shard id of each subscribed stream, set to null; This is called in the constructor; correct values will be set later on by calling advanceLastDiscoveredShardOfStream().

createKinesisAsyncClient(Properties, ClientConfiguration, SdkAsyncHttpClient) - Static method in class software.amazon.kinesis.connectors.flink.util.AwsV2Util

Creates an Amazon Kinesis Async Client from the provided properties.

createKinesisClient(Properties) - Method in class software.amazon.kinesis.connectors.flink.proxy.DynamoDBStreamsProxy

Creates an AmazonDynamoDBStreamsAdapterClient.

createKinesisClient(Properties) - Method in class software.amazon.kinesis.connectors.flink.proxy.KinesisProxy

Create the Kinesis client, using the provided configuration properties and default ClientConfiguration.

createKinesisClient(Properties) - Static method in class software.amazon.kinesis.connectors.flink.util.AWSUtil

Creates an AmazonKinesis client.

createKinesisClient(Properties, ClientConfiguration) - Static method in class software.amazon.kinesis.connectors.flink.util.AWSUtil

Creates an Amazon Kinesis Client.

createKinesisProxyV2(Properties) - Static method in class software.amazon.kinesis.connectors.flink.proxy.KinesisProxyV2Factory

Uses the given properties to instantiate a new instance of KinesisProxyV2.

createRecordPublisher(SequenceNumber, Properties, MetricGroup, StreamShardHandle) - Method in class software.amazon.kinesis.connectors.flink.internals.DynamoDBStreamsDataFetcher

createRecordPublisher(SequenceNumber, Properties, MetricGroup, StreamShardHandle) - Method in class software.amazon.kinesis.connectors.flink.internals.KinesisDataFetcher

createRecordPublisherFactory() - Method in class software.amazon.kinesis.connectors.flink.internals.KinesisDataFetcher

createShardConsumer(Integer, StreamShardHandle, SequenceNumber, MetricGroup, KinesisDeserializationSchema<T>) - Method in class software.amazon.kinesis.connectors.flink.internals.KinesisDataFetcher

Create a new shard consumer.

createShardConsumersThreadPool(String) - Method in class software.amazon.kinesis.connectors.flink.internals.KinesisDataFetcher

createShardsStateSerializer(ExecutionConfig) - Static method in class software.amazon.kinesis.connectors.flink.util.KinesisStateUtil

Creates state serializer for kinesis shard sequence number.

D

DEFAULT_DELIMITER - Static variable in class software.amazon.kinesis.connectors.flink.table.RowDataFieldsKinesisPartitioner

Default delimiter for RowDataFieldsKinesisPartitioner.delimiter.

DEFAULT_DEREGISTER_STREAM_BACKOFF_BASE - Static variable in class software.amazon.kinesis.connectors.flink.config.ConsumerConfigConstants

DEFAULT_DEREGISTER_STREAM_BACKOFF_EXPONENTIAL_CONSTANT - Static variable in class software.amazon.kinesis.connectors.flink.config.ConsumerConfigConstants

DEFAULT_DEREGISTER_STREAM_BACKOFF_MAX - Static variable in class software.amazon.kinesis.connectors.flink.config.ConsumerConfigConstants

DEFAULT_DEREGISTER_STREAM_RETRIES - Static variable in class software.amazon.kinesis.connectors.flink.config.ConsumerConfigConstants

DEFAULT_DEREGISTER_STREAM_TIMEOUT - Static variable in class software.amazon.kinesis.connectors.flink.config.ConsumerConfigConstants

DEFAULT_DESCRIBE_STREAM_CONSUMER_BACKOFF_BASE - Static variable in class software.amazon.kinesis.connectors.flink.config.ConsumerConfigConstants

DEFAULT_DESCRIBE_STREAM_CONSUMER_BACKOFF_EXPONENTIAL_CONSTANT - Static variable in class software.amazon.kinesis.connectors.flink.config.ConsumerConfigConstants

DEFAULT_DESCRIBE_STREAM_CONSUMER_BACKOFF_MAX - Static variable in class software.amazon.kinesis.connectors.flink.config.ConsumerConfigConstants

DEFAULT_DESCRIBE_STREAM_CONSUMER_RETRIES - Static variable in class software.amazon.kinesis.connectors.flink.config.ConsumerConfigConstants

DEFAULT_EFO_HTTP_CLIENT_ACQUISITION_TIMEOUT - Static variable in class software.amazon.kinesis.connectors.flink.config.ConsumerConfigConstants

DEFAULT_EFO_HTTP_CLIENT_MAX_CONCURRENCY - Static variable in class software.amazon.kinesis.connectors.flink.config.ConsumerConfigConstants

DEFAULT_EFO_HTTP_CLIENT_READ_TIMEOUT - Static variable in class software.amazon.kinesis.connectors.flink.config.ConsumerConfigConstants

DEFAULT_LIST_SHARDS_BACKOFF_BASE - Static variable in class software.amazon.kinesis.connectors.flink.config.ConsumerConfigConstants

DEFAULT_LIST_SHARDS_BACKOFF_EXPONENTIAL_CONSTANT - Static variable in class software.amazon.kinesis.connectors.flink.config.ConsumerConfigConstants

DEFAULT_LIST_SHARDS_BACKOFF_MAX - Static variable in class software.amazon.kinesis.connectors.flink.config.ConsumerConfigConstants

DEFAULT_LIST_SHARDS_RETRIES - Static variable in class software.amazon.kinesis.connectors.flink.config.ConsumerConfigConstants

DEFAULT_QUEUE_CAPACITY - Static variable in class software.amazon.kinesis.connectors.flink.util.RecordEmitter

The default capacity of a single queue.

DEFAULT_RATE_LIMIT - Static variable in class software.amazon.kinesis.connectors.flink.util.KinesisConfigUtil

Default values for RateLimit.

DEFAULT_REGISTER_STREAM_BACKOFF_BASE - Static variable in class software.amazon.kinesis.connectors.flink.config.ConsumerConfigConstants

DEFAULT_REGISTER_STREAM_BACKOFF_EXPONENTIAL_CONSTANT - Static variable in class software.amazon.kinesis.connectors.flink.config.ConsumerConfigConstants

DEFAULT_REGISTER_STREAM_BACKOFF_MAX - Static variable in class software.amazon.kinesis.connectors.flink.config.ConsumerConfigConstants

DEFAULT_REGISTER_STREAM_RETRIES - Static variable in class software.amazon.kinesis.connectors.flink.config.ConsumerConfigConstants

DEFAULT_REGISTER_STREAM_TIMEOUT - Static variable in class software.amazon.kinesis.connectors.flink.config.ConsumerConfigConstants

DEFAULT_SHARD_ASSIGNER - Static variable in class software.amazon.kinesis.connectors.flink.internals.KinesisDataFetcher

DEFAULT_SHARD_DISCOVERY_INTERVAL_MILLIS - Static variable in class software.amazon.kinesis.connectors.flink.config.ConsumerConfigConstants

DEFAULT_SHARD_GETITERATOR_BACKOFF_BASE - Static variable in class software.amazon.kinesis.connectors.flink.config.ConsumerConfigConstants

DEFAULT_SHARD_GETITERATOR_BACKOFF_EXPONENTIAL_CONSTANT - Static variable in class software.amazon.kinesis.connectors.flink.config.ConsumerConfigConstants

DEFAULT_SHARD_GETITERATOR_BACKOFF_MAX - Static variable in class software.amazon.kinesis.connectors.flink.config.ConsumerConfigConstants

DEFAULT_SHARD_GETITERATOR_RETRIES - Static variable in class software.amazon.kinesis.connectors.flink.config.ConsumerConfigConstants

DEFAULT_SHARD_GETRECORDS_BACKOFF_BASE - Static variable in class software.amazon.kinesis.connectors.flink.config.ConsumerConfigConstants

DEFAULT_SHARD_GETRECORDS_BACKOFF_EXPONENTIAL_CONSTANT - Static variable in class software.amazon.kinesis.connectors.flink.config.ConsumerConfigConstants

DEFAULT_SHARD_GETRECORDS_BACKOFF_MAX - Static variable in class software.amazon.kinesis.connectors.flink.config.ConsumerConfigConstants

DEFAULT_SHARD_GETRECORDS_INTERVAL_MILLIS - Static variable in class software.amazon.kinesis.connectors.flink.config.ConsumerConfigConstants

DEFAULT_SHARD_GETRECORDS_MAX - Static variable in class software.amazon.kinesis.connectors.flink.config.ConsumerConfigConstants

DEFAULT_SHARD_GETRECORDS_RETRIES - Static variable in class software.amazon.kinesis.connectors.flink.config.ConsumerConfigConstants

DEFAULT_SHARD_IDLE_INTERVAL_MILLIS - Static variable in class software.amazon.kinesis.connectors.flink.config.ConsumerConfigConstants

DEFAULT_SHARD_USE_ADAPTIVE_READS - Static variable in class software.amazon.kinesis.connectors.flink.config.ConsumerConfigConstants

DEFAULT_STREAM_DESCRIBE_BACKOFF_BASE - Static variable in class software.amazon.kinesis.connectors.flink.config.ConsumerConfigConstants

DEFAULT_STREAM_DESCRIBE_BACKOFF_EXPONENTIAL_CONSTANT - Static variable in class software.amazon.kinesis.connectors.flink.config.ConsumerConfigConstants

DEFAULT_STREAM_DESCRIBE_BACKOFF_MAX - Static variable in class software.amazon.kinesis.connectors.flink.config.ConsumerConfigConstants

DEFAULT_STREAM_DESCRIBE_RETRIES - Static variable in class software.amazon.kinesis.connectors.flink.config.ConsumerConfigConstants

DEFAULT_STREAM_INITIAL_POSITION - Static variable in class software.amazon.kinesis.connectors.flink.config.ConsumerConfigConstants

DEFAULT_STREAM_TIMESTAMP_DATE_FORMAT - Static variable in class software.amazon.kinesis.connectors.flink.config.ConsumerConfigConstants

DEFAULT_SUBSCRIBE_TO_SHARD_BACKOFF_BASE - Static variable in class software.amazon.kinesis.connectors.flink.config.ConsumerConfigConstants

DEFAULT_SUBSCRIBE_TO_SHARD_BACKOFF_EXPONENTIAL_CONSTANT - Static variable in class software.amazon.kinesis.connectors.flink.config.ConsumerConfigConstants

DEFAULT_SUBSCRIBE_TO_SHARD_BACKOFF_MAX - Static variable in class software.amazon.kinesis.connectors.flink.config.ConsumerConfigConstants

DEFAULT_SUBSCRIBE_TO_SHARD_RETRIES - Static variable in class software.amazon.kinesis.connectors.flink.config.ConsumerConfigConstants

DEFAULT_SUBSCRIBE_TO_SHARD_TIMEOUT - Static variable in class software.amazon.kinesis.connectors.flink.config.ConsumerConfigConstants

DEFAULT_THREAD_POOL_SIZE - Static variable in class software.amazon.kinesis.connectors.flink.util.KinesisConfigUtil

Default values for ThreadPoolSize.

DEFAULT_THREADING_MODEL - Static variable in class software.amazon.kinesis.connectors.flink.util.KinesisConfigUtil

Default value for ThreadingModel.

DEFAULT_UPDATE_TIMEOUT_MILLIS - Static variable in class software.amazon.kinesis.connectors.flink.util.WatermarkTracker

DEFAULT_WATERMARK_SYNC_MILLIS - Static variable in class software.amazon.kinesis.connectors.flink.config.ConsumerConfigConstants

DEREGISTER_STREAM_BACKOFF_BASE - Static variable in class software.amazon.kinesis.connectors.flink.config.ConsumerConfigConstants

The base backoff time between each deregisterStream attempt.

DEREGISTER_STREAM_BACKOFF_EXPONENTIAL_CONSTANT - Static variable in class software.amazon.kinesis.connectors.flink.config.ConsumerConfigConstants

The power constant for exponential backoff between each deregisterStream attempt.

DEREGISTER_STREAM_BACKOFF_MAX - Static variable in class software.amazon.kinesis.connectors.flink.config.ConsumerConfigConstants

The maximum backoff time between each deregisterStream attempt.

DEREGISTER_STREAM_RETRIES - Static variable in class software.amazon.kinesis.connectors.flink.config.ConsumerConfigConstants

The maximum number of deregisterStream attempts if we get a recoverable exception.

DEREGISTER_STREAM_TIMEOUT_SECONDS - Static variable in class software.amazon.kinesis.connectors.flink.config.ConsumerConfigConstants

The maximum time in seconds to wait for a stream consumer to deregister before giving up.

deregisterStreamConsumer() - Method in class software.amazon.kinesis.connectors.flink.internals.KinesisDataFetcher

Deregisters stream consumers.

deregisterStreamConsumer(String) - Method in class software.amazon.kinesis.connectors.flink.internals.publisher.fanout.StreamConsumerRegistrar

Deregister the stream consumer with the given ARN.

deregisterStreamConsumer(String) - Method in class software.amazon.kinesis.connectors.flink.proxy.KinesisProxyV2

deregisterStreamConsumer(String) - Method in interface software.amazon.kinesis.connectors.flink.proxy.KinesisProxyV2Interface

deregisterStreamConsumers(Properties, List<String>) - Static method in class software.amazon.kinesis.connectors.flink.util.StreamConsumerRegistrarUtil

Deregisters stream consumers for the given streams if EFO is enabled with LAZY registration strategy.

DESCRIBE_STREAM_CONSUMER_BACKOFF_BASE - Static variable in class software.amazon.kinesis.connectors.flink.config.ConsumerConfigConstants

The base backoff time between each describeStreamConsumer attempt.

DESCRIBE_STREAM_CONSUMER_BACKOFF_EXPONENTIAL_CONSTANT - Static variable in class software.amazon.kinesis.connectors.flink.config.ConsumerConfigConstants

The power constant for exponential backoff between each describeStreamConsumer attempt.

DESCRIBE_STREAM_CONSUMER_BACKOFF_MAX - Static variable in class software.amazon.kinesis.connectors.flink.config.ConsumerConfigConstants

The maximum backoff time between each describeStreamConsumer attempt.

DESCRIBE_STREAM_CONSUMER_RETRIES - Static variable in class software.amazon.kinesis.connectors.flink.config.ConsumerConfigConstants

The maximum number of describeStreamConsumer attempts if we get a recoverable exception.

describeStream(String, String) - Method in class software.amazon.kinesis.connectors.flink.proxy.KinesisProxy

Get metainfo for a Kinesis stream, which contains information about which shards this Kinesis stream possess.

describeStreamConsumer(String, String) - Method in class software.amazon.kinesis.connectors.flink.proxy.KinesisProxyV2

describeStreamConsumer(String) - Method in class software.amazon.kinesis.connectors.flink.proxy.KinesisProxyV2

describeStreamConsumer(String) - Method in interface software.amazon.kinesis.connectors.flink.proxy.KinesisProxyV2Interface

describeStreamConsumer(String, String) - Method in interface software.amazon.kinesis.connectors.flink.proxy.KinesisProxyV2Interface

describeStreamSummary(String) - Method in class software.amazon.kinesis.connectors.flink.proxy.KinesisProxyV2

describeStreamSummary(String) - Method in interface software.amazon.kinesis.connectors.flink.proxy.KinesisProxyV2Interface

deserialize(byte[], String, String, long, String, String) - Method in class software.amazon.kinesis.connectors.flink.serialization.DynamoDBStreamsSchema

deserialize(byte[], String, String, long, String, String) - Method in interface software.amazon.kinesis.connectors.flink.serialization.KinesisDeserializationSchema

Deserializes a Kinesis record's bytes.

deserialize(byte[], String, String, long, String, String) - Method in class software.amazon.kinesis.connectors.flink.serialization.KinesisDeserializationSchemaWrapper

deserialize(byte[], String, String, long, String, String) - Method in class software.amazon.kinesis.connectors.flink.table.RowDataKinesisDeserializationSchema

discoverNewShardsToSubscribe() - Method in class software.amazon.kinesis.connectors.flink.internals.KinesisDataFetcher

A utility function that does the following:

DynamoDBStreamsDataFetcher<T> - Class in software.amazon.kinesis.connectors.flink.internals

Dynamodb streams data fetcher.

DynamoDBStreamsDataFetcher(List<String>, SourceFunction.SourceContext<T>, RuntimeContext, Properties, KinesisDeserializationSchema<T>, KinesisShardAssigner) - Constructor for class software.amazon.kinesis.connectors.flink.internals.DynamoDBStreamsDataFetcher

Constructor.

DynamoDBStreamsProxy - Class in software.amazon.kinesis.connectors.flink.proxy

DynamoDB streams proxy: interface interacting with the DynamoDB streams.

DynamoDBStreamsProxy(Properties) - Constructor for class software.amazon.kinesis.connectors.flink.proxy.DynamoDBStreamsProxy

DynamoDBStreamsSchema - Class in software.amazon.kinesis.connectors.flink.serialization

Schema used for deserializing DynamoDB streams records.

DynamoDBStreamsSchema() - Constructor for class software.amazon.kinesis.connectors.flink.serialization.DynamoDBStreamsSchema

DynamoDBStreamsShardHandle - Class in software.amazon.kinesis.connectors.flink.model

DynamoDB streams shard handle format and utilities.

DynamoDBStreamsShardHandle(String, Shard) - Constructor for class software.amazon.kinesis.connectors.flink.model.DynamoDBStreamsShardHandle

E

eagerlyRegisterStreamConsumers(Properties, List<String>) - Static method in class software.amazon.kinesis.connectors.flink.util.StreamConsumerRegistrarUtil

Registers stream consumers for the given streams if EFO is enabled with EAGER registration strategy.

EFO_CONSUMER_ARN_PREFIX - Static variable in class software.amazon.kinesis.connectors.flink.config.ConsumerConfigConstants

The prefix of consumer ARN for a given stream.

EFO_CONSUMER_NAME - Static variable in class software.amazon.kinesis.connectors.flink.config.ConsumerConfigConstants

The name of the EFO consumer to register with KDS.

EFO_HTTP_CLIENT_ACQUISITION_TIMEOUT_MILLIS - Static variable in class software.amazon.kinesis.connectors.flink.config.ConsumerConfigConstants

EFO_HTTP_CLIENT_MAX_CONCURRENCY - Static variable in class software.amazon.kinesis.connectors.flink.config.ConsumerConfigConstants

EFO_HTTP_CLIENT_READ_TIMEOUT_MILLIS - Static variable in class software.amazon.kinesis.connectors.flink.config.ConsumerConfigConstants

EFO_REGISTRATION_TYPE - Static variable in class software.amazon.kinesis.connectors.flink.config.ConsumerConfigConstants

Determine how and when consumer de-/registration is performed (LAZY|EAGER|NONE, default is LAZY).

efoConsumerArn(String) - Static method in class software.amazon.kinesis.connectors.flink.config.ConsumerConfigConstants

Build the key of an EFO consumer ARN according to a stream name.

emit(T, RecordEmitter.RecordQueue<T>) - Method in class software.amazon.kinesis.connectors.flink.util.RecordEmitter

Emit the record.

emitRecordAndUpdateState(T, long, int, SequenceNumber) - Method in class software.amazon.kinesis.connectors.flink.internals.KinesisDataFetcher

Prepare a record and hand it over to the RecordEmitter, which may collect it asynchronously.

emitRecords() - Method in class software.amazon.kinesis.connectors.flink.util.RecordEmitter

emitWatermark() - Method in class software.amazon.kinesis.connectors.flink.internals.KinesisDataFetcher

Called periodically to emit a watermark.

equals(Object) - Method in class software.amazon.kinesis.connectors.flink.FixedKinesisPartitioner

equals(Object) - Method in class software.amazon.kinesis.connectors.flink.model.KinesisStreamShard

Deprecated.

equals(Object) - Method in class software.amazon.kinesis.connectors.flink.model.KinesisStreamShardState

equals(Object) - Method in class software.amazon.kinesis.connectors.flink.model.SequenceNumber

equals(Object) - Method in class software.amazon.kinesis.connectors.flink.model.StreamShardHandle

equals(Object) - Method in class software.amazon.kinesis.connectors.flink.model.StreamShardMetadata

equals(Object) - Method in class software.amazon.kinesis.connectors.flink.model.StreamShardMetadata.EquivalenceWrapper

equals(Object) - Method in class software.amazon.kinesis.connectors.flink.RandomKinesisPartitioner

equals(Object) - Method in class software.amazon.kinesis.connectors.flink.table.KinesisDynamicSink

equals(Object) - Method in class software.amazon.kinesis.connectors.flink.table.KinesisDynamicSource

equals(Object) - Method in class software.amazon.kinesis.connectors.flink.table.RowDataFieldsKinesisPartitioner

EquivalenceWrapper(StreamShardMetadata) - Constructor for class software.amazon.kinesis.connectors.flink.model.StreamShardMetadata.EquivalenceWrapper

externalId(String) - Static method in class software.amazon.kinesis.connectors.flink.config.AWSConfigConstants

F

factoryIdentifier() - Method in class software.amazon.kinesis.connectors.flink.table.KinesisDynamicTableFactory

FanOutRecordPublisher - Class in software.amazon.kinesis.connectors.flink.internals.publisher.fanout

A RecordPublisher that will read and forward records from Kinesis using EFO, to the subscriber.

FanOutRecordPublisher(StartingPosition, String, StreamShardHandle, KinesisProxyV2Interface, FanOutRecordPublisherConfiguration, FullJitterBackoff) - Constructor for class software.amazon.kinesis.connectors.flink.internals.publisher.fanout.FanOutRecordPublisher

Instantiate a new FanOutRecordPublisher.

FanOutRecordPublisherConfiguration - Class in software.amazon.kinesis.connectors.flink.internals.publisher.fanout

This is a configuration class for enhanced fan-out components.

FanOutRecordPublisherConfiguration(Properties, List<String>) - Constructor for class software.amazon.kinesis.connectors.flink.internals.publisher.fanout.FanOutRecordPublisherConfiguration

Creates a FanOutRecordPublisherConfiguration.

FanOutRecordPublisherFactory - Class in software.amazon.kinesis.connectors.flink.internals.publisher.fanout

A RecordPublisher factory used to create instances of FanOutRecordPublisher.

FanOutRecordPublisherFactory(KinesisProxyV2Interface) - Constructor for class software.amazon.kinesis.connectors.flink.internals.publisher.fanout.FanOutRecordPublisherFactory

Instantiate a factory responsible for creating FanOutRecordPublisher.

FanOutShardSubscriber - Class in software.amazon.kinesis.connectors.flink.internals.publisher.fanout

This class is responsible for acquiring an Enhanced Fan Out subscription and consuming records from a shard.

FixedKinesisPartitioner<T> - Class in software.amazon.kinesis.connectors.flink

A partitioner ensuring that each internal Flink partition ends up in the same Kinesis partition.

FixedKinesisPartitioner() - Constructor for class software.amazon.kinesis.connectors.flink.FixedKinesisPartitioner

FlinkDynamoDBStreamsConsumer<T> - Class in software.amazon.kinesis.connectors.flink

Consume events from DynamoDB streams.

FlinkDynamoDBStreamsConsumer(String, DeserializationSchema<T>, Properties) - Constructor for class software.amazon.kinesis.connectors.flink.FlinkDynamoDBStreamsConsumer

Constructor of FlinkDynamoDBStreamsConsumer.

FlinkDynamoDBStreamsConsumer(List<String>, KinesisDeserializationSchema, Properties) - Constructor for class software.amazon.kinesis.connectors.flink.FlinkDynamoDBStreamsConsumer

Constructor of FlinkDynamodbStreamConsumer.

FlinkKinesisConsumer<T> - Class in software.amazon.kinesis.connectors.flink

The Flink Kinesis Consumer is an exactly-once parallel streaming data source that subscribes to multiple AWS Kinesis streams within the same AWS service region, and can handle resharding of streams.

FlinkKinesisConsumer(String, DeserializationSchema<T>, Properties) - Constructor for class software.amazon.kinesis.connectors.flink.FlinkKinesisConsumer

Creates a new Flink Kinesis Consumer.

FlinkKinesisConsumer(String, KinesisDeserializationSchema<T>, Properties) - Constructor for class software.amazon.kinesis.connectors.flink.FlinkKinesisConsumer

Creates a new Flink Kinesis Consumer.

FlinkKinesisConsumer(List<String>, KinesisDeserializationSchema<T>, Properties) - Constructor for class software.amazon.kinesis.connectors.flink.FlinkKinesisConsumer

Creates a new Flink Kinesis Consumer.

FlinkKinesisException - Exception in software.amazon.kinesis.connectors.flink

A RuntimeException wrapper indicating the exception was thrown from this connector.

FlinkKinesisException(String) - Constructor for exception software.amazon.kinesis.connectors.flink.FlinkKinesisException

FlinkKinesisException(String, Throwable) - Constructor for exception software.amazon.kinesis.connectors.flink.FlinkKinesisException

FlinkKinesisException.FlinkKinesisTimeoutException - Exception in software.amazon.kinesis.connectors.flink

A semantic RuntimeException thrown to indicate timeout errors in the Kinesis connector.

FlinkKinesisProducer<OUT> - Class in software.amazon.kinesis.connectors.flink

The FlinkKinesisProducer allows to produce from a Flink DataStream into Kinesis.

FlinkKinesisProducer(SerializationSchema<OUT>, Properties) - Constructor for class software.amazon.kinesis.connectors.flink.FlinkKinesisProducer

Create a new FlinkKinesisProducer.

FlinkKinesisProducer(KinesisSerializationSchema<OUT>, Properties) - Constructor for class software.amazon.kinesis.connectors.flink.FlinkKinesisProducer

Create a new FlinkKinesisProducer.

FlinkKinesisStreamConsumerRegistrarException(String, Throwable) - Constructor for exception software.amazon.kinesis.connectors.flink.util.StreamConsumerRegistrarUtil.FlinkKinesisStreamConsumerRegistrarException

FlinkKinesisTimeoutException(String) - Constructor for exception software.amazon.kinesis.connectors.flink.FlinkKinesisException.FlinkKinesisTimeoutException

formatFlinkUserAgentPrefix() - Static method in class software.amazon.kinesis.connectors.flink.util.AWSUtil

Creates a user agent prefix for Flink.

fromTimestamp(Date) - Static method in class software.amazon.kinesis.connectors.flink.model.StartingPosition

FullJitterBackoff - Class in software.amazon.kinesis.connectors.flink.proxy

Used to calculate full jitter backoff sleep durations.

FullJitterBackoff() - Constructor for class software.amazon.kinesis.connectors.flink.proxy.FullJitterBackoff

G

get() - Method in enum software.amazon.kinesis.connectors.flink.model.SentinelSequenceNumber

getAdjacentParentShardId() - Method in class software.amazon.kinesis.connectors.flink.model.StreamShardMetadata

getAggregatedRecordSize() - Method in class software.amazon.kinesis.connectors.flink.internals.publisher.RecordBatch

getAverageRecordSizeBytes() - Method in class software.amazon.kinesis.connectors.flink.internals.publisher.RecordBatch

getAverageRecordSizeBytes() - Method in class software.amazon.kinesis.connectors.flink.metrics.ShardConsumerMetricsReporter

getBytesPerRead() - Method in class software.amazon.kinesis.connectors.flink.metrics.PollingRecordPublisherMetricsReporter

getChangelogMode(ChangelogMode) - Method in class software.amazon.kinesis.connectors.flink.table.KinesisDynamicSink

getChangelogMode() - Method in class software.amazon.kinesis.connectors.flink.table.KinesisDynamicSource

getConsumerConfiguration() - Method in class software.amazon.kinesis.connectors.flink.internals.KinesisDataFetcher

getConsumerName() - Method in class software.amazon.kinesis.connectors.flink.internals.publisher.fanout.FanOutRecordPublisherConfiguration

Get consumer name, will be null if efo registration type is 'NONE'.

getConsumerProperties(Map<String, String>) - Static method in class software.amazon.kinesis.connectors.flink.table.KinesisOptions

Derive properties to be passed to the FlinkKinesisConsumer.

getCredentialsProvider(Properties) - Static method in class software.amazon.kinesis.connectors.flink.util.AWSUtil

Return a AWSCredentialsProvider instance corresponding to the configuration properties.

getCredentialsProvider(Properties) - Static method in class software.amazon.kinesis.connectors.flink.util.AwsV2Util

Return a AWSCredentialsProvider instance corresponding to the configuration properties.

getCurrentTime() - Method in class software.amazon.kinesis.connectors.flink.util.WatermarkTracker

getCurrentTimeMillis() - Method in class software.amazon.kinesis.connectors.flink.internals.KinesisDataFetcher

Return the current system time.

getDeaggregatedRecords() - Method in class software.amazon.kinesis.connectors.flink.internals.publisher.RecordBatch

getDeaggregatedRecordSize() - Method in class software.amazon.kinesis.connectors.flink.internals.publisher.RecordBatch

getDeregisterStreamBaseBackoffMillis() - Method in class software.amazon.kinesis.connectors.flink.internals.publisher.fanout.FanOutRecordPublisherConfiguration

Get base backoff millis for the deregister stream operation.

getDeregisterStreamConsumerTimeout() - Method in class software.amazon.kinesis.connectors.flink.internals.publisher.fanout.FanOutRecordPublisherConfiguration

Get maximum duration to wait for a stream consumer to deregister before giving up.

getDeregisterStreamExpConstant() - Method in class software.amazon.kinesis.connectors.flink.internals.publisher.fanout.FanOutRecordPublisherConfiguration

Get exponential backoff power constant for the deregister stream operation.

getDeregisterStreamMaxBackoffMillis() - Method in class software.amazon.kinesis.connectors.flink.internals.publisher.fanout.FanOutRecordPublisherConfiguration

Get maximum backoff millis for the deregister stream operation.

getDeregisterStreamMaxRetries() - Method in class software.amazon.kinesis.connectors.flink.internals.publisher.fanout.FanOutRecordPublisherConfiguration

Get maximum retry attempts for the register stream operation.

getDescribeStreamBaseBackoffMillis() - Method in class software.amazon.kinesis.connectors.flink.internals.publisher.fanout.FanOutRecordPublisherConfiguration

Get base backoff millis for the describe stream operation.

getDescribeStreamConsumerBaseBackoffMillis() - Method in class software.amazon.kinesis.connectors.flink.internals.publisher.fanout.FanOutRecordPublisherConfiguration

Get base backoff millis for the describe stream operation.

getDescribeStreamConsumerExpConstant() - Method in class software.amazon.kinesis.connectors.flink.internals.publisher.fanout.FanOutRecordPublisherConfiguration

Get exponential backoff power constant for the describe stream operation.

getDescribeStreamConsumerMaxBackoffMillis() - Method in class software.amazon.kinesis.connectors.flink.internals.publisher.fanout.FanOutRecordPublisherConfiguration

Get maximum backoff millis for the describe stream operation.

getDescribeStreamConsumerMaxRetries() - Method in class software.amazon.kinesis.connectors.flink.internals.publisher.fanout.FanOutRecordPublisherConfiguration

Get maximum retry attempts for the describe stream operation.

getDescribeStreamExpConstant() - Method in class software.amazon.kinesis.connectors.flink.internals.publisher.fanout.FanOutRecordPublisherConfiguration

Get exponential backoff power constant for the describe stream operation.

getDescribeStreamMaxBackoffMillis() - Method in class software.amazon.kinesis.connectors.flink.internals.publisher.fanout.FanOutRecordPublisherConfiguration

Get maximum backoff millis for the describe stream operation.

getDescribeStreamMaxRetries() - Method in class software.amazon.kinesis.connectors.flink.internals.publisher.fanout.FanOutRecordPublisherConfiguration

Get maximum retry attempts for the describe stream operation.

getEfoRegistrationType() - Method in class software.amazon.kinesis.connectors.flink.internals.publisher.fanout.FanOutRecordPublisherConfiguration

Get efo registration type.

getEndingHashKey() - Method in class software.amazon.kinesis.connectors.flink.model.StreamShardMetadata

getEndingSequenceNumber() - Method in class software.amazon.kinesis.connectors.flink.model.StreamShardMetadata

getExplicitHashKey(T) - Method in class software.amazon.kinesis.connectors.flink.KinesisPartitioner

Optional method for setting an explicit hash key.

getFetchIntervalMillis() - Method in class software.amazon.kinesis.connectors.flink.internals.publisher.polling.PollingRecordPublisherConfiguration

getKinesisPartitioner(ReadableConfig, CatalogTable, ClassLoader) - Static method in class software.amazon.kinesis.connectors.flink.table.KinesisOptions

Constructs the kinesis partitioner for a targetTable based on the currently set tableOptions.

getKinesisProducer(KinesisProducerConfiguration) - Method in class software.amazon.kinesis.connectors.flink.FlinkKinesisProducer

Creates a KinesisProducer.

getLastProcessedSequenceNum() - Method in class software.amazon.kinesis.connectors.flink.model.KinesisStreamShardState

getLastSeenShardOfStream(String) - Method in class software.amazon.kinesis.connectors.flink.proxy.GetShardListResult

getLoopFrequencyHz() - Method in class software.amazon.kinesis.connectors.flink.metrics.PollingRecordPublisherMetricsReporter

getMaxNumberOfRecordsPerFetch() - Method in class software.amazon.kinesis.connectors.flink.internals.publisher.polling.PollingRecordPublisherConfiguration

getMaxNumberOfRecordsPerFetch() - Method in class software.amazon.kinesis.connectors.flink.metrics.PollingRecordPublisherMetricsReporter

getMillisBehindLatest() - Method in class software.amazon.kinesis.connectors.flink.internals.publisher.RecordBatch

getMillisBehindLatest() - Method in class software.amazon.kinesis.connectors.flink.metrics.ShardConsumerMetricsReporter

getNumberOfAggregatedRecords() - Method in class software.amazon.kinesis.connectors.flink.metrics.ShardConsumerMetricsReporter

getNumberOfDeaggregatedRecords() - Method in class software.amazon.kinesis.connectors.flink.metrics.ShardConsumerMetricsReporter

getParentShardId() - Method in class software.amazon.kinesis.connectors.flink.model.StreamShardMetadata

getPartitionId(T) - Method in class software.amazon.kinesis.connectors.flink.FixedKinesisPartitioner

getPartitionId(T) - Method in class software.amazon.kinesis.connectors.flink.KinesisPartitioner

Return a partition id based on the input.

getPartitionId(T) - Method in class software.amazon.kinesis.connectors.flink.RandomKinesisPartitioner

getPartitionId(RowData) - Method in class software.amazon.kinesis.connectors.flink.table.RowDataFieldsKinesisPartitioner

getPeriodicWatermarkAssigner() - Method in class software.amazon.kinesis.connectors.flink.FlinkKinesisConsumer

getProducedType() - Method in class software.amazon.kinesis.connectors.flink.FlinkKinesisConsumer

getProducedType() - Method in class software.amazon.kinesis.connectors.flink.serialization.DynamoDBStreamsSchema

getProducedType() - Method in class software.amazon.kinesis.connectors.flink.serialization.KinesisDeserializationSchemaWrapper

getProducedType() - Method in class software.amazon.kinesis.connectors.flink.table.RowDataKinesisDeserializationSchema

getProducerProperties(Map<String, String>) - Static method in class software.amazon.kinesis.connectors.flink.table.KinesisOptions

Derive properties to be passed to the FlinkKinesisProducer.

getQueue(int) - Method in class software.amazon.kinesis.connectors.flink.util.RecordEmitter

The queue for the given producer (i.e.

getRecords(String, int) - Method in class software.amazon.kinesis.connectors.flink.proxy.KinesisProxy

getRecords(String, int) - Method in interface software.amazon.kinesis.connectors.flink.proxy.KinesisProxyInterface

Get the next batch of data records using a specific shard iterator.

getRegion(Properties) - Static method in class software.amazon.kinesis.connectors.flink.util.AwsV2Util

Creates a Region object from the given Properties.

getRegisterStreamBaseBackoffMillis() - Method in class software.amazon.kinesis.connectors.flink.internals.publisher.fanout.FanOutRecordPublisherConfiguration

Get base backoff millis for the register stream operation.

getRegisterStreamConsumerTimeout() - Method in class software.amazon.kinesis.connectors.flink.internals.publisher.fanout.FanOutRecordPublisherConfiguration

Get maximum duration to wait for a stream consumer to become active before giving up.

getRegisterStreamExpConstant() - Method in class software.amazon.kinesis.connectors.flink.internals.publisher.fanout.FanOutRecordPublisherConfiguration

Get exponential backoff power constant for the register stream operation.

getRegisterStreamMaxBackoffMillis() - Method in class software.amazon.kinesis.connectors.flink.internals.publisher.fanout.FanOutRecordPublisherConfiguration

Get maximum backoff millis for the register stream operation.

getRegisterStreamMaxRetries() - Method in class software.amazon.kinesis.connectors.flink.internals.publisher.fanout.FanOutRecordPublisherConfiguration

Get maximum retry attempts for the register stream operation.

getRetrievedShardListOfStream(String) - Method in class software.amazon.kinesis.connectors.flink.proxy.GetShardListResult

getRunLoopTimeNanos() - Method in class software.amazon.kinesis.connectors.flink.metrics.PollingRecordPublisherMetricsReporter

getScanRuntimeProvider(ScanTableSource.ScanContext) - Method in class software.amazon.kinesis.connectors.flink.table.KinesisDynamicSource

getSequenceNumber() - Method in class software.amazon.kinesis.connectors.flink.model.SequenceNumber

getShard() - Method in class software.amazon.kinesis.connectors.flink.model.KinesisStreamShard

Deprecated.

getShard() - Method in class software.amazon.kinesis.connectors.flink.model.StreamShardHandle

getShardAssigner() - Method in class software.amazon.kinesis.connectors.flink.FlinkKinesisConsumer

getShardId() - Method in class software.amazon.kinesis.connectors.flink.model.StreamShardMetadata

getShardIterator(StreamShardHandle, String, Object) - Method in class software.amazon.kinesis.connectors.flink.proxy.KinesisProxy

getShardIterator(StreamShardHandle, String, Object) - Method in interface software.amazon.kinesis.connectors.flink.proxy.KinesisProxyInterface

Get a shard iterator from the specified position in a shard.

getShardIteratorType() - Method in class software.amazon.kinesis.connectors.flink.model.StartingPosition

getShardList(Map<String, String>) - Method in class software.amazon.kinesis.connectors.flink.proxy.DynamoDBStreamsProxy

getShardList(Map<String, String>) - Method in class software.amazon.kinesis.connectors.flink.proxy.KinesisProxy

getShardList(Map<String, String>) - Method in interface software.amazon.kinesis.connectors.flink.proxy.KinesisProxyInterface

Get shard list of multiple Kinesis streams, ignoring the shards of each stream before a specified last seen shard id.

GetShardListResult - Class in software.amazon.kinesis.connectors.flink.proxy

Basic model class to bundle the shards retrieved from Kinesis on a KinesisProxyInterface.getShardList(Map) call.

GetShardListResult() - Constructor for class software.amazon.kinesis.connectors.flink.proxy.GetShardListResult

getShardMetadata() - Method in class software.amazon.kinesis.connectors.flink.model.StreamShardMetadata.EquivalenceWrapper

getSinkRuntimeProvider(DynamicTableSink.Context) - Method in class software.amazon.kinesis.connectors.flink.table.KinesisDynamicSink

getSize() - Method in interface software.amazon.kinesis.connectors.flink.util.RecordEmitter.RecordQueue

getSleepTimeMillis() - Method in class software.amazon.kinesis.connectors.flink.metrics.PollingRecordPublisherMetricsReporter

getStartingHashKey() - Method in class software.amazon.kinesis.connectors.flink.model.StreamShardMetadata

getStartingMarker() - Method in class software.amazon.kinesis.connectors.flink.model.StartingPosition

getStartingPosition(SequenceNumber, Properties) - Static method in class software.amazon.kinesis.connectors.flink.util.AWSUtil

Creates a StartingPosition from the given SequenceNumber and Properties.

getStartingSequenceNumber() - Method in class software.amazon.kinesis.connectors.flink.model.StreamShardMetadata

getStreamConsumerArn(String) - Method in class software.amazon.kinesis.connectors.flink.internals.publisher.fanout.FanOutRecordPublisherConfiguration

Get the according consumer arn to the stream, will be null if efo registration type is 'LAZY' or 'EAGER'.

getStreamName() - Method in class software.amazon.kinesis.connectors.flink.model.KinesisStreamShard

Deprecated.

getStreamName() - Method in class software.amazon.kinesis.connectors.flink.model.StreamShardHandle

getStreamName() - Method in class software.amazon.kinesis.connectors.flink.model.StreamShardMetadata

getStreamShardHandle() - Method in class software.amazon.kinesis.connectors.flink.model.KinesisStreamShardState

getStreamShardMetadata() - Method in class software.amazon.kinesis.connectors.flink.model.KinesisStreamShardState

getStreamsWithRetrievedShards() - Method in class software.amazon.kinesis.connectors.flink.proxy.GetShardListResult

getSubscribedShardsState() - Method in class software.amazon.kinesis.connectors.flink.internals.KinesisDataFetcher

getSubscribeToShardBaseBackoffMillis() - Method in class software.amazon.kinesis.connectors.flink.internals.publisher.fanout.FanOutRecordPublisherConfiguration

Get base backoff millis for the subscribe to shard operation.

getSubscribeToShardExpConstant() - Method in class software.amazon.kinesis.connectors.flink.internals.publisher.fanout.FanOutRecordPublisherConfiguration

Get exponential backoff power constant for the subscribe to shard operation.

getSubscribeToShardMaxBackoffMillis() - Method in class software.amazon.kinesis.connectors.flink.internals.publisher.fanout.FanOutRecordPublisherConfiguration

Get maximum backoff millis for the subscribe to shard operation.

getSubscribeToShardMaxRetries() - Method in class software.amazon.kinesis.connectors.flink.internals.publisher.fanout.FanOutRecordPublisherConfiguration

Get maximum retry attempts for the subscribe to shard operation.

getSubscribeToShardTimeout() - Method in class software.amazon.kinesis.connectors.flink.internals.publisher.fanout.FanOutRecordPublisherConfiguration

Get timeout when waiting for a shard subscription to be established.

getSubSequenceNumber() - Method in class software.amazon.kinesis.connectors.flink.model.SequenceNumber

getSubtaskId() - Method in class software.amazon.kinesis.connectors.flink.util.WatermarkTracker

getTargetStream(T) - Method in interface software.amazon.kinesis.connectors.flink.serialization.KinesisSerializationSchema

Optional method to determine the target stream based on the element.

getTotalSizeInBytes() - Method in class software.amazon.kinesis.connectors.flink.internals.publisher.RecordBatch

getUpdateTimeoutCount() - Method in class software.amazon.kinesis.connectors.flink.util.JobManagerWatermarkTracker

getUpdateTimeoutCount() - Method in class software.amazon.kinesis.connectors.flink.util.WatermarkTracker

getUpdateTimeoutMillis() - Method in class software.amazon.kinesis.connectors.flink.util.WatermarkTracker

getValidatedProducerConfiguration(Properties) - Static method in class software.amazon.kinesis.connectors.flink.util.KinesisConfigUtil

Validate configuration properties for FlinkKinesisProducer, and return a constructed KinesisProducerConfiguration.

getWatermark() - Method in class software.amazon.kinesis.connectors.flink.util.WatermarkTracker.WatermarkState

getWatermarkTracker() - Method in class software.amazon.kinesis.connectors.flink.FlinkKinesisConsumer

H

hashCode() - Method in class software.amazon.kinesis.connectors.flink.FixedKinesisPartitioner

hashCode() - Method in class software.amazon.kinesis.connectors.flink.model.KinesisStreamShard

Deprecated.

hashCode() - Method in class software.amazon.kinesis.connectors.flink.model.KinesisStreamShardState

hashCode() - Method in class software.amazon.kinesis.connectors.flink.model.SequenceNumber

hashCode() - Method in class software.amazon.kinesis.connectors.flink.model.StreamShardHandle

hashCode() - Method in class software.amazon.kinesis.connectors.flink.model.StreamShardMetadata.EquivalenceWrapper

hashCode() - Method in class software.amazon.kinesis.connectors.flink.model.StreamShardMetadata

hashCode() - Method in class software.amazon.kinesis.connectors.flink.RandomKinesisPartitioner

hashCode() - Method in class software.amazon.kinesis.connectors.flink.table.KinesisDynamicSink

hashCode() - Method in class software.amazon.kinesis.connectors.flink.table.KinesisDynamicSource

hashCode() - Method in class software.amazon.kinesis.connectors.flink.table.RowDataFieldsKinesisPartitioner

hasRetrievedShards() - Method in class software.amazon.kinesis.connectors.flink.proxy.GetShardListResult

hasWellDefinedString(LogicalType) - Static method in class software.amazon.kinesis.connectors.flink.table.RowDataFieldsKinesisPartitioner

Checks whether the given LogicalType has a well-defined string representation when calling Object.toString() on the internal data structure.

I

id - Variable in class software.amazon.kinesis.connectors.flink.util.JobManagerWatermarkTracker.WatermarkUpdate

IDENTIFIER - Static variable in class software.amazon.kinesis.connectors.flink.table.KinesisDynamicTableFactory

initialize(int, int) - Method in class software.amazon.kinesis.connectors.flink.FixedKinesisPartitioner

initialize(int, int) - Method in class software.amazon.kinesis.connectors.flink.KinesisPartitioner

Optional initializer.

initializeState(FunctionInitializationContext) - Method in class software.amazon.kinesis.connectors.flink.FlinkKinesisConsumer

initializeState(FunctionInitializationContext) - Method in class software.amazon.kinesis.connectors.flink.FlinkKinesisProducer

invoke(OUT, SinkFunction.Context) - Method in class software.amazon.kinesis.connectors.flink.FlinkKinesisProducer

isAdaptiveReads() - Method in class software.amazon.kinesis.connectors.flink.internals.publisher.polling.PollingRecordPublisherConfiguration

isAggregated() - Method in class software.amazon.kinesis.connectors.flink.model.SequenceNumber

isClosed() - Method in class software.amazon.kinesis.connectors.flink.model.KinesisStreamShard

Deprecated.

isClosed() - Method in class software.amazon.kinesis.connectors.flink.model.StreamShardHandle

isEagerEfoRegistrationType(Properties) - Static method in class software.amazon.kinesis.connectors.flink.util.AwsV2Util

isLazyEfoRegistrationType(Properties) - Static method in class software.amazon.kinesis.connectors.flink.util.AwsV2Util

isNoneEfoRegistrationType(Properties) - Static method in class software.amazon.kinesis.connectors.flink.util.AwsV2Util

isRecoverableException(AmazonServiceException) - Static method in class software.amazon.kinesis.connectors.flink.proxy.KinesisProxy

Determines whether the exception is recoverable using exponential-backoff.

isRecoverableException(Exception) - Static method in class software.amazon.kinesis.connectors.flink.util.AwsV2Util

isRecoverableSdkClientException(SdkClientException) - Method in class software.amazon.kinesis.connectors.flink.proxy.KinesisProxy

Determines whether the exception is recoverable using exponential-backoff.

isSentinelSequenceNumber(SequenceNumber) - Static method in enum software.amazon.kinesis.connectors.flink.model.SentinelSequenceNumber

Returns true if the given SequenceNumber is a sentinel.

isThisSubtaskShouldSubscribeTo(int, int, int) - Static method in class software.amazon.kinesis.connectors.flink.internals.KinesisDataFetcher

Utility function to determine whether a shard should be subscribed by this consumer subtask.

isUsingEfoRecordPublisher(Properties) - Static method in class software.amazon.kinesis.connectors.flink.util.AwsV2Util

isValidRegion(String) - Static method in class software.amazon.kinesis.connectors.flink.util.AWSUtil

Checks whether or not a region ID is valid.

isValidShardId(String) - Static method in class software.amazon.kinesis.connectors.flink.model.DynamoDBStreamsShardHandle

Dynamodb streams shard ID is a char string ranging from 28 characters to 65 characters.

J

JobManagerWatermarkTracker - Class in software.amazon.kinesis.connectors.flink.util

A WatermarkTracker that shares state through GlobalAggregateManager.

JobManagerWatermarkTracker(String) - Constructor for class software.amazon.kinesis.connectors.flink.util.JobManagerWatermarkTracker

JobManagerWatermarkTracker(String, long) - Constructor for class software.amazon.kinesis.connectors.flink.util.JobManagerWatermarkTracker

JobManagerWatermarkTracker.WatermarkResult - Class in software.amazon.kinesis.connectors.flink.util

Watermark aggregation result.

JobManagerWatermarkTracker.WatermarkUpdate - Class in software.amazon.kinesis.connectors.flink.util

Watermark aggregation input.

K

KINESIS_CONSUMER_METRICS_GROUP - Static variable in class software.amazon.kinesis.connectors.flink.metrics.KinesisConsumerMetricConstants

KINESIS_PRODUCER_METRIC_GROUP - Static variable in class software.amazon.kinesis.connectors.flink.FlinkKinesisProducer

KinesisConfigUtil - Class in software.amazon.kinesis.connectors.flink.util

Utilities for Flink Kinesis connector configuration.

KinesisConfigUtil() - Constructor for class software.amazon.kinesis.connectors.flink.util.KinesisConfigUtil

KinesisConsumerMetricConstants - Class in software.amazon.kinesis.connectors.flink.metrics

A collection of consumer metric related constant names.

KinesisConsumerMetricConstants() - Constructor for class software.amazon.kinesis.connectors.flink.metrics.KinesisConsumerMetricConstants

KinesisDataFetcher<T> - Class in software.amazon.kinesis.connectors.flink.internals

A KinesisDataFetcher is responsible for fetching data from multiple Kinesis shards.

KinesisDataFetcher(List<String>, SourceFunction.SourceContext<T>, RuntimeContext, Properties, KinesisDeserializationSchema<T>, KinesisShardAssigner, AssignerWithPeriodicWatermarks<T>, WatermarkTracker) - Constructor for class software.amazon.kinesis.connectors.flink.internals.KinesisDataFetcher

Creates a Kinesis Data Fetcher.

KinesisDataFetcher(List<String>, SourceFunction.SourceContext<T>, Object, RuntimeContext, Properties, KinesisDeserializationSchema<T>, KinesisShardAssigner, AssignerWithPeriodicWatermarks<T>, WatermarkTracker, AtomicReference<Throwable>, List<KinesisStreamShardState>, HashMap<String, String>, KinesisDataFetcher.FlinkKinesisProxyFactory, KinesisDataFetcher.FlinkKinesisProxyV2Factory) - Constructor for class software.amazon.kinesis.connectors.flink.internals.KinesisDataFetcher

KinesisDataFetcher.FlinkKinesisProxyFactory - Interface in software.amazon.kinesis.connectors.flink.internals

Factory to create Kinesis proxy instances used by a fetcher.

KinesisDataFetcher.FlinkKinesisProxyV2Factory - Interface in software.amazon.kinesis.connectors.flink.internals

Factory to create Kinesis proxy V@ instances used by a fetcher.

KinesisDeserializationSchema<T> - Interface in software.amazon.kinesis.connectors.flink.serialization

This is a deserialization schema specific for the Flink Kinesis Consumer.

KinesisDeserializationSchemaWrapper<T> - Class in software.amazon.kinesis.connectors.flink.serialization

A simple wrapper for using the DeserializationSchema with the KinesisDeserializationSchema interface.

KinesisDeserializationSchemaWrapper(DeserializationSchema<T>) - Constructor for class software.amazon.kinesis.connectors.flink.serialization.KinesisDeserializationSchemaWrapper

KinesisDynamicSink - Class in software.amazon.kinesis.connectors.flink.table

Kinesis-backed DynamicTableSink.

KinesisDynamicSink(DataType, String, Properties, EncodingFormat<SerializationSchema<RowData>>, KinesisPartitioner<RowData>) - Constructor for class software.amazon.kinesis.connectors.flink.table.KinesisDynamicSink

KinesisDynamicSource - Class in software.amazon.kinesis.connectors.flink.table

Kinesis-backed ScanTableSource.

KinesisDynamicSource(DataType, String, Properties, DecodingFormat<DeserializationSchema<RowData>>) - Constructor for class software.amazon.kinesis.connectors.flink.table.KinesisDynamicSource

KinesisDynamicTableFactory - Class in software.amazon.kinesis.connectors.flink.table

Factory for creating KinesisDynamicSource and KinesisDynamicSink instances.

KinesisDynamicTableFactory() - Constructor for class software.amazon.kinesis.connectors.flink.table.KinesisDynamicTableFactory

KinesisOptions - Class in software.amazon.kinesis.connectors.flink.table

Options for Kinesis tables supported by the {@code CREATE TABLE ...

KinesisPartitioner<T> - Class in software.amazon.kinesis.connectors.flink

An interface for partitioning records.

KinesisPartitioner() - Constructor for class software.amazon.kinesis.connectors.flink.KinesisPartitioner

KinesisProxy - Class in software.amazon.kinesis.connectors.flink.proxy

Kinesis proxy implementation - a utility class that is used as a proxy to make calls to AWS Kinesis for several functions, such as getting a list of shards and fetching a batch of data records starting from a specified record sequence number.

KinesisProxy(Properties) - Constructor for class software.amazon.kinesis.connectors.flink.proxy.KinesisProxy

Create a new KinesisProxy based on the supplied configuration properties.

KinesisProxyInterface - Interface in software.amazon.kinesis.connectors.flink.proxy

Interface for a Kinesis proxy that operates on multiple Kinesis streams within the same AWS service region.

KinesisProxyV2 - Class in software.amazon.kinesis.connectors.flink.proxy

Kinesis proxy implementation using AWS SDK v2.x - a utility class that is used as a proxy to make calls to AWS Kinesis for several EFO (Enhanced Fan Out) functions, such as de-/registering stream consumers, subscribing to a shard and receiving records from a shard.

KinesisProxyV2(KinesisAsyncClient, SdkAsyncHttpClient, FanOutRecordPublisherConfiguration, FullJitterBackoff) - Constructor for class software.amazon.kinesis.connectors.flink.proxy.KinesisProxyV2

Create a new KinesisProxyV2.

KinesisProxyV2Factory - Class in software.amazon.kinesis.connectors.flink.proxy

Creates instances of KinesisProxyV2.

KinesisProxyV2Factory() - Constructor for class software.amazon.kinesis.connectors.flink.proxy.KinesisProxyV2Factory

KinesisProxyV2Interface - Interface in software.amazon.kinesis.connectors.flink.proxy

Interface for a Kinesis proxy using AWS SDK v2.x operating on multiple Kinesis streams within the same AWS service region.

KinesisSerializationSchema<T> - Interface in software.amazon.kinesis.connectors.flink.serialization

Kinesis-specific serialization schema, allowing users to specify a target stream based on a record's contents.

KinesisShardAssigner - Interface in software.amazon.kinesis.connectors.flink

Utility to map Kinesis shards to Flink subtask indices.

KinesisStateUtil - Class in software.amazon.kinesis.connectors.flink.util

Utilities for Flink Kinesis connector state management.

KinesisStreamShard - Class in software.amazon.kinesis.connectors.flink.model

Deprecated.

Will be remove in a future version in favor of StreamShardHandle.

KinesisStreamShard(String, Shard) - Constructor for class software.amazon.kinesis.connectors.flink.model.KinesisStreamShard

Deprecated.

Create a new KinesisStreamShard.

KinesisStreamShardState - Class in software.amazon.kinesis.connectors.flink.model

A wrapper class that bundles a StreamShardHandle with its last processed sequence number.

KinesisStreamShardState(StreamShardMetadata, StreamShardHandle, SequenceNumber) - Constructor for class software.amazon.kinesis.connectors.flink.model.KinesisStreamShardState

L

lastUpdated - Variable in class software.amazon.kinesis.connectors.flink.util.WatermarkTracker.WatermarkState

lazilyRegisterStreamConsumers(Properties, List<String>) - Static method in class software.amazon.kinesis.connectors.flink.util.StreamConsumerRegistrarUtil

Registers stream consumers for the given streams if EFO is enabled with LAZY registration strategy.

LIST_SHARDS_BACKOFF_BASE - Static variable in class software.amazon.kinesis.connectors.flink.config.ConsumerConfigConstants

The base backoff time between each listShards attempt.

LIST_SHARDS_BACKOFF_EXPONENTIAL_CONSTANT - Static variable in class software.amazon.kinesis.connectors.flink.config.ConsumerConfigConstants

The power constant for exponential backoff between each listShards attempt.

LIST_SHARDS_BACKOFF_MAX - Static variable in class software.amazon.kinesis.connectors.flink.config.ConsumerConfigConstants

The maximum backoff time between each listShards attempt.

LIST_SHARDS_RETRIES - Static variable in class software.amazon.kinesis.connectors.flink.config.ConsumerConfigConstants

The maximum number of listShards attempts if we get a recoverable exception.

LOOP_FREQUENCY_HZ - Static variable in class software.amazon.kinesis.connectors.flink.metrics.KinesisConsumerMetricConstants

M

MAX_PARTITION_KEY_LENGTH - Static variable in class software.amazon.kinesis.connectors.flink.table.RowDataFieldsKinesisPartitioner

Allowed maximum length limit of a partition key.

MAX_RECORDS_PER_FETCH - Static variable in class software.amazon.kinesis.connectors.flink.metrics.KinesisConsumerMetricConstants

MAX_SHARD_GETRECORDS_INTERVAL_MILLIS - Static variable in class software.amazon.kinesis.connectors.flink.config.ConsumerConfigConstants

To avoid shard iterator expires in ShardConsumers, the value for the configured getRecords interval can not exceed 5 minutes, which is the expire time for retrieved iterators.

METRIC_BACKPRESSURE_CYCLES - Static variable in class software.amazon.kinesis.connectors.flink.FlinkKinesisProducer

METRIC_OUTSTANDING_RECORDS_COUNT - Static variable in class software.amazon.kinesis.connectors.flink.FlinkKinesisProducer

MILLIS_BEHIND_LATEST_GAUGE - Static variable in class software.amazon.kinesis.connectors.flink.metrics.KinesisConsumerMetricConstants

N

NON_VALIDATED_PREFIXES - Static variable in class software.amazon.kinesis.connectors.flink.table.KinesisOptions

Prefixes of properties that are validated by downstream components and should not be validated by the Table API infrastructure.

NUM_AGGREGATED_RECORDS_PER_FETCH - Static variable in class software.amazon.kinesis.connectors.flink.metrics.KinesisConsumerMetricConstants

NUM_DEAGGREGATED_RECORDS_PER_FETCH - Static variable in class software.amazon.kinesis.connectors.flink.metrics.KinesisConsumerMetricConstants

O

open(Configuration) - Method in class software.amazon.kinesis.connectors.flink.FlinkKinesisProducer

open(DeserializationSchema.InitializationContext) - Method in interface software.amazon.kinesis.connectors.flink.serialization.KinesisDeserializationSchema

Initialization method for the schema.

open(DeserializationSchema.InitializationContext) - Method in class software.amazon.kinesis.connectors.flink.serialization.KinesisDeserializationSchemaWrapper

open(SerializationSchema.InitializationContext) - Method in interface software.amazon.kinesis.connectors.flink.serialization.KinesisSerializationSchema

Initialization method for the schema.

open(DeserializationSchema.InitializationContext) - Method in class software.amazon.kinesis.connectors.flink.table.RowDataKinesisDeserializationSchema

open(RuntimeContext) - Method in class software.amazon.kinesis.connectors.flink.util.JobManagerWatermarkTracker

open(RuntimeContext) - Method in class software.amazon.kinesis.connectors.flink.util.WatermarkTracker

optionalOptions() - Method in class software.amazon.kinesis.connectors.flink.table.KinesisDynamicTableFactory

P

parseStreamTimestampStartingPosition(Properties) - Static method in class software.amazon.kinesis.connectors.flink.util.KinesisConfigUtil

Parses the timestamp in which to start consuming from the stream, from the given properties.

peek() - Method in interface software.amazon.kinesis.connectors.flink.util.RecordEmitter.RecordQueue

PollingRecordPublisher - Class in software.amazon.kinesis.connectors.flink.internals.publisher.polling

A RecordPublisher that will read records from Kinesis and forward them to the subscriber.

PollingRecordPublisherConfiguration - Class in software.amazon.kinesis.connectors.flink.internals.publisher.polling

A configuration class for PollingRecordPublisher instantiated from a properties map.

PollingRecordPublisherConfiguration(Properties) - Constructor for class software.amazon.kinesis.connectors.flink.internals.publisher.polling.PollingRecordPublisherConfiguration

PollingRecordPublisherFactory - Class in software.amazon.kinesis.connectors.flink.internals.publisher.polling

A RecordPublisher factory used to create instances of PollingRecordPublisher.

PollingRecordPublisherFactory(KinesisDataFetcher.FlinkKinesisProxyFactory) - Constructor for class software.amazon.kinesis.connectors.flink.internals.publisher.polling.PollingRecordPublisherFactory

PollingRecordPublisherMetricsReporter - Class in software.amazon.kinesis.connectors.flink.metrics

A container for PollingRecordPublishers to report metric values.

PollingRecordPublisherMetricsReporter(MetricGroup) - Constructor for class software.amazon.kinesis.connectors.flink.metrics.PollingRecordPublisherMetricsReporter

printInfo() - Method in class software.amazon.kinesis.connectors.flink.util.RecordEmitter

Summary of emit queues that can be used for logging.

PRODUCER_PREFIX - Static variable in class software.amazon.kinesis.connectors.flink.table.KinesisOptions

Prefix for properties defined in KinesisProducerConfiguration that are delegated to FlinkKinesisConsumer.

ProducerConfigConstants - Class in software.amazon.kinesis.connectors.flink.config

Deprecated.

This class is deprecated in favor of the official AWS Kinesis producer configuration keys. See here for the full list of available configs. For configuring the region and credentials, please use the keys in AWSConfigConstants.

ProducerConfigConstants() - Constructor for class software.amazon.kinesis.connectors.flink.config.ProducerConfigConstants

Deprecated.

profileName(String) - Static method in class software.amazon.kinesis.connectors.flink.config.AWSConfigConstants

profilePath(String) - Static method in class software.amazon.kinesis.connectors.flink.config.AWSConfigConstants

put(T) - Method in interface software.amazon.kinesis.connectors.flink.util.RecordEmitter.RecordQueue

R

RandomKinesisPartitioner<T> - Class in software.amazon.kinesis.connectors.flink

A KinesisPartitioner that maps an arbitrary input element to a random partition ID.

RandomKinesisPartitioner() - Constructor for class software.amazon.kinesis.connectors.flink.RandomKinesisPartitioner

RATE_LIMIT - Static variable in class software.amazon.kinesis.connectors.flink.util.KinesisConfigUtil

Limits the maximum allowed put rate for a shard, as a percentage of the backend limits.

RECORD_PUBLISHER_TYPE - Static variable in class software.amazon.kinesis.connectors.flink.config.ConsumerConfigConstants

The RecordPublisher type (EFO|POLLING, default is POLLING).

RecordBatch - Class in software.amazon.kinesis.connectors.flink.internals.publisher

A batch of UserRecords received from Kinesis.

RecordBatch(List<Record>, StreamShardHandle, Long) - Constructor for class software.amazon.kinesis.connectors.flink.internals.publisher.RecordBatch

RecordEmitter<T extends org.apache.flink.streaming.runtime.operators.windowing.TimestampedValue> - Class in software.amazon.kinesis.connectors.flink.util

Emitter that handles event time synchronization between producer threads.

RecordEmitter(int) - Constructor for class software.amazon.kinesis.connectors.flink.util.RecordEmitter

RecordEmitter.RecordQueue<T> - Interface in software.amazon.kinesis.connectors.flink.util

Accepts records from readers.

RecordPublisher - Interface in software.amazon.kinesis.connectors.flink.internals.publisher

A RecordPublisher will consume records from an external stream and deliver them to the registered subscriber.

RecordPublisher.RecordBatchConsumer - Interface in software.amazon.kinesis.connectors.flink.internals.publisher

An interface used to collect record batches, and reply with the latest consumed sequence number.

RecordPublisher.RecordPublisherRunResult - Enum in software.amazon.kinesis.connectors.flink.internals.publisher

A status enum to represent whether a shard has been fully consumed.

RecordPublisherFactory - Interface in software.amazon.kinesis.connectors.flink.internals.publisher

A factory interface used to create instances of RecordPublisher.

REGISTER_STREAM_BACKOFF_BASE - Static variable in class software.amazon.kinesis.connectors.flink.config.ConsumerConfigConstants

The base backoff time between each registerStream attempt.

REGISTER_STREAM_BACKOFF_EXPONENTIAL_CONSTANT - Static variable in class software.amazon.kinesis.connectors.flink.config.ConsumerConfigConstants

The power constant for exponential backoff between each registerStream attempt.

REGISTER_STREAM_BACKOFF_MAX - Static variable in class software.amazon.kinesis.connectors.flink.config.ConsumerConfigConstants

The maximum backoff time between each registerStream attempt.

REGISTER_STREAM_RETRIES - Static variable in class software.amazon.kinesis.connectors.flink.config.ConsumerConfigConstants

The maximum number of registerStream attempts if we get a recoverable exception.

REGISTER_STREAM_TIMEOUT_SECONDS - Static variable in class software.amazon.kinesis.connectors.flink.config.ConsumerConfigConstants

The maximum time in seconds to wait for a stream consumer to become active before giving up.

registerNewSubscribedShardState(KinesisStreamShardState) - Method in class software.amazon.kinesis.connectors.flink.internals.KinesisDataFetcher

Register a new subscribed shard state.

registerStreamConsumer(String, String) - Method in class software.amazon.kinesis.connectors.flink.internals.publisher.fanout.StreamConsumerRegistrar

Register a stream consumer with the given name against the given stream.

registerStreamConsumer(String, String) - Method in class software.amazon.kinesis.connectors.flink.proxy.KinesisProxyV2

registerStreamConsumer(String, String) - Method in interface software.amazon.kinesis.connectors.flink.proxy.KinesisProxyV2Interface

replaceDeprecatedProducerKeys(Properties) - Static method in class software.amazon.kinesis.connectors.flink.util.KinesisConfigUtil

Replace deprecated configuration properties for FlinkKinesisProducer.

requiredOptions() - Method in class software.amazon.kinesis.connectors.flink.table.KinesisDynamicTableFactory

restartFromSequenceNumber(SequenceNumber) - Static method in class software.amazon.kinesis.connectors.flink.model.StartingPosition

Returns the starting position to restart record consumption from the given sequence number after failure.

roleArn(String) - Static method in class software.amazon.kinesis.connectors.flink.config.AWSConfigConstants

roleCredentialsProvider(String) - Static method in class software.amazon.kinesis.connectors.flink.config.AWSConfigConstants

roleSessionName(String) - Static method in class software.amazon.kinesis.connectors.flink.config.AWSConfigConstants

RowDataFieldsKinesisPartitioner - Class in software.amazon.kinesis.connectors.flink.table

A KinesisPartitioner of RowData elements that constructs the partition key from a list of field names.

RowDataFieldsKinesisPartitioner(CatalogTable) - Constructor for class software.amazon.kinesis.connectors.flink.table.RowDataFieldsKinesisPartitioner

RowDataFieldsKinesisPartitioner(CatalogTable, String) - Constructor for class software.amazon.kinesis.connectors.flink.table.RowDataFieldsKinesisPartitioner

RowDataKinesisDeserializationSchema - Class in software.amazon.kinesis.connectors.flink.table

A KinesisDeserializationSchema adaptor for RowData records that delegates physical data deserialization to an inner DeserializationSchema and appends requested metadata to the end of the deserialized RowData record.

RowDataKinesisDeserializationSchema(DeserializationSchema<RowData>, TypeInformation<RowData>) - Constructor for class software.amazon.kinesis.connectors.flink.table.RowDataKinesisDeserializationSchema

run(SourceFunction.SourceContext<T>) - Method in class software.amazon.kinesis.connectors.flink.FlinkKinesisConsumer

run(RecordPublisher.RecordBatchConsumer) - Method in class software.amazon.kinesis.connectors.flink.internals.publisher.fanout.FanOutRecordPublisher

run(RecordPublisher.RecordBatchConsumer) - Method in class software.amazon.kinesis.connectors.flink.internals.publisher.polling.AdaptivePollingRecordPublisher

run(RecordPublisher.RecordBatchConsumer) - Method in class software.amazon.kinesis.connectors.flink.internals.publisher.polling.PollingRecordPublisher

run(RecordPublisher.RecordBatchConsumer, int) - Method in class software.amazon.kinesis.connectors.flink.internals.publisher.polling.PollingRecordPublisher

run(RecordPublisher.RecordBatchConsumer) - Method in interface software.amazon.kinesis.connectors.flink.internals.publisher.RecordPublisher

Run the record publisher.

run() - Method in class software.amazon.kinesis.connectors.flink.internals.ShardConsumer

run() - Method in class software.amazon.kinesis.connectors.flink.util.RecordEmitter

Run loop, does not return unless RecordEmitter.stop() was called.

runFetcher() - Method in class software.amazon.kinesis.connectors.flink.internals.KinesisDataFetcher

Starts the fetcher.

RUNTIME_LOOP_NANOS - Static variable in class software.amazon.kinesis.connectors.flink.metrics.KinesisConsumerMetricConstants

S

secretKey(String) - Static method in class software.amazon.kinesis.connectors.flink.config.AWSConfigConstants

SentinelSequenceNumber - Enum in software.amazon.kinesis.connectors.flink.model

Special flag values for sequence numbers in shards to indicate special positions.

SequenceNumber - Class in software.amazon.kinesis.connectors.flink.model

A serializable representation of a Kinesis record's sequence number.

SequenceNumber(String) - Constructor for class software.amazon.kinesis.connectors.flink.model.SequenceNumber

Create a new instance for a non-aggregated Kinesis record without a subsequence number.

SequenceNumber(String, long) - Constructor for class software.amazon.kinesis.connectors.flink.model.SequenceNumber

Create a new instance, with the specified sequence number and subsequence number.

serialize(T) - Method in interface software.amazon.kinesis.connectors.flink.serialization.KinesisSerializationSchema

Serialize the given element into a ByteBuffer.

setAdjacentParentShardId(String) - Method in class software.amazon.kinesis.connectors.flink.model.StreamShardMetadata

setAverageRecordSizeBytes(long) - Method in class software.amazon.kinesis.connectors.flink.metrics.ShardConsumerMetricsReporter

setAwsClientConfigProperties(ClientConfiguration, Properties) - Static method in class software.amazon.kinesis.connectors.flink.util.AWSUtil

Set all prefixed properties on ClientConfiguration.

setBytesPerRead(double) - Method in class software.amazon.kinesis.connectors.flink.metrics.PollingRecordPublisherMetricsReporter

setCurrentWatermark(long) - Method in class software.amazon.kinesis.connectors.flink.util.RecordEmitter

Set the current watermark.

setCustomPartitioner(KinesisPartitioner<OUT>) - Method in class software.amazon.kinesis.connectors.flink.FlinkKinesisProducer

setDefaultPartition(String) - Method in class software.amazon.kinesis.connectors.flink.FlinkKinesisProducer

Set default partition id.

setDefaultStream(String) - Method in class software.amazon.kinesis.connectors.flink.FlinkKinesisProducer

Set a default stream name.

setEndingHashKey(String) - Method in class software.amazon.kinesis.connectors.flink.model.StreamShardMetadata

setEndingSequenceNumber(String) - Method in class software.amazon.kinesis.connectors.flink.model.StreamShardMetadata

setFailOnError(boolean) - Method in class software.amazon.kinesis.connectors.flink.FlinkKinesisProducer

If set to true, the producer will immediately fail with an exception on any error.

setLastProcessedSequenceNum(SequenceNumber) - Method in class software.amazon.kinesis.connectors.flink.model.KinesisStreamShardState

setLoopFrequencyHz(double) - Method in class software.amazon.kinesis.connectors.flink.metrics.PollingRecordPublisherMetricsReporter

setMaxLookaheadMillis(long) - Method in class software.amazon.kinesis.connectors.flink.util.RecordEmitter

How far ahead of the watermark records should be emitted.

setMaxNumberOfRecordsPerFetch(int) - Method in class software.amazon.kinesis.connectors.flink.metrics.PollingRecordPublisherMetricsReporter

setMillisBehindLatest(long) - Method in class software.amazon.kinesis.connectors.flink.metrics.ShardConsumerMetricsReporter

setNumberOfAggregatedRecords(int) - Method in class software.amazon.kinesis.connectors.flink.metrics.ShardConsumerMetricsReporter

setNumberOfDeaggregatedRecords(int) - Method in class software.amazon.kinesis.connectors.flink.metrics.ShardConsumerMetricsReporter

setParentShardId(String) - Method in class software.amazon.kinesis.connectors.flink.model.StreamShardMetadata

setPeriodicWatermarkAssigner(AssignerWithPeriodicWatermarks<T>) - Method in class software.amazon.kinesis.connectors.flink.FlinkKinesisConsumer

Set the assigner that will extract the timestamp from T and calculate the watermark.

setQueueLimit(int) - Method in class software.amazon.kinesis.connectors.flink.FlinkKinesisProducer

The KinesisProducer holds an unbounded queue internally.

setRunLoopTimeNanos(long) - Method in class software.amazon.kinesis.connectors.flink.metrics.PollingRecordPublisherMetricsReporter

setShardAssigner(KinesisShardAssigner) - Method in class software.amazon.kinesis.connectors.flink.FlinkKinesisConsumer

Provide a custom assigner to influence how shards are distributed over subtasks.

setShardId(String) - Method in class software.amazon.kinesis.connectors.flink.model.StreamShardMetadata

setSleepTimeMillis(long) - Method in class software.amazon.kinesis.connectors.flink.metrics.PollingRecordPublisherMetricsReporter

setStartingHashKey(String) - Method in class software.amazon.kinesis.connectors.flink.model.StreamShardMetadata

setStartingSequenceNumber(String) - Method in class software.amazon.kinesis.connectors.flink.model.StreamShardMetadata

setStaticFields(Map<String, String>) - Method in class software.amazon.kinesis.connectors.flink.table.RowDataFieldsKinesisPartitioner

Update the fixed partition key prefix.

setStreamName(String) - Method in class software.amazon.kinesis.connectors.flink.model.StreamShardMetadata

setUpdateTimeoutMillis(long) - Method in class software.amazon.kinesis.connectors.flink.util.WatermarkTracker

Subtasks that have not provided a watermark update within the configured interval will be considered idle and excluded from target watermark calculation.

setWatermarkTracker(WatermarkTracker) - Method in class software.amazon.kinesis.connectors.flink.FlinkKinesisConsumer

Set the global watermark tracker.

SHARD_DISCOVERY_INTERVAL_MILLIS - Static variable in class software.amazon.kinesis.connectors.flink.config.ConsumerConfigConstants

The interval between each attempt to discover new shards.

SHARD_GETITERATOR_BACKOFF_BASE - Static variable in class software.amazon.kinesis.connectors.flink.config.ConsumerConfigConstants

The base backoff time between getShardIterator attempts if we get a ProvisionedThroughputExceededException.

SHARD_GETITERATOR_BACKOFF_EXPONENTIAL_CONSTANT - Static variable in class software.amazon.kinesis.connectors.flink.config.ConsumerConfigConstants

The power constant for exponential backoff between each getShardIterator attempt.

SHARD_GETITERATOR_BACKOFF_MAX - Static variable in class software.amazon.kinesis.connectors.flink.config.ConsumerConfigConstants

The maximum backoff time between getShardIterator attempts if we get a ProvisionedThroughputExceededException.

SHARD_GETITERATOR_RETRIES - Static variable in class software.amazon.kinesis.connectors.flink.config.ConsumerConfigConstants

The maximum number of getShardIterator attempts if we get ProvisionedThroughputExceededException.

SHARD_GETRECORDS_BACKOFF_BASE - Static variable in class software.amazon.kinesis.connectors.flink.config.ConsumerConfigConstants

The base backoff time between getRecords attempts if we get a ProvisionedThroughputExceededException.

SHARD_GETRECORDS_BACKOFF_EXPONENTIAL_CONSTANT - Static variable in class software.amazon.kinesis.connectors.flink.config.ConsumerConfigConstants

The power constant for exponential backoff between each getRecords attempt.

SHARD_GETRECORDS_BACKOFF_MAX - Static variable in class software.amazon.kinesis.connectors.flink.config.ConsumerConfigConstants

The maximum backoff time between getRecords attempts if we get a ProvisionedThroughputExceededException.

SHARD_GETRECORDS_INTERVAL_MILLIS - Static variable in class software.amazon.kinesis.connectors.flink.config.ConsumerConfigConstants

The interval between each getRecords request to a AWS Kinesis shard in milliseconds.

SHARD_GETRECORDS_MAX - Static variable in class software.amazon.kinesis.connectors.flink.config.ConsumerConfigConstants

The maximum number of records to try to get each time we fetch records from a AWS Kinesis shard.

SHARD_GETRECORDS_RETRIES - Static variable in class software.amazon.kinesis.connectors.flink.config.ConsumerConfigConstants

The maximum number of getRecords attempts if we get a recoverable exception.

SHARD_IDLE_INTERVAL_MILLIS - Static variable in class software.amazon.kinesis.connectors.flink.config.ConsumerConfigConstants

The interval after which to consider a shard idle for purposes of watermark generation.

SHARD_METRICS_GROUP - Static variable in class software.amazon.kinesis.connectors.flink.metrics.KinesisConsumerMetricConstants

SHARD_USE_ADAPTIVE_READS - Static variable in class software.amazon.kinesis.connectors.flink.config.ConsumerConfigConstants

The config to turn on adaptive reads from a shard.

ShardConsumer<T> - Class in software.amazon.kinesis.connectors.flink.internals

Thread that subscribes to the given RecordPublisher.

ShardConsumer(KinesisDataFetcher<T>, RecordPublisher, Integer, StreamShardHandle, SequenceNumber, ShardConsumerMetricsReporter, KinesisDeserializationSchema<T>) - Constructor for class software.amazon.kinesis.connectors.flink.internals.ShardConsumer

Creates a shard consumer.

ShardConsumerMetricsReporter - Class in software.amazon.kinesis.connectors.flink.metrics

A container for ShardConsumers to report metric values.

ShardConsumerMetricsReporter(MetricGroup) - Constructor for class software.amazon.kinesis.connectors.flink.metrics.ShardConsumerMetricsReporter

SHARDID_PREFIX - Static variable in class software.amazon.kinesis.connectors.flink.model.DynamoDBStreamsShardHandle

SHARDID_PREFIX_LEN - Static variable in class software.amazon.kinesis.connectors.flink.model.DynamoDBStreamsShardHandle

shouldAdvanceLastDiscoveredShardId(String, String) - Method in class software.amazon.kinesis.connectors.flink.internals.DynamoDBStreamsDataFetcher

shouldAdvanceLastDiscoveredShardId(String, String) - Method in class software.amazon.kinesis.connectors.flink.internals.KinesisDataFetcher

Given lastSeenShardId, check if last discovered shardId should be advanced.

shutdownFetcher() - Method in class software.amazon.kinesis.connectors.flink.internals.KinesisDataFetcher

Starts shutting down the fetcher.

SINK_PARTITIONER - Static variable in class software.amazon.kinesis.connectors.flink.table.KinesisOptions

SINK_PARTITIONER_FIELD_DELIMITER - Static variable in class software.amazon.kinesis.connectors.flink.table.KinesisOptions

SINK_PARTITIONER_VALUE_FIXED - Static variable in class software.amazon.kinesis.connectors.flink.table.KinesisOptions

SINK_PARTITIONER_VALUE_RANDOM - Static variable in class software.amazon.kinesis.connectors.flink.table.KinesisOptions

sleep(long) - Method in class software.amazon.kinesis.connectors.flink.proxy.FullJitterBackoff

Puts the current thread to sleep for the specified number of millis.

SLEEP_TIME_MILLIS - Static variable in class software.amazon.kinesis.connectors.flink.metrics.KinesisConsumerMetricConstants

snapshotState(FunctionSnapshotContext) - Method in class software.amazon.kinesis.connectors.flink.FlinkKinesisConsumer

snapshotState(FunctionSnapshotContext) - Method in class software.amazon.kinesis.connectors.flink.FlinkKinesisProducer

snapshotState() - Method in class software.amazon.kinesis.connectors.flink.internals.KinesisDataFetcher

Creates a snapshot of the current last processed sequence numbers of each subscribed shard.

software.amazon.kinesis.connectors.flink - package software.amazon.kinesis.connectors.flink

software.amazon.kinesis.connectors.flink.config - package software.amazon.kinesis.connectors.flink.config

software.amazon.kinesis.connectors.flink.internals - package software.amazon.kinesis.connectors.flink.internals

software.amazon.kinesis.connectors.flink.internals.publisher - package software.amazon.kinesis.connectors.flink.internals.publisher

software.amazon.kinesis.connectors.flink.internals.publisher.fanout - package software.amazon.kinesis.connectors.flink.internals.publisher.fanout

software.amazon.kinesis.connectors.flink.internals.publisher.polling - package software.amazon.kinesis.connectors.flink.internals.publisher.polling

software.amazon.kinesis.connectors.flink.metrics - package software.amazon.kinesis.connectors.flink.metrics

software.amazon.kinesis.connectors.flink.model - package software.amazon.kinesis.connectors.flink.model

software.amazon.kinesis.connectors.flink.proxy - package software.amazon.kinesis.connectors.flink.proxy

software.amazon.kinesis.connectors.flink.serialization - package software.amazon.kinesis.connectors.flink.serialization

software.amazon.kinesis.connectors.flink.table - package software.amazon.kinesis.connectors.flink.table

software.amazon.kinesis.connectors.flink.util - package software.amazon.kinesis.connectors.flink.util

StartingPosition - Class in software.amazon.kinesis.connectors.flink.model

The position in which to start consuming from a stream.

stop() - Method in class software.amazon.kinesis.connectors.flink.util.RecordEmitter

stopWithError(Throwable) - Method in class software.amazon.kinesis.connectors.flink.internals.KinesisDataFetcher

Called by created threads to pass on errors.

STREAM - Static variable in class software.amazon.kinesis.connectors.flink.table.KinesisOptions

STREAM_DESCRIBE_BACKOFF_BASE - Static variable in class software.amazon.kinesis.connectors.flink.config.ConsumerConfigConstants

The base backoff time between each describeStream attempt (for consuming from DynamoDB streams).

STREAM_DESCRIBE_BACKOFF_EXPONENTIAL_CONSTANT - Static variable in class software.amazon.kinesis.connectors.flink.config.ConsumerConfigConstants

The power constant for exponential backoff between each describeStream attempt (for consuming from DynamoDB streams).

STREAM_DESCRIBE_BACKOFF_MAX - Static variable in class software.amazon.kinesis.connectors.flink.config.ConsumerConfigConstants

The maximum backoff time between each describeStream attempt (for consuming from DynamoDB streams).

STREAM_DESCRIBE_RETRIES - Static variable in class software.amazon.kinesis.connectors.flink.config.ConsumerConfigConstants

The maximum number of describeStream attempts if we get a recoverable exception.

STREAM_INITIAL_POSITION - Static variable in class software.amazon.kinesis.connectors.flink.config.ConsumerConfigConstants

The initial position to start reading Kinesis streams from (LATEST is used if not set).

STREAM_INITIAL_TIMESTAMP - Static variable in class software.amazon.kinesis.connectors.flink.config.ConsumerConfigConstants

The initial timestamp to start reading Kinesis stream from (when AT_TIMESTAMP is set for STREAM_INITIAL_POSITION).

STREAM_METRICS_GROUP - Static variable in class software.amazon.kinesis.connectors.flink.metrics.KinesisConsumerMetricConstants

STREAM_TIMESTAMP_DATE_FORMAT - Static variable in class software.amazon.kinesis.connectors.flink.config.ConsumerConfigConstants

The date format of initial timestamp to start reading Kinesis stream from (when AT_TIMESTAMP is set for STREAM_INITIAL_POSITION).

StreamConsumerRegistrar - Class in software.amazon.kinesis.connectors.flink.internals.publisher.fanout

Responsible for registering and deregistering EFO stream consumers.

StreamConsumerRegistrar(KinesisProxyV2Interface, FanOutRecordPublisherConfiguration, FullJitterBackoff) - Constructor for class software.amazon.kinesis.connectors.flink.internals.publisher.fanout.StreamConsumerRegistrar

StreamConsumerRegistrarUtil - Class in software.amazon.kinesis.connectors.flink.util

A utility class that creates instances of StreamConsumerRegistrar and handles batch operations.

StreamConsumerRegistrarUtil() - Constructor for class software.amazon.kinesis.connectors.flink.util.StreamConsumerRegistrarUtil

StreamConsumerRegistrarUtil.FlinkKinesisStreamConsumerRegistrarException - Exception in software.amazon.kinesis.connectors.flink.util

A semantic RuntimeException thrown to indicate errors de-/registering stream consumers.

StreamShardHandle - Class in software.amazon.kinesis.connectors.flink.model

A wrapper class around the information provided along with streamName and Shard, with some extra utility methods to determine whether or not a shard is closed and whether or not the shard is a result of parent shard splits or merges.

StreamShardHandle(String, Shard) - Constructor for class software.amazon.kinesis.connectors.flink.model.StreamShardHandle

Create a new StreamShardHandle.

StreamShardMetadata - Class in software.amazon.kinesis.connectors.flink.model

A serializable representation of a AWS Kinesis Stream shard.

StreamShardMetadata() - Constructor for class software.amazon.kinesis.connectors.flink.model.StreamShardMetadata

StreamShardMetadata.EquivalenceWrapper - Class in software.amazon.kinesis.connectors.flink.model

An equivalence wrapper that only checks for the stream name and shard id for equality.

SUBSCRIBE_TO_SHARD_BACKOFF_BASE - Static variable in class software.amazon.kinesis.connectors.flink.config.ConsumerConfigConstants

The base backoff time between each subscribeToShard attempt.

SUBSCRIBE_TO_SHARD_BACKOFF_EXPONENTIAL_CONSTANT - Static variable in class software.amazon.kinesis.connectors.flink.config.ConsumerConfigConstants

The power constant for exponential backoff between each subscribeToShard attempt.

SUBSCRIBE_TO_SHARD_BACKOFF_MAX - Static variable in class software.amazon.kinesis.connectors.flink.config.ConsumerConfigConstants

The maximum backoff time between each subscribeToShard attempt.

SUBSCRIBE_TO_SHARD_RETRIES - Static variable in class software.amazon.kinesis.connectors.flink.config.ConsumerConfigConstants

The maximum number of subscribeToShard attempts if we get a recoverable exception.

SUBSCRIBE_TO_SHARD_TIMEOUT_SECONDS - Static variable in class software.amazon.kinesis.connectors.flink.config.ConsumerConfigConstants

A timeout when waiting for a shard subscription to be established.

subscribeToShard(SubscribeToShardRequest, SubscribeToShardResponseHandler) - Method in class software.amazon.kinesis.connectors.flink.proxy.KinesisProxyV2

subscribeToShard(SubscribeToShardRequest, SubscribeToShardResponseHandler) - Method in interface software.amazon.kinesis.connectors.flink.proxy.KinesisProxyV2Interface

T

TABLE_LEVEL_OPTIONS - Static variable in class software.amazon.kinesis.connectors.flink.table.KinesisOptions

Options handled and validated by the table-level layer.

THREAD_POOL_SIZE - Static variable in class software.amazon.kinesis.connectors.flink.util.KinesisConfigUtil

The maximum number of threads that the native process' thread pool will be configured with.

THREADING_MODEL - Static variable in class software.amazon.kinesis.connectors.flink.util.KinesisConfigUtil

The threading model that KinesisProducer will use.

TimeoutLatch - Class in software.amazon.kinesis.connectors.flink.util

Internal use.

TimeoutLatch() - Constructor for class software.amazon.kinesis.connectors.flink.util.TimeoutLatch

toSentinelSequenceNumber() - Method in enum software.amazon.kinesis.connectors.flink.config.ConsumerConfigConstants.InitialPosition

toString() - Method in class software.amazon.kinesis.connectors.flink.model.KinesisStreamShard

Deprecated.

toString() - Method in class software.amazon.kinesis.connectors.flink.model.KinesisStreamShardState

toString() - Method in class software.amazon.kinesis.connectors.flink.model.SequenceNumber

toString() - Method in class software.amazon.kinesis.connectors.flink.model.StreamShardHandle

toString() - Method in class software.amazon.kinesis.connectors.flink.model.StreamShardMetadata

toString() - Method in class software.amazon.kinesis.connectors.flink.util.WatermarkTracker.WatermarkState

trigger() - Method in class software.amazon.kinesis.connectors.flink.util.TimeoutLatch

U

unregister() - Method in class software.amazon.kinesis.connectors.flink.metrics.ShardConsumerMetricsReporter

updateBuilder(DeserializationConfig, BeanDescription, BeanDeserializerBuilder) - Method in class software.amazon.kinesis.connectors.flink.util.BeanDeserializerModifierForIgnorables

updateProperties(DeserializationConfig, BeanDescription, List<BeanPropertyDefinition>) - Method in class software.amazon.kinesis.connectors.flink.util.BeanDeserializerModifierForIgnorables

updateState(int, SequenceNumber) - Method in class software.amazon.kinesis.connectors.flink.internals.KinesisDataFetcher

Update the shard to last processed sequence number state.

updateTimeoutCount - Variable in class software.amazon.kinesis.connectors.flink.util.JobManagerWatermarkTracker.WatermarkResult

updateWatermark(long) - Method in class software.amazon.kinesis.connectors.flink.util.JobManagerWatermarkTracker

updateWatermark(long) - Method in class software.amazon.kinesis.connectors.flink.util.WatermarkTracker

Set the current watermark of the owning subtask and return the global low watermark based on the current state snapshot.

V

validateAwsConfiguration(Properties) - Static method in class software.amazon.kinesis.connectors.flink.util.KinesisConfigUtil

Validate configuration properties related to Amazon AWS service.

validateConsumerConfiguration(Properties) - Static method in class software.amazon.kinesis.connectors.flink.util.KinesisConfigUtil

Validate configuration properties for FlinkKinesisConsumer.

validateConsumerConfiguration(Properties, List<String>) - Static method in class software.amazon.kinesis.connectors.flink.util.KinesisConfigUtil

Validate configuration properties for FlinkKinesisConsumer.

validateEfoConfiguration(Properties, List<String>) - Static method in class software.amazon.kinesis.connectors.flink.util.KinesisConfigUtil

Validate if the given config is a valid EFO configuration.

validateKinesisPartitioner(ReadableConfig, CatalogTable) - Static method in class software.amazon.kinesis.connectors.flink.table.KinesisDynamicTableFactory

validateRecordPublisherType(Properties) - Static method in class software.amazon.kinesis.connectors.flink.util.KinesisConfigUtil

Validate the record publisher type.

valueOf(String) - Static method in enum software.amazon.kinesis.connectors.flink.config.AWSConfigConstants.CredentialProvider

Returns the enum constant of this type with the specified name.

valueOf(String) - Static method in enum software.amazon.kinesis.connectors.flink.config.ConsumerConfigConstants.EFORegistrationType

Returns the enum constant of this type with the specified name.

valueOf(String) - Static method in enum software.amazon.kinesis.connectors.flink.config.ConsumerConfigConstants.InitialPosition

Returns the enum constant of this type with the specified name.

valueOf(String) - Static method in enum software.amazon.kinesis.connectors.flink.config.ConsumerConfigConstants.RecordPublisherType

Returns the enum constant of this type with the specified name.

valueOf(String) - Static method in enum software.amazon.kinesis.connectors.flink.internals.publisher.RecordPublisher.RecordPublisherRunResult

Returns the enum constant of this type with the specified name.

valueOf(String) - Static method in enum software.amazon.kinesis.connectors.flink.model.SentinelSequenceNumber

Returns the enum constant of this type with the specified name.

values() - Static method in enum software.amazon.kinesis.connectors.flink.config.AWSConfigConstants.CredentialProvider

Returns an array containing the constants of this enum type, in the order they are declared.

values() - Static method in enum software.amazon.kinesis.connectors.flink.config.ConsumerConfigConstants.EFORegistrationType

Returns an array containing the constants of this enum type, in the order they are declared.

values() - Static method in enum software.amazon.kinesis.connectors.flink.config.ConsumerConfigConstants.InitialPosition

Returns an array containing the constants of this enum type, in the order they are declared.

values() - Static method in enum software.amazon.kinesis.connectors.flink.config.ConsumerConfigConstants.RecordPublisherType

Returns an array containing the constants of this enum type, in the order they are declared.

values() - Static method in enum software.amazon.kinesis.connectors.flink.internals.publisher.RecordPublisher.RecordPublisherRunResult

Returns an array containing the constants of this enum type, in the order they are declared.

values() - Static method in enum software.amazon.kinesis.connectors.flink.model.SentinelSequenceNumber

Returns an array containing the constants of this enum type, in the order they are declared.

W

watermark - Variable in class software.amazon.kinesis.connectors.flink.util.JobManagerWatermarkTracker.WatermarkResult

watermark - Variable in class software.amazon.kinesis.connectors.flink.util.JobManagerWatermarkTracker.WatermarkUpdate

watermark - Variable in class software.amazon.kinesis.connectors.flink.util.WatermarkTracker.WatermarkState

WATERMARK_LOOKAHEAD_MILLIS - Static variable in class software.amazon.kinesis.connectors.flink.config.ConsumerConfigConstants

The maximum delta allowed for the reader to advance ahead of the shared global watermark.

WATERMARK_SYNC_MILLIS - Static variable in class software.amazon.kinesis.connectors.flink.config.ConsumerConfigConstants

The interval for periodically synchronizing the shared watermark state.

WATERMARK_SYNC_QUEUE_CAPACITY - Static variable in class software.amazon.kinesis.connectors.flink.config.ConsumerConfigConstants

The maximum number of records that will be buffered before suspending consumption of a shard.

WatermarkResult() - Constructor for class software.amazon.kinesis.connectors.flink.util.JobManagerWatermarkTracker.WatermarkResult

WatermarkState() - Constructor for class software.amazon.kinesis.connectors.flink.util.WatermarkTracker.WatermarkState

WatermarkTracker - Class in software.amazon.kinesis.connectors.flink.util

The watermark tracker is responsible for aggregating watermarks across distributed operators.

WatermarkTracker() - Constructor for class software.amazon.kinesis.connectors.flink.util.WatermarkTracker

WatermarkTracker.WatermarkState - Class in software.amazon.kinesis.connectors.flink.util

Watermark state.

WatermarkUpdate() - Constructor for class software.amazon.kinesis.connectors.flink.util.JobManagerWatermarkTracker.WatermarkUpdate

webIdentityTokenFile(String) - Static method in class software.amazon.kinesis.connectors.flink.config.AWSConfigConstants

A B C D E F G H I J K L M N O P R S T U V W