- RateLimitingStrategy - Interface in org.apache.flink.connector.base.sink.writer.strategy
-
RateLimitingStrategy is used to control the rate of requests.
- RecordEmitter<E,T,SplitStateT> - Interface in org.apache.flink.connector.base.source.reader
-
Emit a record to the downstream.
- recordEmitter - Variable in class org.apache.flink.connector.base.source.reader.SourceReaderBase
-
The record emitter to handle the records read by the SplitReaders.
- RecordEvaluator<T> - Interface in org.apache.flink.connector.base.source.reader
-
An interface that evaluates whether a de-serialized record should trigger certain control-flow
operations (e.g. end of stream).
- RecordsBySplits<E> - Class in org.apache.flink.connector.base.source.reader
-
An implementation of RecordsWithSplitIds to host all the records by splits.
- RecordsBySplits(Map<String, Collection<E>>, Set<String>) - Constructor for class org.apache.flink.connector.base.source.reader.RecordsBySplits
-
- RecordsBySplits.Builder<E> - Class in org.apache.flink.connector.base.source.reader
-
A utility builder to collect records in individual calls, rather than put a finished
collection in the
RecordsBySplits(Map, Set) constructor.
- RecordsWithSplitIds<E> - Interface in org.apache.flink.connector.base.source.reader
-
An interface for the elements passed from the fetchers to the source reader.
- recycle() - Method in interface org.apache.flink.connector.base.source.reader.RecordsWithSplitIds
-
This method is called when all records from this batch have been emitted.
- registerCompletedRequest(ResultInfo) - Method in class org.apache.flink.connector.base.sink.writer.strategy.CongestionControlRateLimitingStrategy
-
- registerCompletedRequest(ResultInfo) - Method in interface org.apache.flink.connector.base.sink.writer.strategy.RateLimitingStrategy
-
Registers the result of completed requests (e.g. to track the current inFlightMessages /
requests).
- registerInFlightRequest(RequestInfo) - Method in class org.apache.flink.connector.base.sink.writer.strategy.CongestionControlRateLimitingStrategy
-
- registerInFlightRequest(RequestInfo) - Method in interface org.apache.flink.connector.base.sink.writer.strategy.RateLimitingStrategy
-
Registers the information of requests being sent (e.g. to track the current inFlightMessages
/ requests).
- remainingCapacity() - Method in class org.apache.flink.connector.base.source.reader.synchronization.FutureCompletingBlockingQueue
-
Checks the remaining capacity in the queue.
- removeSplits(List<SplitT>) - Method in class org.apache.flink.connector.base.source.reader.fetcher.SingleThreadFetcherManager
-
- removeSplits(List<SplitT>) - Method in class org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher
-
Notice the split fetcher that some splits finished.
- removeSplits(List<SplitT>) - Method in class org.apache.flink.connector.base.source.reader.fetcher.SplitFetcherManager
-
- RemoveSplitsTask<SplitT extends org.apache.flink.api.connector.source.SourceSplit> - Class in org.apache.flink.connector.base.source.reader.fetcher
-
The task to finish reading some splits.
- RequestEntryWrapper<RequestEntryT> - Class in org.apache.flink.connector.base.sink.writer
-
A wrapper that contains a RequestEntryT ready to be written by the Sink Writer class,
along with the size of that entry as defined by the method getSizeInBytes(RequestEntryT)
of the AsyncSinkWriter.
- RequestEntryWrapper(RequestEntryT, long) - Constructor for class org.apache.flink.connector.base.sink.writer.RequestEntryWrapper
-
- RequestInfo - Interface in org.apache.flink.connector.base.sink.writer.strategy
-
Interface for dataclass used to encapsulate information about starting requests.
- restoreEnumerator(SplitEnumeratorContext<HybridSourceSplit>, HybridSourceEnumeratorState) - Method in class org.apache.flink.connector.base.source.hybrid.HybridSource
-
- ResultInfo - Interface in org.apache.flink.connector.base.sink.writer.strategy
-
Interface for dataclass used to encapsulate results from completed requests.
- resume() - Method in class org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher
-
- run() - Method in class org.apache.flink.connector.base.source.reader.fetcher.RemoveSplitsTask
-
- run() - Method in class org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher
-
- run() - Method in interface org.apache.flink.connector.base.source.reader.fetcher.SplitFetcherTask
-
Run the logic.
- scaleDown(Integer) - Method in class org.apache.flink.connector.base.sink.writer.strategy.AIMDScalingStrategy
-
- scaleDown(T) - Method in class org.apache.flink.connector.base.sink.writer.strategy.NoOpScalingStrategy
-
- scaleDown(T) - Method in interface org.apache.flink.connector.base.sink.writer.strategy.ScalingStrategy
-
Returns the scaled down value.
- scaleUp(Integer) - Method in class org.apache.flink.connector.base.sink.writer.strategy.AIMDScalingStrategy
-
- scaleUp(T) - Method in class org.apache.flink.connector.base.sink.writer.strategy.NoOpScalingStrategy
-
- scaleUp(T) - Method in interface org.apache.flink.connector.base.sink.writer.strategy.ScalingStrategy
-
Returns the scaled up value.
- ScalingStrategy<T> - Interface in org.apache.flink.connector.base.sink.writer.strategy
-
ScalingStrategy provides an interface to control scale up / down behaviour.
- SerdeUtils - Class in org.apache.flink.connector.base.source.utils
-
A util class with some helper method for serde in the sources.
- serialize(BufferedRequestState<RequestEntryT>) - Method in class org.apache.flink.connector.base.sink.writer.AsyncSinkWriterStateSerializer
-
Serializes state in form of
[DATA_IDENTIFIER,NUM_OF_ELEMENTS,SIZE1,REQUEST1,SIZE2,REQUEST2....].
- serialize(HybridSourceEnumeratorState) - Method in class org.apache.flink.connector.base.source.hybrid.HybridSourceEnumeratorStateSerializer
-
- serialize(HybridSourceSplit) - Method in class org.apache.flink.connector.base.source.hybrid.HybridSourceSplitSerializer
-
- serializeRequestToStream(RequestEntryT, DataOutputStream) - Method in class org.apache.flink.connector.base.sink.writer.AsyncSinkWriterStateSerializer
-
- serializeSplitAssignments(Map<Integer, C>, SimpleVersionedSerializer<SplitT>) - Static method in class org.apache.flink.connector.base.source.utils.SerdeUtils
-
Serialize a mapping from subtask ids to lists of assigned splits.
- setDecreaseFactor(double) - Method in class org.apache.flink.connector.base.sink.writer.strategy.AIMDScalingStrategy.AIMDScalingStrategyBuilder
-
- setIncreaseRate(int) - Method in class org.apache.flink.connector.base.sink.writer.strategy.AIMDScalingStrategy.AIMDScalingStrategyBuilder
-
- setInitialMaxInFlightMessages(int) - Method in class org.apache.flink.connector.base.sink.writer.strategy.CongestionControlRateLimitingStrategy.CongestionControlRateLimitingStrategyBuilder
-
- setMaxBatchSize(int) - Method in class org.apache.flink.connector.base.sink.AsyncSinkBaseBuilder
-
- setMaxBatchSize(int) - Method in class org.apache.flink.connector.base.sink.writer.config.AsyncSinkWriterConfiguration.AsyncSinkWriterConfigurationBuilder
-
- setMaxBatchSize(int) - Method in interface org.apache.flink.connector.base.sink.writer.config.AsyncSinkWriterConfiguration.ConfigurationMaxBatchSize
-
- setMaxBatchSize(int) - Method in class org.apache.flink.connector.base.table.sink.AsyncDynamicTableSinkBuilder
-
- setMaxBatchSizeInBytes(long) - Method in class org.apache.flink.connector.base.sink.AsyncSinkBaseBuilder
-
- setMaxBatchSizeInBytes(long) - Method in class org.apache.flink.connector.base.sink.writer.config.AsyncSinkWriterConfiguration.AsyncSinkWriterConfigurationBuilder
-
- setMaxBatchSizeInBytes(long) - Method in interface org.apache.flink.connector.base.sink.writer.config.AsyncSinkWriterConfiguration.ConfigurationMaxBatchSizeInBytes
-
- setMaxBufferedRequests(int) - Method in class org.apache.flink.connector.base.sink.AsyncSinkBaseBuilder
-
- setMaxBufferedRequests(int) - Method in class org.apache.flink.connector.base.sink.writer.config.AsyncSinkWriterConfiguration.AsyncSinkWriterConfigurationBuilder
-
- setMaxBufferedRequests(int) - Method in interface org.apache.flink.connector.base.sink.writer.config.AsyncSinkWriterConfiguration.ConfigurationMaxBufferedRequests
-
- setMaxBufferedRequests(int) - Method in class org.apache.flink.connector.base.table.sink.AsyncDynamicTableSinkBuilder
-
- setMaxBufferSizeInBytes(long) - Method in class org.apache.flink.connector.base.table.sink.AsyncDynamicTableSinkBuilder
-
- setMaxInFlightRequests(int) - Method in class org.apache.flink.connector.base.sink.AsyncSinkBaseBuilder
-
- setMaxInFlightRequests(int) - Method in class org.apache.flink.connector.base.sink.writer.config.AsyncSinkWriterConfiguration.AsyncSinkWriterConfigurationBuilder
-
- setMaxInFlightRequests(int) - Method in interface org.apache.flink.connector.base.sink.writer.config.AsyncSinkWriterConfiguration.ConfigurationMaxInFlightRequests
-
- setMaxInFlightRequests(int) - Method in class org.apache.flink.connector.base.sink.writer.strategy.CongestionControlRateLimitingStrategy.CongestionControlRateLimitingStrategyBuilder
-
- setMaxInFlightRequests(int) - Method in class org.apache.flink.connector.base.table.sink.AsyncDynamicTableSinkBuilder
-
- setMaxRecordSizeInBytes(long) - Method in class org.apache.flink.connector.base.sink.AsyncSinkBaseBuilder
-
- setMaxRecordSizeInBytes(long) - Method in class org.apache.flink.connector.base.sink.writer.config.AsyncSinkWriterConfiguration.AsyncSinkWriterConfigurationBuilder
-
- setMaxRecordSizeInBytes(long) - Method in interface org.apache.flink.connector.base.sink.writer.config.AsyncSinkWriterConfiguration.ConfigurationMaxRecordSizeInBytes
-
- setMaxTimeInBufferMS(long) - Method in class org.apache.flink.connector.base.sink.AsyncSinkBaseBuilder
-
- setMaxTimeInBufferMS(long) - Method in class org.apache.flink.connector.base.sink.writer.config.AsyncSinkWriterConfiguration.AsyncSinkWriterConfigurationBuilder
-
- setMaxTimeInBufferMS(long) - Method in interface org.apache.flink.connector.base.sink.writer.config.AsyncSinkWriterConfiguration.ConfigurationMaxTimeInBufferMS
-
- setMaxTimeInBufferMS(long) - Method in class org.apache.flink.connector.base.table.sink.AsyncDynamicTableSinkBuilder
-
- setRateLimitingStrategy(RateLimitingStrategy) - Method in class org.apache.flink.connector.base.sink.writer.config.AsyncSinkWriterConfiguration.AsyncSinkWriterConfigurationBuilder
-
- setScalingStrategy(ScalingStrategy<Integer>) - Method in class org.apache.flink.connector.base.sink.writer.strategy.CongestionControlRateLimitingStrategy.CongestionControlRateLimitingStrategyBuilder
-
- shouldBlock(RequestInfo) - Method in class org.apache.flink.connector.base.sink.writer.strategy.CongestionControlRateLimitingStrategy
-
- shouldBlock(RequestInfo) - Method in interface org.apache.flink.connector.base.sink.writer.strategy.RateLimitingStrategy
-
Decides whether the next request should be blocked.
- shutdown() - Method in class org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher
-
Shutdown the split fetcher.
- SingleThreadFetcherManager<E,SplitT extends org.apache.flink.api.connector.source.SourceSplit> - Class in org.apache.flink.connector.base.source.reader.fetcher
-
A Fetcher Manager with a single fetching thread (I/O thread) that handles all splits
concurrently.
- SingleThreadFetcherManager(FutureCompletingBlockingQueue<RecordsWithSplitIds<E>>, Supplier<SplitReader<E, SplitT>>) - Constructor for class org.apache.flink.connector.base.source.reader.fetcher.SingleThreadFetcherManager
-
- SingleThreadFetcherManager(FutureCompletingBlockingQueue<RecordsWithSplitIds<E>>, Supplier<SplitReader<E, SplitT>>, Configuration) - Constructor for class org.apache.flink.connector.base.source.reader.fetcher.SingleThreadFetcherManager
-
- SingleThreadFetcherManager(FutureCompletingBlockingQueue<RecordsWithSplitIds<E>>, Supplier<SplitReader<E, SplitT>>, Configuration, Consumer<Collection<String>>) - Constructor for class org.apache.flink.connector.base.source.reader.fetcher.SingleThreadFetcherManager
-
- SingleThreadFetcherManager(Supplier<SplitReader<E, SplitT>>) - Constructor for class org.apache.flink.connector.base.source.reader.fetcher.SingleThreadFetcherManager
-
Creates a new SplitFetcherManager with a single I/O threads.
- SingleThreadFetcherManager(Supplier<SplitReader<E, SplitT>>, Configuration) - Constructor for class org.apache.flink.connector.base.source.reader.fetcher.SingleThreadFetcherManager
-
Creates a new SplitFetcherManager with a single I/O threads.
- SingleThreadFetcherManager(Supplier<SplitReader<E, SplitT>>, Configuration, Consumer<Collection<String>>) - Constructor for class org.apache.flink.connector.base.source.reader.fetcher.SingleThreadFetcherManager
-
Creates a new SplitFetcherManager with a single I/O threads.
- SingleThreadMultiplexSourceReaderBase<E,T,SplitT extends org.apache.flink.api.connector.source.SourceSplit,SplitStateT> - Class in org.apache.flink.connector.base.source.reader
-
A base for
SourceReaders that read splits with one thread using one
SplitReader.
- SingleThreadMultiplexSourceReaderBase(Supplier<SplitReader<E, SplitT>>, RecordEmitter<E, T, SplitStateT>, Configuration, SourceReaderContext) - Constructor for class org.apache.flink.connector.base.source.reader.SingleThreadMultiplexSourceReaderBase
-
The primary constructor for the source reader.
- SingleThreadMultiplexSourceReaderBase(FutureCompletingBlockingQueue<RecordsWithSplitIds<E>>, Supplier<SplitReader<E, SplitT>>, RecordEmitter<E, T, SplitStateT>, Configuration, SourceReaderContext) - Constructor for class org.apache.flink.connector.base.source.reader.SingleThreadMultiplexSourceReaderBase
-
- SingleThreadMultiplexSourceReaderBase(FutureCompletingBlockingQueue<RecordsWithSplitIds<E>>, SingleThreadFetcherManager<E, SplitT>, RecordEmitter<E, T, SplitStateT>, Configuration, SourceReaderContext) - Constructor for class org.apache.flink.connector.base.source.reader.SingleThreadMultiplexSourceReaderBase
-
- SingleThreadMultiplexSourceReaderBase(FutureCompletingBlockingQueue<RecordsWithSplitIds<E>>, SingleThreadFetcherManager<E, SplitT>, RecordEmitter<E, T, SplitStateT>, RecordEvaluator<T>, Configuration, SourceReaderContext) - Constructor for class org.apache.flink.connector.base.source.reader.SingleThreadMultiplexSourceReaderBase
-
- SingleThreadMultiplexSourceReaderBase(SingleThreadFetcherManager<E, SplitT>, RecordEmitter<E, T, SplitStateT>, Configuration, SourceReaderContext) - Constructor for class org.apache.flink.connector.base.source.reader.SingleThreadMultiplexSourceReaderBase
-
- SingleThreadMultiplexSourceReaderBase(SingleThreadFetcherManager<E, SplitT>, RecordEmitter<E, T, SplitStateT>, RecordEvaluator<T>, Configuration, SourceReaderContext) - Constructor for class org.apache.flink.connector.base.source.reader.SingleThreadMultiplexSourceReaderBase
-
- size() - Method in class org.apache.flink.connector.base.source.reader.synchronization.FutureCompletingBlockingQueue
-
Gets the size of the queue.
- snapshotState(long) - Method in class org.apache.flink.connector.base.sink.writer.AsyncSinkWriter
-
All in-flight requests that are relevant for the snapshot have been completed, but there may
still be request entries in the internal buffers that are yet to be sent to the endpoint.
- snapshotState(long) - Method in class org.apache.flink.connector.base.source.hybrid.HybridSourceReader
-
- snapshotState(long) - Method in class org.apache.flink.connector.base.source.hybrid.HybridSourceSplitEnumerator
-
- snapshotState(long) - Method in class org.apache.flink.connector.base.source.reader.SourceReaderBase
-
- source() - Method in class org.apache.flink.connector.base.source.hybrid.SwitchSourceEvent
-
- SOURCE_READER_CLOSE_TIMEOUT - Static variable in class org.apache.flink.connector.base.source.reader.SourceReaderOptions
-
- sourceIndex() - Method in class org.apache.flink.connector.base.source.hybrid.HybridSourceSplit
-
- sourceIndex() - Method in class org.apache.flink.connector.base.source.hybrid.SourceReaderFinishedEvent
-
- sourceIndex() - Method in class org.apache.flink.connector.base.source.hybrid.SwitchSourceEvent
-
- SourceReaderBase<E,T,SplitT extends org.apache.flink.api.connector.source.SourceSplit,SplitStateT> - Class in org.apache.flink.connector.base.source.reader
-
An abstract implementation of SourceReader which provides some synchronization between
the mail box main thread and the SourceReader internal threads.
- SourceReaderBase(FutureCompletingBlockingQueue<RecordsWithSplitIds<E>>, SplitFetcherManager<E, SplitT>, RecordEmitter<E, T, SplitStateT>, Configuration, SourceReaderContext) - Constructor for class org.apache.flink.connector.base.source.reader.SourceReaderBase
-
- SourceReaderBase(FutureCompletingBlockingQueue<RecordsWithSplitIds<E>>, SplitFetcherManager<E, SplitT>, RecordEmitter<E, T, SplitStateT>, RecordEvaluator<T>, Configuration, SourceReaderContext) - Constructor for class org.apache.flink.connector.base.source.reader.SourceReaderBase
-
- SourceReaderBase(SplitFetcherManager<E, SplitT>, RecordEmitter<E, T, SplitStateT>, Configuration, SourceReaderContext) - Constructor for class org.apache.flink.connector.base.source.reader.SourceReaderBase
-
The primary constructor for the source reader.
- SourceReaderBase(SplitFetcherManager<E, SplitT>, RecordEmitter<E, T, SplitStateT>, RecordEvaluator<T>, Configuration, SourceReaderContext) - Constructor for class org.apache.flink.connector.base.source.reader.SourceReaderBase
-
- sourceReaderCloseTimeout - Variable in class org.apache.flink.connector.base.source.reader.SourceReaderOptions
-
- SourceReaderFinishedEvent - Class in org.apache.flink.connector.base.source.hybrid
-
A source event sent from the HybridSourceReader to the enumerator to indicate that the current
reader has finished and splits for the next reader can be sent.
- SourceReaderFinishedEvent(int) - Constructor for class org.apache.flink.connector.base.source.hybrid.SourceReaderFinishedEvent
-
Constructor.
- SourceReaderOptions - Class in org.apache.flink.connector.base.source.reader
-
- SourceReaderOptions(Configuration) - Constructor for class org.apache.flink.connector.base.source.reader.SourceReaderOptions
-
- SplitFetcher<E,SplitT extends org.apache.flink.api.connector.source.SourceSplit> - Class in org.apache.flink.connector.base.source.reader.fetcher
-
The internal fetcher runnable responsible for polling message from the external system.
- SplitFetcherManager<E,SplitT extends org.apache.flink.api.connector.source.SourceSplit> - Class in org.apache.flink.connector.base.source.reader.fetcher
-
A class responsible for starting the
SplitFetcher and manage the life cycles of them.
- SplitFetcherManager(FutureCompletingBlockingQueue<RecordsWithSplitIds<E>>, Supplier<SplitReader<E, SplitT>>, Configuration) - Constructor for class org.apache.flink.connector.base.source.reader.fetcher.SplitFetcherManager
-
- SplitFetcherManager(FutureCompletingBlockingQueue<RecordsWithSplitIds<E>>, Supplier<SplitReader<E, SplitT>>, Configuration, Consumer<Collection<String>>) - Constructor for class org.apache.flink.connector.base.source.reader.fetcher.SplitFetcherManager
-
- SplitFetcherManager(Supplier<SplitReader<E, SplitT>>, Configuration) - Constructor for class org.apache.flink.connector.base.source.reader.fetcher.SplitFetcherManager
-
Create a split fetcher manager.
- SplitFetcherManager(Supplier<SplitReader<E, SplitT>>, Configuration, Consumer<Collection<String>>) - Constructor for class org.apache.flink.connector.base.source.reader.fetcher.SplitFetcherManager
-
Create a split fetcher manager.
- splitFetcherManager - Variable in class org.apache.flink.connector.base.source.reader.SourceReaderBase
-
The split fetcher manager to run split fetchers.
- SplitFetcherTask - Interface in org.apache.flink.connector.base.source.reader.fetcher
-
An interface similar to
Runnable but allows throwing exceptions and wakeup.
- splitId() - Method in class org.apache.flink.connector.base.source.hybrid.HybridSourceSplit
-
- SplitReader<E,SplitT extends org.apache.flink.api.connector.source.SourceSplit> - Interface in org.apache.flink.connector.base.source.reader.splitreader
-
An interface used to read from splits.
- splits() - Method in class org.apache.flink.connector.base.source.reader.splitreader.SplitsChange
-
- SplitsAddition<SplitT> - Class in org.apache.flink.connector.base.source.reader.splitreader
-
A change to add splits.
- SplitsAddition(List<SplitT>) - Constructor for class org.apache.flink.connector.base.source.reader.splitreader.SplitsAddition
-
- SplitsChange<SplitT> - Class in org.apache.flink.connector.base.source.reader.splitreader
-
An abstract class to host splits change.
- SplitsRemoval<SplitT> - Class in org.apache.flink.connector.base.source.reader.splitreader
-
A change to remove splits.
- SplitsRemoval(List<SplitT>) - Constructor for class org.apache.flink.connector.base.source.reader.splitreader.SplitsRemoval
-
- start() - Method in class org.apache.flink.connector.base.source.hybrid.HybridSourceReader
-
- start() - Method in class org.apache.flink.connector.base.source.hybrid.HybridSourceSplitEnumerator
-
- start() - Method in class org.apache.flink.connector.base.source.reader.SourceReaderBase
-
- startFetcher(SplitFetcher<E, SplitT>) - Method in class org.apache.flink.connector.base.source.reader.fetcher.SplitFetcherManager
-
- submitRequestEntries(List<RequestEntryT>, Consumer<List<RequestEntryT>>) - Method in class org.apache.flink.connector.base.sink.writer.AsyncSinkWriter
-
This method specifies how to persist buffered request entries into the destination.
- SwitchSourceEvent - Class in org.apache.flink.connector.base.source.hybrid
-
- SwitchSourceEvent(int, Source, boolean) - Constructor for class org.apache.flink.connector.base.source.hybrid.SwitchSourceEvent
-
Constructor.