Uses of Class
org.apache.flink.connector.file.src.FileSourceSplit
-
-
Uses of FileSourceSplit in org.apache.flink.connector.file.src
Classes in org.apache.flink.connector.file.src with type parameters of type FileSourceSplit Modifier and Type Class Description classAbstractFileSource<T,SplitT extends FileSourceSplit>The base class for File Sources.protected static classAbstractFileSource.AbstractFileSourceBuilder<T,SplitT extends FileSourceSplit,SELF extends AbstractFileSource.AbstractFileSourceBuilder<T,SplitT,SELF>>The generic base builder.classFileSourceSplitState<SplitT extends FileSourceSplit>State of the reader, essentially a mutable version of theFileSourceSplit.classPendingSplitsCheckpoint<SplitT extends FileSourceSplit>A checkpoint of the current state of the containing the currently pending splits that are not yet assigned.classPendingSplitsCheckpointSerializer<T extends FileSourceSplit>A serializer for thePendingSplitsCheckpoint.Methods in org.apache.flink.connector.file.src with type parameters of type FileSourceSplit Modifier and Type Method Description static <T extends FileSourceSplit>
PendingSplitsCheckpoint<T>PendingSplitsCheckpoint. fromCollectionSnapshot(Collection<T> splits)static <T extends FileSourceSplit>
PendingSplitsCheckpoint<T>PendingSplitsCheckpoint. fromCollectionSnapshot(Collection<T> splits, Collection<org.apache.flink.core.fs.Path> alreadyProcessedPaths)Methods in org.apache.flink.connector.file.src that return FileSourceSplit Modifier and Type Method Description FileSourceSplitFileSourceSplitSerializer. deserialize(int version, byte[] serialized)FileSourceSplitFileSourceSplit. updateWithCheckpointedPosition(CheckpointedPosition position)Creates a copy of this split where the checkpointed position is replaced by the given new position.Methods in org.apache.flink.connector.file.src that return types with arguments of type FileSourceSplit Modifier and Type Method Description org.apache.flink.core.io.SimpleVersionedSerializer<FileSourceSplit>FileSource. getSplitSerializer()Methods in org.apache.flink.connector.file.src with parameters of type FileSourceSplit Modifier and Type Method Description byte[]FileSourceSplitSerializer. serialize(FileSourceSplit split)Method parameters in org.apache.flink.connector.file.src with type arguments of type FileSourceSplit Modifier and Type Method Description static <T> FileSource.FileSourceBuilder<T>FileSource. forBulkFileFormat(BulkFormat<T,FileSourceSplit> bulkFormat, org.apache.flink.core.fs.Path... paths)Builds a newFileSourceusing aBulkFormatto read batches of records from files. -
Uses of FileSourceSplit in org.apache.flink.connector.file.src.assigners
Methods in org.apache.flink.connector.file.src.assigners that return types with arguments of type FileSourceSplit Modifier and Type Method Description Optional<FileSourceSplit>FileSplitAssigner. getNext(String hostname)Gets the next split.Optional<FileSourceSplit>LocalityAwareSplitAssigner. getNext(String host)Optional<FileSourceSplit>SimpleSplitAssigner. getNext(String hostname)Collection<FileSourceSplit>FileSplitAssigner. remainingSplits()Gets the remaining splits that this assigner has pending.Collection<FileSourceSplit>LocalityAwareSplitAssigner. remainingSplits()Collection<FileSourceSplit>SimpleSplitAssigner. remainingSplits()Method parameters in org.apache.flink.connector.file.src.assigners with type arguments of type FileSourceSplit Modifier and Type Method Description voidFileSplitAssigner. addSplits(Collection<FileSourceSplit> splits)Adds a set of splits to this assigner.voidLocalityAwareSplitAssigner. addSplits(Collection<FileSourceSplit> splits)voidSimpleSplitAssigner. addSplits(Collection<FileSourceSplit> newSplits)FileSplitAssignerFileSplitAssigner.Provider. create(Collection<FileSourceSplit> initialSplits)Creates a newFileSplitAssignerthat starts with the given set of initial splits.Constructor parameters in org.apache.flink.connector.file.src.assigners with type arguments of type FileSourceSplit Constructor Description LocalityAwareSplitAssigner(Collection<FileSourceSplit> splits)SimpleSplitAssigner(Collection<FileSourceSplit> splits) -
Uses of FileSourceSplit in org.apache.flink.connector.file.src.enumerate
Methods in org.apache.flink.connector.file.src.enumerate that return types with arguments of type FileSourceSplit Modifier and Type Method Description Collection<FileSourceSplit>FileEnumerator. enumerateSplits(org.apache.flink.core.fs.Path[] paths, int minDesiredSplits)Generates all file splits for the relevant files under the given paths.Collection<FileSourceSplit>NonSplittingRecursiveEnumerator. enumerateSplits(org.apache.flink.core.fs.Path[] paths, int minDesiredSplits)Method parameters in org.apache.flink.connector.file.src.enumerate with type arguments of type FileSourceSplit Modifier and Type Method Description protected voidBlockSplittingRecursiveAllDirEnumerator. addSplitsForPath(org.apache.flink.core.fs.FileStatus fileStatus, org.apache.flink.core.fs.FileSystem fs, ArrayList<FileSourceSplit> target)protected voidNonSplittingRecursiveAllDirEnumerator. addSplitsForPath(org.apache.flink.core.fs.FileStatus fileStatus, org.apache.flink.core.fs.FileSystem fs, ArrayList<FileSourceSplit> target)protected voidNonSplittingRecursiveEnumerator. addSplitsForPath(org.apache.flink.core.fs.FileStatus fileStatus, org.apache.flink.core.fs.FileSystem fs, ArrayList<FileSourceSplit> target)protected voidBlockSplittingRecursiveEnumerator. convertToSourceSplits(org.apache.flink.core.fs.FileStatus file, org.apache.flink.core.fs.FileSystem fs, List<FileSourceSplit> target)protected voidNonSplittingRecursiveEnumerator. convertToSourceSplits(org.apache.flink.core.fs.FileStatus file, org.apache.flink.core.fs.FileSystem fs, List<FileSourceSplit> target) -
Uses of FileSourceSplit in org.apache.flink.connector.file.src.impl
Classes in org.apache.flink.connector.file.src.impl with type parameters of type FileSourceSplit Modifier and Type Class Description classDynamicFileSplitEnumerator<SplitT extends FileSourceSplit>A SplitEnumerator implementation that supports dynamic filtering.classFileSourceReader<T,SplitT extends FileSourceSplit>ASourceReaderthat read records fromFileSourceSplit.Methods in org.apache.flink.connector.file.src.impl that return types with arguments of type FileSourceSplit Modifier and Type Method Description PendingSplitsCheckpoint<FileSourceSplit>ContinuousFileSplitEnumerator. snapshotState(long checkpointId)PendingSplitsCheckpoint<FileSourceSplit>StaticFileSplitEnumerator. snapshotState(long checkpointId)Methods in org.apache.flink.connector.file.src.impl with parameters of type FileSourceSplit Modifier and Type Method Description BulkFormat.Reader<T>StreamFormatAdapter. createReader(org.apache.flink.configuration.Configuration config, FileSourceSplit split)BulkFormat.Reader<T>StreamFormatAdapter. restoreReader(org.apache.flink.configuration.Configuration config, FileSourceSplit split)Method parameters in org.apache.flink.connector.file.src.impl with type arguments of type FileSourceSplit Modifier and Type Method Description voidContinuousFileSplitEnumerator. addSplitsBack(List<FileSourceSplit> splits, int subtaskId)voidStaticFileSplitEnumerator. addSplitsBack(List<FileSourceSplit> splits, int subtaskId)Constructor parameters in org.apache.flink.connector.file.src.impl with type arguments of type FileSourceSplit Constructor Description ContinuousFileSplitEnumerator(org.apache.flink.api.connector.source.SplitEnumeratorContext<FileSourceSplit> context, FileEnumerator enumerator, FileSplitAssigner splitAssigner, org.apache.flink.core.fs.Path[] paths, Collection<org.apache.flink.core.fs.Path> alreadyDiscoveredPaths, long discoveryInterval)StaticFileSplitEnumerator(org.apache.flink.api.connector.source.SplitEnumeratorContext<FileSourceSplit> context, FileSplitAssigner splitAssigner) -
Uses of FileSourceSplit in org.apache.flink.connector.file.src.reader
Classes in org.apache.flink.connector.file.src.reader with type parameters of type FileSourceSplit Modifier and Type Interface Description interfaceBulkFormat<T,SplitT extends FileSourceSplit>TheBulkFormatreads and decodes batches of records at a time. -
Uses of FileSourceSplit in org.apache.flink.connector.file.table
Classes in org.apache.flink.connector.file.table with type parameters of type FileSourceSplit Modifier and Type Class Description classLimitableBulkFormat<T,SplitT extends FileSourceSplit>ABulkFormatthat can limit output record number.interfacePartitionFieldExtractor<T extends FileSourceSplit>Interface to extract partition field from split.Methods in org.apache.flink.connector.file.table with type parameters of type FileSourceSplit Modifier and Type Method Description static <T,SplitT extends FileSourceSplit>
BulkFormat<T,SplitT>LimitableBulkFormat. create(BulkFormat<T,SplitT> format, Long limit)Methods in org.apache.flink.connector.file.table that return types with arguments of type FileSourceSplit Modifier and Type Method Description static PartitionFieldExtractor<FileSourceSplit>PartitionFieldExtractor. forFileSystem(String defaultPartValue)Methods in org.apache.flink.connector.file.table with parameters of type FileSourceSplit Modifier and Type Method Description org.apache.flink.connector.file.table.DeserializationSchemaAdapter.ReaderDeserializationSchemaAdapter. createReader(org.apache.flink.configuration.Configuration config, FileSourceSplit split)org.apache.flink.connector.file.table.DeserializationSchemaAdapter.ReaderDeserializationSchemaAdapter. restoreReader(org.apache.flink.configuration.Configuration config, FileSourceSplit split)Constructor parameters in org.apache.flink.connector.file.table with type arguments of type FileSourceSplit Constructor Description FileSystemTableSource(org.apache.flink.table.catalog.ObjectIdentifier tableIdentifier, org.apache.flink.table.types.DataType physicalRowDataType, List<String> partitionKeys, org.apache.flink.configuration.ReadableConfig tableOptions, org.apache.flink.table.connector.format.DecodingFormat<BulkFormat<org.apache.flink.table.data.RowData,FileSourceSplit>> bulkReaderFormat, org.apache.flink.table.connector.format.DecodingFormat<org.apache.flink.api.common.serialization.DeserializationSchema<org.apache.flink.table.data.RowData>> deserializationFormat) -
Uses of FileSourceSplit in org.apache.flink.connector.file.table.stream.compact
Method parameters in org.apache.flink.connector.file.table.stream.compact with type arguments of type FileSourceSplit Modifier and Type Method Description static <T> CompactReader.Factory<T>CompactBulkReader. factory(BulkFormat<T,FileSourceSplit> format)
-