org.apache.flink.connector.file.src.enumerate

接口 FileEnumerator

所有已知实现类:

BlockSplittingRecursiveEnumerator, NonSplittingRecursiveEnumerator

@PublicEvolving
public interface FileEnumerator

The FileEnumerator's task is to discover all files to be read and to split them into a set of FileSourceSplit.

This includes possibly, path traversals, file filtering (by name or other patterns) and deciding whether to split files into multiple splits, and how to split them.

嵌套类概要

嵌套类

限定符和类型	接口和说明
static interface	FileEnumerator.Provider Factory for the FileEnumerator, to allow the FileEnumerator to be eagerly initialized and to not be serializable.

方法概要

限定符和类型	方法和说明
Collection<FileSourceSplit>	enumerateSplits(org.apache.flink.core.fs.Path[] paths, int minDesiredSplits) Generates all file splits for the relevant files under the given paths.

方法详细资料

enumerateSplits

Collection<FileSourceSplit> enumerateSplits(org.apache.flink.core.fs.Path[] paths,
                                            int minDesiredSplits)
                                     throws IOException

Generates all file splits for the relevant files under the given paths. The minDesiredSplits is an optional hint indicating how many splits would be necessary to exploit parallelism properly.

抛出:

IOException