Package org.apache.flink.connector.file.table

Interface Summary

Interface	Description
ContinuousPartitionFetcher<P,T extends Comparable<T>>	Partition fetcher for helping continuously fetch partitioned table.
ContinuousPartitionFetcher.Context<P,T extends Comparable<T>>	Context for fetch partitions, partition information is stored in hive meta store.
FileSystemFactory	A factory to create file systems.
OutputFormatFactory<T>	A factory to create an OutputFormat.
PartitionCommitPolicy	Policy for commit a partition.
PartitionCommitPolicy.Context	Context of policy, including table information and partition information.
PartitionComputer<T>	Compute partition path from record and project non-partition columns for output writer.
PartitionFetcher<P>	Fetcher to fetch the suitable partitions of a filesystem table.
PartitionFetcher.Context<P>	Context for fetch partitions, partition information is stored in hive meta store.
PartitionFetcher.Context.ComparablePartitionValue<P,T extends Comparable<T>>	A comparable partition value that can compare order by using its comparator.
PartitionFieldExtractor<T extends FileSourceSplit>	Interface to extract partition field from split.
PartitionReader<P,OUT>	Reader that reads record from given partitions.
PartitionTimeExtractor	Time extractor to extract time from partition values.
PartitionWriter<T>	Partition writer to write records with partition.
PartitionWriter.PartitionWriterListener	Listener for partition writer.
PartitionWriterFactory<T>	Factory of PartitionWriter to avoid virtual function calls.
TableMetaStoreFactory	Meta store factory to create TableMetaStoreFactory.TableMetaStore.
TableMetaStoreFactory.TableMetaStore	Meta store to manage the location paths of this table and its partitions.

Class Summary

Class	Description
BinPacking	A bin packing implementation.
ColumnarRowIterator	A BulkFormat.RecordIterator that returns RowDatas.
DefaultPartTimeExtractor	Default PartitionTimeExtractor.
DeserializationSchemaAdapter	Adapter to turn a DeserializationSchema into a BulkFormat.
DynamicPartitionWriter<T>	Dynamic partition writer to writing multiple partitions at the same time, it maybe consumes more memory.
EmptyMetaStoreFactory	Empty implementation TableMetaStoreFactory.
EnrichedRowData	An implementation of RowData which is backed by two RowData with a well-defined index mapping, One of the rows is fixed, while the other can be swapped for performant changes in hot code paths.
FileSystemCommitter	File system file committer implementation.
FileSystemConnectorOptions	Options for the filesystem connector.
FileSystemOutputFormat<T>	File system OutputFormat for batch job.
FileSystemOutputFormat.Builder<T>	Builder to build FileSystemOutputFormat.
FileSystemTableFactory	File system TableFactory.
FileSystemTableSink	File system DynamicTableSink.
FileSystemTableSink.ProjectionBulkFactory	Project row to non-partition fields.
FileSystemTableSink.TableBucketAssigner	Table bucket assigner, wrap PartitionComputer.
FileSystemTableSink.TableRollingPolicy	Table RollingPolicy, it extends CheckpointRollingPolicy for bulk writers.
FileSystemTableSource	File system table source.
GroupedPartitionWriter<T>	PartitionWriter for grouped dynamic partition inserting.
LimitableBulkFormat<T,SplitT extends FileSourceSplit>	A BulkFormat that can limit output record number.
MetastoreCommitPolicy	Partition commit policy to update metastore.
PartitionCommitPolicyFactory	A factory to create PartitionCommitPolicy chain.
PartitionLoader	Loader to temporary files to final output path and meta store.
PartitionTempFileManager	Manage temporary files for writing files.
PartitionWriter.Context<T>	Context for partition writer, provide some information and generation utils.
PartitionWriter.DefaultPartitionWriterListener	Default implementation for PartitionWriterListener.
RowDataPartitionComputer	PartitionComputer for RowData.
RowPartitionComputer	PartitionComputer for Row.
SerializationSchemaAdapter	Adapter to turn a SerializationSchema into a Encoder.
SingleDirectoryWriter<T>	PartitionWriter for single directory writer.
SuccessFileCommitPolicy	Partition commit policy to add success file to directory.

Enum Summary

Enum	Description
FileSystemConnectorOptions.FileStatisticsType	Statistics types for file system, see FileSystemConnectorOptions.SOURCE_REPORT_STATISTICS.
FileSystemConnectorOptions.PartitionCommitTriggerType	Trigger types for partition commit, see FileSystemConnectorOptions.SINK_PARTITION_COMMIT_TRIGGER.