程序包 org.apache.flink.connector.file.table

接口概要

接口	说明
ContinuousPartitionFetcher<P,T extends Comparable<T>>	Partition fetcher for helping continuously fetch partitioned table.
ContinuousPartitionFetcher.Context<P,T extends Comparable<T>>	Context for fetch partitions, partition information is stored in hive meta store.
FileSystemFactory	A factory to create file systems.
OutputFormatFactory<T>	A factory to create an OutputFormat.
PartitionCommitPolicy	Policy for commit a partition.
PartitionCommitPolicy.Context	Context of policy, including table information and partition information.
PartitionComputer<T>	Compute partition path from record and project non-partition columns for output writer.
PartitionFetcher<P>	Fetcher to fetch the suitable partitions of a filesystem table.
PartitionFetcher.Context<P>	Context for fetch partitions, partition information is stored in hive meta store.
PartitionFetcher.Context.ComparablePartitionValue<P,T extends Comparable<T>>	A comparable partition value that can compare order by using its comparator.
PartitionFieldExtractor<T extends FileSourceSplit>	Interface to extract partition field from split.
PartitionReader<P,OUT>	Reader that reads record from given partitions.
PartitionTimeExtractor	Time extractor to extract time from partition values.
PartitionWriter<T>	Partition writer to write records with partition.
PartitionWriterFactory<T>	Factory of PartitionWriter to avoid virtual function calls.
TableMetaStoreFactory	Meta store factory to create TableMetaStoreFactory.TableMetaStore.
TableMetaStoreFactory.TableMetaStore	Meta store to manage the location paths of this table and its partitions.

类概要

类	说明
BinPacking	A bin packing implementation.
ColumnarRowIterator	A BulkFormat.RecordIterator that returns RowDatas.
DefaultPartTimeExtractor	Default PartitionTimeExtractor.
DeserializationSchemaAdapter	Adapter to turn a DeserializationSchema into a BulkFormat.
DynamicPartitionWriter<T>	Dynamic partition writer to writing multiple partitions at the same time, it maybe consumes more memory.
EmptyMetaStoreFactory	Empty implementation TableMetaStoreFactory.
EnrichedRowData	An implementation of RowData which is backed by two RowData with a well-defined index mapping, One of the rows is fixed, while the other can be swapped for performant changes in hot code paths.
FileSystemConnectorOptions	Options for the filesystem connector.
FileSystemOutputFormat<T>	File system OutputFormat for batch job.
FileSystemOutputFormat.Builder<T>	Builder to build FileSystemOutputFormat.
FileSystemTableFactory	File system TableFactory.
FileSystemTableSink	File system DynamicTableSink.
FileSystemTableSink.ProjectionBulkFactory	Project row to non-partition fields.
FileSystemTableSink.TableBucketAssigner	Table bucket assigner, wrap PartitionComputer.
FileSystemTableSink.TableRollingPolicy	Table RollingPolicy, it extends CheckpointRollingPolicy for bulk writers.
FileSystemTableSource	File system table source.
GroupedPartitionWriter<T>	PartitionWriter for grouped dynamic partition inserting.
LimitableBulkFormat<T,SplitT extends FileSourceSplit>	A BulkFormat that can limit output record number.
MetastoreCommitPolicy	Partition commit policy to update metastore.
PartitionLoader	Loader to temporary files to final output path and meta store.
PartitionTempFileManager	Manage temporary files for writing files.
PartitionWriter.Context<T>	Context for partition writer, provide some information and generation utils.
RowDataPartitionComputer	PartitionComputer for RowData.
RowPartitionComputer	PartitionComputer for Row.
SerializationSchemaAdapter	Adapter to turn a SerializationSchema into a Encoder.
SingleDirectoryWriter<T>	PartitionWriter for single directory writer.
SuccessFileCommitPolicy	Partition commit policy to add success file to directory.

枚举概要

枚举	说明
FileSystemConnectorOptions.PartitionCommitTriggerType	Trigger types for partition commit, see FileSystemConnectorOptions.SINK_PARTITION_COMMIT_TRIGGER.