| Modifier and Type | Method and Description |
|---|---|
FileSystemOutputFormat.Builder<T> |
FileSystemOutputFormat.Builder.setFileSystemFactory(FileSystemFactory fileSystemFactory) |
| Constructor and Description |
|---|
FileSystemCommitter(FileSystemFactory factory,
TableMetaStoreFactory metaStoreFactory,
boolean overwrite,
org.apache.flink.core.fs.Path tmpPath,
int partitionColumnSize,
boolean isToLocal,
org.apache.flink.table.catalog.ObjectIdentifier identifier,
LinkedHashMap<String,String> staticPartitions,
List<PartitionCommitPolicy> policies) |
PartitionTempFileManager(FileSystemFactory factory,
org.apache.flink.core.fs.Path tmpPath,
int taskNumber,
int attemptNumber) |
PartitionTempFileManager(FileSystemFactory factory,
org.apache.flink.core.fs.Path tmpPath,
int taskNumber,
int attemptNumber,
org.apache.flink.streaming.api.functions.sink.filesystem.OutputFileConfig outputFileConfig) |
| Modifier and Type | Method and Description |
|---|---|
static <T> org.apache.flink.streaming.api.datastream.DataStreamSink<?> |
BatchSink.createBatchCompactSink(org.apache.flink.streaming.api.datastream.DataStream<CompactMessages.CoordinatorInput> dataStream,
org.apache.flink.streaming.api.functions.sink.filesystem.StreamingFileSink.BucketsBuilder<T,String,? extends org.apache.flink.streaming.api.functions.sink.filesystem.StreamingFileSink.BucketsBuilder<T,String,?>> builder,
CompactReader.Factory<T> readFactory,
FileSystemFactory fsFactory,
TableMetaStoreFactory metaStoreFactory,
PartitionCommitPolicyFactory partitionCommitPolicyFactory,
String[] partitionColumns,
LinkedHashMap<String,String> staticPartitionSpec,
org.apache.flink.core.fs.Path tmpPath,
org.apache.flink.table.catalog.ObjectIdentifier identifier,
long compactAverageSize,
long compactTargetSize,
boolean isToLocal,
boolean overwrite,
int compactParallelism,
boolean compactParallelismConfigured) |
| Constructor and Description |
|---|
BatchFileWriter(FileSystemFactory fsFactory,
org.apache.flink.core.fs.Path tmpPath,
String[] partitionColumns,
boolean dynamicGrouped,
LinkedHashMap<String,String> staticPartitions,
OutputFormatFactory<T> formatFactory,
PartitionComputer<T> computer,
org.apache.flink.streaming.api.functions.sink.filesystem.OutputFileConfig outputFileConfig) |
BatchPartitionCommitterSink(FileSystemFactory fsFactory,
TableMetaStoreFactory msFactory,
boolean overwrite,
boolean isToLocal,
org.apache.flink.core.fs.Path tmpPath,
String[] partitionColumns,
LinkedHashMap<String,String> staticPartitions,
org.apache.flink.table.catalog.ObjectIdentifier identifier,
PartitionCommitPolicyFactory partitionCommitPolicyFactory) |
| Modifier and Type | Method and Description |
|---|---|
static <T> org.apache.flink.streaming.api.datastream.DataStream<PartitionCommitInfo> |
StreamingSink.compactionWriter(org.apache.flink.table.connector.ProviderContext providerContext,
org.apache.flink.streaming.api.datastream.DataStream<T> inputStream,
long bucketCheckInterval,
org.apache.flink.streaming.api.functions.sink.filesystem.StreamingFileSink.BucketsBuilder<T,String,? extends org.apache.flink.streaming.api.functions.sink.filesystem.StreamingFileSink.BucketsBuilder<T,String,?>> bucketsBuilder,
FileSystemFactory fsFactory,
org.apache.flink.core.fs.Path path,
CompactReader.Factory<T> readFactory,
long targetFileSize,
int parallelism,
boolean parallelismConfigured)
Create a file writer with compaction operators by input stream.
|
static org.apache.flink.streaming.api.datastream.DataStreamSink<?> |
StreamingSink.sink(org.apache.flink.table.connector.ProviderContext providerContext,
org.apache.flink.streaming.api.datastream.DataStream<PartitionCommitInfo> writer,
org.apache.flink.core.fs.Path locationPath,
org.apache.flink.table.catalog.ObjectIdentifier identifier,
List<String> partitionKeys,
TableMetaStoreFactory msFactory,
FileSystemFactory fsFactory,
org.apache.flink.configuration.Configuration options)
Create a sink from file writer.
|
| Constructor and Description |
|---|
PartitionCommitter(org.apache.flink.core.fs.Path locationPath,
org.apache.flink.table.catalog.ObjectIdentifier tableIdentifier,
List<String> partitionKeys,
TableMetaStoreFactory metaStoreFactory,
FileSystemFactory fsFactory,
org.apache.flink.configuration.Configuration conf) |
Copyright © 2014–2025 The Apache Software Foundation. All rights reserved.