org.apache.flink.connector.file.table.batch.compact

Class BatchPartitionCommitterSink

java.lang.Object

org.apache.flink.api.common.functions.AbstractRichFunction

org.apache.flink.streaming.api.functions.sink.RichSinkFunction<CompactMessages.CompactOutput>

org.apache.flink.connector.file.table.batch.compact.BatchPartitionCommitterSink

All Implemented Interfaces:

Serializable, org.apache.flink.api.common.functions.Function, org.apache.flink.api.common.functions.RichFunction, org.apache.flink.streaming.api.functions.sink.SinkFunction<CompactMessages.CompactOutput>

public class BatchPartitionCommitterSink
extends org.apache.flink.streaming.api.functions.sink.RichSinkFunction<CompactMessages.CompactOutput>

Committer operator for partition in batch mode. This is the single (non-parallel) task. It collects all the partition information including partition and written files send from upstream.

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from interface org.apache.flink.streaming.api.functions.sink.SinkFunction

org.apache.flink.streaming.api.functions.sink.SinkFunction.Context

Constructor Summary

Constructors

Constructor and Description
BatchPartitionCommitterSink(FileSystemFactory fsFactory, TableMetaStoreFactory msFactory, boolean overwrite, boolean isToLocal, org.apache.flink.core.fs.Path tmpPath, String[] partitionColumns, LinkedHashMap<String,String> staticPartitions, org.apache.flink.table.catalog.ObjectIdentifier identifier, PartitionCommitPolicyFactory partitionCommitPolicyFactory)

Method Summary

Modifier and Type	Method and Description
void	close()
void	finish()
void	invoke(CompactMessages.CompactOutput compactOutput, org.apache.flink.streaming.api.functions.sink.SinkFunction.Context context)
void	open(org.apache.flink.api.common.functions.OpenContext openContext)

Methods inherited from class org.apache.flink.api.common.functions.AbstractRichFunction

getIterationRuntimeContext, getRuntimeContext, open, setRuntimeContext

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.flink.streaming.api.functions.sink.SinkFunction

invoke, writeWatermark

Constructor Detail

BatchPartitionCommitterSink

public BatchPartitionCommitterSink(FileSystemFactory fsFactory,
                                   TableMetaStoreFactory msFactory,
                                   boolean overwrite,
                                   boolean isToLocal,
                                   org.apache.flink.core.fs.Path tmpPath,
                                   String[] partitionColumns,
                                   LinkedHashMap<String,String> staticPartitions,
                                   org.apache.flink.table.catalog.ObjectIdentifier identifier,
                                   PartitionCommitPolicyFactory partitionCommitPolicyFactory)

Method Detail

open

public void open(org.apache.flink.api.common.functions.OpenContext openContext)
          throws Exception

Throws:

Exception

invoke

public void invoke(CompactMessages.CompactOutput compactOutput,
                   org.apache.flink.streaming.api.functions.sink.SinkFunction.Context context)
            throws Exception

Throws:

Exception

finish

public void finish()
            throws Exception

Throws:

Exception

close

public void close()
           throws Exception

Specified by:

close in interface org.apache.flink.api.common.functions.RichFunction

Overrides:

close in class org.apache.flink.api.common.functions.AbstractRichFunction

Throws:

Exception