Package org.apache.flink.connector.file.sink.compactor
-
Interface Summary Interface Description DecoderBasedReader.Decoder<T> ADecoderBasedReader.Decoderto decode the file content into the actual records.DecoderBasedReader.Decoder.Factory<T> Factory to createDecoderBasedReader.Decoder.FileCompactor TheFileCompactoris responsible for compacting files into one file.RecordWiseFileCompactor.Reader<T> The reader that reads record from the compacting files.RecordWiseFileCompactor.Reader.Factory<T> Factory forRecordWiseFileCompactor.Reader.RecordWiseFileCompactor.Writer<T> The writer that writers record into the compacting files. -
Class Summary Class Description ConcatFileCompactor AOutputStreamBasedFileCompactorimplementation that simply concat the compacting files.DecoderBasedReader<T> ARecordWiseFileCompactor.Readerimplementation that reads the file as anFSDataInputStreamand decodes the record with theDecoderBasedReader.Decoder.DecoderBasedReader.Factory<T> Factory forDecoderBasedReader.FileCompactStrategy Strategy for compacting the files written inFileSinkbefore committing.FileCompactStrategy.Builder Builder forFileCompactStrategy.IdenticalFileCompactor A simpleOutputStreamBasedFileCompactorimplementation that directly copy the content of the only input file to the output.InputFormatBasedReader<T> ARecordWiseFileCompactor.Readerimplementation that reads the file using theFileInputFormat.InputFormatBasedReader.Factory<T> Factory forInputFormatBasedReader.OutputStreamBasedFileCompactor Base class forFileCompactorimplementations that write the compacting file by a output stream.RecordWiseFileCompactor<IN> AFileCompactorimplementation that reads input files with aRecordWiseFileCompactor.Readerand writes with aRecordWiseFileCompactor.Writer.SimpleStringDecoder A sinkDecoderBasedReader.Decoderthat reads data encoded by theSimpleStringEncoderonly for compaction.