| 接口 | 说明 |
|---|---|
| DecoderBasedReader.Decoder<T> |
A
DecoderBasedReader.Decoder to decode the file content into the actual records. |
| DecoderBasedReader.Decoder.Factory<T> |
Factory to create
DecoderBasedReader.Decoder. |
| FileCompactor |
The
FileCompactor is responsible for compacting files into one file. |
| RecordWiseFileCompactor.Reader<T> |
The reader that reads record from the compacting files.
|
| RecordWiseFileCompactor.Reader.Factory<T> |
Factory for
RecordWiseFileCompactor.Reader. |
| RecordWiseFileCompactor.Writer<T> |
The writer that writers record into the compacting files.
|
| 类 | 说明 |
|---|---|
| ConcatFileCompactor |
A
OutputStreamBasedFileCompactor implementation that simply concat the compacting files. |
| DecoderBasedReader<T> |
A
RecordWiseFileCompactor.Reader implementation that reads the file as an FSDataInputStream and decodes the record with the DecoderBasedReader.Decoder. |
| DecoderBasedReader.Factory<T> |
Factory for
DecoderBasedReader. |
| FileCompactStrategy |
Strategy for compacting the files written in
FileSink before committing. |
| FileCompactStrategy.Builder |
Builder for
FileCompactStrategy. |
| IdenticalFileCompactor |
A simple
OutputStreamBasedFileCompactor implementation that directly copy the content of
the only input file to the output. |
| InputFormatBasedReader<T> |
A
RecordWiseFileCompactor.Reader implementation that reads the file using the FileInputFormat. |
| InputFormatBasedReader.Factory<T> |
Factory for
InputFormatBasedReader. |
| OutputStreamBasedFileCompactor |
Base class for
FileCompactor implementations that write the compacting file by a output
stream. |
| RecordWiseFileCompactor<IN> |
A
FileCompactor implementation that reads input files with a RecordWiseFileCompactor.Reader and writes
with a RecordWiseFileCompactor.Writer. |
| SimpleStringDecoder |
A sink
DecoderBasedReader.Decoder that reads data encoded by the SimpleStringEncoder only for compaction. |
Copyright © 2014–2022 The Apache Software Foundation. All rights reserved.