org.apache.hudi.common.table.cdc

Class HoodieCDCFileSplit

java.lang.Object

org.apache.hudi.common.table.cdc.HoodieCDCFileSplit

All Implemented Interfaces:

Serializable, Comparable<HoodieCDCFileSplit>

public class HoodieCDCFileSplit
extends Object
implements Serializable, Comparable<HoodieCDCFileSplit>

This contains all the information that retrieve the change data at a single file group and at a single commit.

For `cdcInferCase` = HoodieCDCInferenceCase.BASE_FILE_INSERT, `cdcFile` is a current version of the base file in the group, and `beforeFileSlice` is None. For `cdcInferCase` = HoodieCDCInferenceCase.BASE_FILE_DELETE, `cdcFile` is null, `beforeFileSlice` is the previous version of the base file in the group. For `cdcInferCase` = HoodieCDCInferenceCase.AS_IS, `cdcFile` is a log file with cdc blocks. when enable the supplemental logging, both `beforeFileSlice` and `afterFileSlice` are None, otherwise these two are the previous and current version of the base file. For `cdcInferCase` = HoodieCDCInferenceCase.LOG_FILE, `cdcFile` is a normal log file and `beforeFileSlice` is the previous version of the file slice. For `cdcInferCase` = HoodieCDCInferenceCase.REPLACE_COMMIT, `cdcFile` is null, `beforeFileSlice` is the current version of the file slice.

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
HoodieCDCFileSplit(String instant, HoodieCDCInferenceCase cdcInferCase, Collection<String> cdcFiles)
HoodieCDCFileSplit(String instant, HoodieCDCInferenceCase cdcInferCase, Collection<String> cdcFiles, Option<FileSlice> beforeFileSlice, Option<FileSlice> afterFileSlice)
HoodieCDCFileSplit(String instant, HoodieCDCInferenceCase cdcInferCase, String cdcFile)
HoodieCDCFileSplit(String instant, HoodieCDCInferenceCase cdcInferCase, String cdcFile, Option<FileSlice> beforeFileSlice, Option<FileSlice> afterFileSlice)

Method Summary

Modifier and Type	Method and Description
int	compareTo(HoodieCDCFileSplit o)
Option<FileSlice>	getAfterFileSlice()
Option<FileSlice>	getBeforeFileSlice()
List<String>	getCdcFiles()
HoodieCDCInferenceCase	getCdcInferCase()
String	getInstant()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

HoodieCDCFileSplit

public HoodieCDCFileSplit(String instant,
                          HoodieCDCInferenceCase cdcInferCase,
                          String cdcFile)

HoodieCDCFileSplit

public HoodieCDCFileSplit(String instant,
                          HoodieCDCInferenceCase cdcInferCase,
                          Collection<String> cdcFiles)

HoodieCDCFileSplit

public HoodieCDCFileSplit(String instant,
                          HoodieCDCInferenceCase cdcInferCase,
                          String cdcFile,
                          Option<FileSlice> beforeFileSlice,
                          Option<FileSlice> afterFileSlice)

HoodieCDCFileSplit

public HoodieCDCFileSplit(String instant,
                          HoodieCDCInferenceCase cdcInferCase,
                          Collection<String> cdcFiles,
                          Option<FileSlice> beforeFileSlice,
                          Option<FileSlice> afterFileSlice)

Method Detail

getInstant

public String getInstant()

getCdcInferCase

public HoodieCDCInferenceCase getCdcInferCase()

getCdcFiles

public List<String> getCdcFiles()

getBeforeFileSlice

public Option<FileSlice> getBeforeFileSlice()

getAfterFileSlice

public Option<FileSlice> getAfterFileSlice()

compareTo

public int compareTo(HoodieCDCFileSplit o)

Specified by:

compareTo in interface Comparable<HoodieCDCFileSplit>