org.apache.flink.connector.file.table

接口 PartitionCommitPolicy

所有已知实现类:

MetastoreCommitPolicy, SuccessFileCommitPolicy

@Experimental
public interface PartitionCommitPolicy

Policy for commit a partition.

The implemented commit method needs to be idempotent because the same partition may be committed multiple times.

Default implementations: See MetastoreCommitPolicy. See SuccessFileCommitPolicy.

Further more, you can implement your own policy, like: - RPC to notify downstream applications. - Trigger hive to analysis partition for generating statistics. ...

嵌套类概要

嵌套类

限定符和类型	接口和说明
static interface	PartitionCommitPolicy.Context Context of policy, including table information and partition information.

字段概要

字段

限定符和类型	字段和说明
static String	CUSTOM
static String	METASTORE
static String	SUCCESS_FILE

方法概要

限定符和类型	方法和说明
void	commit(PartitionCommitPolicy.Context context) Commit a partition.
static List<PartitionCommitPolicy>	createPolicyChain(ClassLoader cl, String policyKind, String customClass, String successFileName, java.util.function.Supplier<org.apache.flink.core.fs.FileSystem> fsSupplier) Create a policy chain from config.
static void	validatePolicyChain(boolean isEmptyMetastore, String policyKind) Validate commit policy.

字段详细资料

METASTORE

static final String METASTORE

另请参阅:

常量字段值

SUCCESS_FILE

static final String SUCCESS_FILE

另请参阅:

常量字段值

CUSTOM

static final String CUSTOM

另请参阅:

常量字段值

方法详细资料

commit

void commit(PartitionCommitPolicy.Context context)
     throws Exception

Commit a partition.

抛出:

Exception

createPolicyChain

static List<PartitionCommitPolicy> createPolicyChain(ClassLoader cl,
                                                     String policyKind,
                                                     String customClass,
                                                     String successFileName,
                                                     java.util.function.Supplier<org.apache.flink.core.fs.FileSystem> fsSupplier)

Create a policy chain from config.

validatePolicyChain

static void validatePolicyChain(boolean isEmptyMetastore,
                                String policyKind)

Validate commit policy.