org.apache.flink.connector.file.table.stream.compact

类 CompactFileWriter<T>

java.lang.Object

org.apache.flink.streaming.api.operators.AbstractStreamOperator<OUT>

org.apache.flink.connector.file.table.stream.AbstractStreamingWriter<T,CompactMessages.CoordinatorInput>

org.apache.flink.connector.file.table.stream.compact.CompactFileWriter<T>

所有已实现的接口:

Serializable, org.apache.flink.api.common.state.CheckpointListener, org.apache.flink.streaming.api.operators.BoundedOneInput, org.apache.flink.streaming.api.operators.Input<T>, org.apache.flink.streaming.api.operators.KeyContext, org.apache.flink.streaming.api.operators.OneInputStreamOperator<T,CompactMessages.CoordinatorInput>, org.apache.flink.streaming.api.operators.SetupableStreamOperator<CompactMessages.CoordinatorInput>, org.apache.flink.streaming.api.operators.StreamOperator<CompactMessages.CoordinatorInput>, org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.CheckpointedStreamOperator

@Internal
public class CompactFileWriter<T>
extends AbstractStreamingWriter<T,CompactMessages.CoordinatorInput>

Writer for emitting CompactMessages.InputFile and CompactMessages.EndCheckpoint to downstream.

另请参阅:

序列化表格

字段概要

从类继承的字段 org.apache.flink.connector.file.table.stream.AbstractStreamingWriter

buckets, currentWatermark

从类继承的字段 org.apache.flink.streaming.api.operators.AbstractStreamOperator

chainingStrategy, config, latencyStats, LOG, metrics, output, processingTimeService

构造器概要

构造器

构造器和说明
CompactFileWriter(long bucketCheckInterval, org.apache.flink.streaming.api.functions.sink.filesystem.StreamingFileSink.BucketsBuilder<T,String,? extends org.apache.flink.streaming.api.functions.sink.filesystem.StreamingFileSink.BucketsBuilder<T,String,?>> bucketsBuilder)

方法概要

限定符和类型	方法和说明
protected void	commitUpToCheckpoint(long checkpointId) Commit up to this checkpoint id.
protected void	onPartFileOpened(String partition, org.apache.flink.core.fs.Path newPath) Notifies a new file has been opened.
protected void	partitionCreated(String partition) Notifies a partition created.
protected void	partitionInactive(String partition) Notifies a partition become inactive.

从类继承的方法 org.apache.flink.connector.file.table.stream.AbstractStreamingWriter

close, endInput, initializeState, notifyCheckpointComplete, processElement, processWatermark, snapshotState

从类继承的方法 org.apache.flink.streaming.api.operators.AbstractStreamOperator

finish, getChainingStrategy, getContainingTask, getCurrentKey, getExecutionConfig, getInternalTimerService, getKeyedStateBackend, getKeyedStateStore, getMetricGroup, getOperatorConfig, getOperatorID, getOperatorName, getOperatorStateBackend, getOrCreateKeyedState, getPartitionedState, getPartitionedState, getProcessingTimeService, getRuntimeContext, getTimeServiceManager, getUserCodeClassloader, initializeState, isUsingCustomRawKeyedState, notifyCheckpointAborted, open, prepareSnapshotPreBarrier, processLatencyMarker, processLatencyMarker1, processLatencyMarker2, processWatermark1, processWatermark2, processWatermarkStatus, processWatermarkStatus1, processWatermarkStatus2, reportOrForwardLatencyMarker, setChainingStrategy, setCurrentKey, setKeyContextElement1, setKeyContextElement2, setProcessingTimeService, setup, snapshotState

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

从接口继承的方法 org.apache.flink.streaming.api.operators.OneInputStreamOperator

setKeyContextElement

从接口继承的方法 org.apache.flink.streaming.api.operators.StreamOperator

finish, getMetricGroup, getOperatorID, initializeState, open, prepareSnapshotPreBarrier, setKeyContextElement1, setKeyContextElement2, snapshotState

从接口继承的方法 org.apache.flink.api.common.state.CheckpointListener

notifyCheckpointAborted

从接口继承的方法 org.apache.flink.streaming.api.operators.KeyContext

getCurrentKey, setCurrentKey

从接口继承的方法 org.apache.flink.streaming.api.operators.Input

processLatencyMarker, processWatermarkStatus

构造器详细资料

CompactFileWriter

public CompactFileWriter(long bucketCheckInterval,
                         org.apache.flink.streaming.api.functions.sink.filesystem.StreamingFileSink.BucketsBuilder<T,String,? extends org.apache.flink.streaming.api.functions.sink.filesystem.StreamingFileSink.BucketsBuilder<T,String,?>> bucketsBuilder)

方法详细资料

partitionCreated

protected void partitionCreated(String partition)

从类复制的说明: AbstractStreamingWriter

Notifies a partition created.

指定者:

partitionCreated 在类中 AbstractStreamingWriter<T,CompactMessages.CoordinatorInput>

partitionInactive

protected void partitionInactive(String partition)

从类复制的说明: AbstractStreamingWriter

Notifies a partition become inactive. A partition becomes inactive after all the records received so far have been committed.

指定者:

partitionInactive 在类中 AbstractStreamingWriter<T,CompactMessages.CoordinatorInput>

onPartFileOpened

protected void onPartFileOpened(String partition,
                                org.apache.flink.core.fs.Path newPath)

从类复制的说明: AbstractStreamingWriter

Notifies a new file has been opened.

Note that this does not mean that the file has been created in the file system. It is only created logically and the actual file will be generated after it is committed.

指定者:

onPartFileOpened 在类中 AbstractStreamingWriter<T,CompactMessages.CoordinatorInput>

commitUpToCheckpoint

protected void commitUpToCheckpoint(long checkpointId)
                             throws Exception

从类复制的说明: AbstractStreamingWriter

Commit up to this checkpoint id.

覆盖:

commitUpToCheckpoint 在类中 AbstractStreamingWriter<T,CompactMessages.CoordinatorInput>

抛出:

Exception