org.apache.flink.connector.file.table.stream

类 StreamingFileWriter<IN>

java.lang.Object

org.apache.flink.streaming.api.operators.AbstractStreamOperator<OUT>

org.apache.flink.connector.file.table.stream.AbstractStreamingWriter<IN,PartitionCommitInfo>

org.apache.flink.connector.file.table.stream.StreamingFileWriter<IN>

所有已实现的接口:

Serializable, org.apache.flink.api.common.state.CheckpointListener, org.apache.flink.streaming.api.operators.BoundedOneInput, org.apache.flink.streaming.api.operators.Input<IN>, org.apache.flink.streaming.api.operators.KeyContext, org.apache.flink.streaming.api.operators.OneInputStreamOperator<IN,PartitionCommitInfo>, org.apache.flink.streaming.api.operators.SetupableStreamOperator<PartitionCommitInfo>, org.apache.flink.streaming.api.operators.StreamOperator<PartitionCommitInfo>, org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.CheckpointedStreamOperator

@Internal
public class StreamingFileWriter<IN>
extends AbstractStreamingWriter<IN,PartitionCommitInfo>

Writer for emitting PartitionCommitInfo to downstream.

另请参阅:

序列化表格

字段概要

从类继承的字段 org.apache.flink.connector.file.table.stream.AbstractStreamingWriter

buckets, currentWatermark

从类继承的字段 org.apache.flink.streaming.api.operators.AbstractStreamOperator

chainingStrategy, config, latencyStats, LOG, metrics, output, processingTimeService

构造器概要

构造器

构造器和说明
StreamingFileWriter(long bucketCheckInterval, org.apache.flink.streaming.api.functions.sink.filesystem.StreamingFileSink.BucketsBuilder<IN,String,? extends org.apache.flink.streaming.api.functions.sink.filesystem.StreamingFileSink.BucketsBuilder<IN,String,?>> bucketsBuilder, List<String> partitionKeys, org.apache.flink.configuration.Configuration conf)

方法概要

限定符和类型	方法和说明
protected void	commitUpToCheckpoint(long checkpointId) Commit up to this checkpoint id.
void	initializeState(org.apache.flink.runtime.state.StateInitializationContext context)
protected void	onPartFileOpened(String s, org.apache.flink.core.fs.Path newPath) Notifies a new file has been opened.
protected void	partitionCreated(String partition) Notifies a partition created.
protected void	partitionInactive(String partition) Notifies a partition become inactive.
void	snapshotState(org.apache.flink.runtime.state.StateSnapshotContext context)

从类继承的方法 org.apache.flink.connector.file.table.stream.AbstractStreamingWriter

close, endInput, notifyCheckpointComplete, processElement, processWatermark

从类继承的方法 org.apache.flink.streaming.api.operators.AbstractStreamOperator

finish, getChainingStrategy, getContainingTask, getCurrentKey, getExecutionConfig, getInternalTimerService, getKeyedStateBackend, getKeyedStateStore, getMetricGroup, getOperatorConfig, getOperatorID, getOperatorName, getOperatorStateBackend, getOrCreateKeyedState, getPartitionedState, getPartitionedState, getProcessingTimeService, getRuntimeContext, getTimeServiceManager, getUserCodeClassloader, initializeState, isUsingCustomRawKeyedState, notifyCheckpointAborted, open, prepareSnapshotPreBarrier, processLatencyMarker, processLatencyMarker1, processLatencyMarker2, processWatermark1, processWatermark2, processWatermarkStatus, processWatermarkStatus1, processWatermarkStatus2, reportOrForwardLatencyMarker, setChainingStrategy, setCurrentKey, setKeyContextElement1, setKeyContextElement2, setProcessingTimeService, setup, snapshotState

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

从接口继承的方法 org.apache.flink.streaming.api.operators.OneInputStreamOperator

setKeyContextElement

从接口继承的方法 org.apache.flink.streaming.api.operators.StreamOperator

finish, getMetricGroup, getOperatorID, initializeState, open, prepareSnapshotPreBarrier, setKeyContextElement1, setKeyContextElement2, snapshotState

从接口继承的方法 org.apache.flink.api.common.state.CheckpointListener

notifyCheckpointAborted

从接口继承的方法 org.apache.flink.streaming.api.operators.KeyContext

getCurrentKey, setCurrentKey

从接口继承的方法 org.apache.flink.streaming.api.operators.Input

processLatencyMarker, processWatermarkStatus

构造器详细资料

StreamingFileWriter

public StreamingFileWriter(long bucketCheckInterval,
                           org.apache.flink.streaming.api.functions.sink.filesystem.StreamingFileSink.BucketsBuilder<IN,String,? extends org.apache.flink.streaming.api.functions.sink.filesystem.StreamingFileSink.BucketsBuilder<IN,String,?>> bucketsBuilder,
                           List<String> partitionKeys,
                           org.apache.flink.configuration.Configuration conf)

方法详细资料

initializeState

public void initializeState(org.apache.flink.runtime.state.StateInitializationContext context)
                     throws Exception

指定者:

initializeState 在接口中 org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.CheckpointedStreamOperator

覆盖:

initializeState 在类中 AbstractStreamingWriter<IN,PartitionCommitInfo>

抛出:

Exception

partitionCreated

protected void partitionCreated(String partition)

从类复制的说明: AbstractStreamingWriter

Notifies a partition created.

指定者:

partitionCreated 在类中 AbstractStreamingWriter<IN,PartitionCommitInfo>

partitionInactive

protected void partitionInactive(String partition)

从类复制的说明: AbstractStreamingWriter

Notifies a partition become inactive. A partition becomes inactive after all the records received so far have been committed.

指定者:

partitionInactive 在类中 AbstractStreamingWriter<IN,PartitionCommitInfo>

onPartFileOpened

protected void onPartFileOpened(String s,
                                org.apache.flink.core.fs.Path newPath)

从类复制的说明: AbstractStreamingWriter

Notifies a new file has been opened.

Note that this does not mean that the file has been created in the file system. It is only created logically and the actual file will be generated after it is committed.

指定者:

onPartFileOpened 在类中 AbstractStreamingWriter<IN,PartitionCommitInfo>

snapshotState

public void snapshotState(org.apache.flink.runtime.state.StateSnapshotContext context)
                   throws Exception

指定者:

snapshotState 在接口中 org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.CheckpointedStreamOperator

覆盖:

snapshotState 在类中 AbstractStreamingWriter<IN,PartitionCommitInfo>

抛出:

Exception

commitUpToCheckpoint

protected void commitUpToCheckpoint(long checkpointId)
                             throws Exception

从类复制的说明: AbstractStreamingWriter

Commit up to this checkpoint id.

覆盖:

commitUpToCheckpoint 在类中 AbstractStreamingWriter<IN,PartitionCommitInfo>

抛出:

Exception