org.apache.flink.connector.file.src.impl

Class ContinuousFileSplitEnumerator

java.lang.Object

org.apache.flink.connector.file.src.impl.ContinuousFileSplitEnumerator

All Implemented Interfaces:

AutoCloseable, org.apache.flink.api.common.state.CheckpointListener, org.apache.flink.api.connector.source.SplitEnumerator<FileSourceSplit,PendingSplitsCheckpoint<FileSourceSplit>>, org.apache.flink.api.connector.source.SupportsBatchSnapshot

@Internal
public class ContinuousFileSplitEnumerator
extends Object
implements org.apache.flink.api.connector.source.SplitEnumerator<FileSourceSplit,PendingSplitsCheckpoint<FileSourceSplit>>, org.apache.flink.api.connector.source.SupportsBatchSnapshot

A continuously monitoring enumerator.

Constructor Summary

Constructors

Constructor and Description
ContinuousFileSplitEnumerator(org.apache.flink.api.connector.source.SplitEnumeratorContext<FileSourceSplit> context, FileEnumerator enumerator, FileSplitAssigner splitAssigner, org.apache.flink.core.fs.Path[] paths, Collection<org.apache.flink.core.fs.Path> alreadyDiscoveredPaths, long discoveryInterval)

Method Summary

Modifier and Type	Method and Description
void	addReader(int subtaskId)
void	addSplitsBack(List<FileSourceSplit> splits, int subtaskId)
void	close()
void	handleSourceEvent(int subtaskId, org.apache.flink.api.connector.source.SourceEvent sourceEvent)
void	handleSplitRequest(int subtaskId, String requesterHostname)
PendingSplitsCheckpoint<FileSourceSplit>	snapshotState(long checkpointId)
void	start()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.flink.api.connector.source.SplitEnumerator

notifyCheckpointComplete

Methods inherited from interface org.apache.flink.api.common.state.CheckpointListener

notifyCheckpointAborted

Constructor Detail

ContinuousFileSplitEnumerator

public ContinuousFileSplitEnumerator(org.apache.flink.api.connector.source.SplitEnumeratorContext<FileSourceSplit> context,
                                     FileEnumerator enumerator,
                                     FileSplitAssigner splitAssigner,
                                     org.apache.flink.core.fs.Path[] paths,
                                     Collection<org.apache.flink.core.fs.Path> alreadyDiscoveredPaths,
                                     long discoveryInterval)

Method Detail

start

public void start()

Specified by:

start in interface org.apache.flink.api.connector.source.SplitEnumerator<FileSourceSplit,PendingSplitsCheckpoint<FileSourceSplit>>

close

public void close()
           throws IOException

Specified by:

close in interface AutoCloseable

Specified by:

close in interface org.apache.flink.api.connector.source.SplitEnumerator<FileSourceSplit,PendingSplitsCheckpoint<FileSourceSplit>>

Throws:

IOException

addReader

public void addReader(int subtaskId)

Specified by:

addReader in interface org.apache.flink.api.connector.source.SplitEnumerator<FileSourceSplit,PendingSplitsCheckpoint<FileSourceSplit>>

handleSplitRequest

public void handleSplitRequest(int subtaskId,
                               @Nullable
                               String requesterHostname)

Specified by:

handleSplitRequest in interface org.apache.flink.api.connector.source.SplitEnumerator<FileSourceSplit,PendingSplitsCheckpoint<FileSourceSplit>>

handleSourceEvent

public void handleSourceEvent(int subtaskId,
                              org.apache.flink.api.connector.source.SourceEvent sourceEvent)

Specified by:

handleSourceEvent in interface org.apache.flink.api.connector.source.SplitEnumerator<FileSourceSplit,PendingSplitsCheckpoint<FileSourceSplit>>

addSplitsBack

public void addSplitsBack(List<FileSourceSplit> splits,
                          int subtaskId)

Specified by:

addSplitsBack in interface org.apache.flink.api.connector.source.SplitEnumerator<FileSourceSplit,PendingSplitsCheckpoint<FileSourceSplit>>

snapshotState

public PendingSplitsCheckpoint<FileSourceSplit> snapshotState(long checkpointId)
                                                       throws Exception

Specified by:

snapshotState in interface org.apache.flink.api.connector.source.SplitEnumerator<FileSourceSplit,PendingSplitsCheckpoint<FileSourceSplit>>

Throws:

Exception