org.apache.flink.connector.file.src

类 AbstractFileSource<T,SplitT extends FileSourceSplit>

java.lang.Object

org.apache.flink.connector.file.src.AbstractFileSource<T,SplitT>

类型参数:

T - The type of the events/records produced by this source.

SplitT - The subclass type of the FileSourceSplit used by the source implementation.

所有已实现的接口:

Serializable, org.apache.flink.api.connector.source.Source<T,SplitT,PendingSplitsCheckpoint<SplitT>>, org.apache.flink.api.java.typeutils.ResultTypeQueryable<T>

直接已知子类:

FileSource

@PublicEvolving
public abstract class AbstractFileSource<T,SplitT extends FileSourceSplit>
extends Object
implements org.apache.flink.api.connector.source.Source<T,SplitT,PendingSplitsCheckpoint<SplitT>>, org.apache.flink.api.java.typeutils.ResultTypeQueryable<T>

The base class for File Sources. The main implementation to use is the FileSource, which also has the majority of the documentation.

To read new formats, one commonly does NOT need to extend this class, but should implement a new Format Reader (like StreamFormat, BulkFormat and use it with the FileSource.

The only reason to extend this class is when a source needs a different type of split, meaning an extension of the FileSourceSplit to carry additional information.

另请参阅:

序列化表格

嵌套类概要

嵌套类

限定符和类型	类和说明
protected static class	AbstractFileSource.AbstractFileSourceBuilder<T,SplitT extends FileSourceSplit,SELF extends AbstractFileSource.AbstractFileSourceBuilder<T,SplitT,SELF>> The generic base builder.

构造器概要

构造器

限定符	构造器和说明
protected	AbstractFileSource(org.apache.flink.core.fs.Path[] inputPaths, FileEnumerator.Provider fileEnumerator, FileSplitAssigner.Provider splitAssigner, BulkFormat<T,SplitT> readerFormat, ContinuousEnumerationSettings continuousEnumerationSettings)

方法概要

限定符和类型	方法和说明
org.apache.flink.api.connector.source.SplitEnumerator<SplitT,PendingSplitsCheckpoint<SplitT>>	createEnumerator(org.apache.flink.api.connector.source.SplitEnumeratorContext<SplitT> enumContext)
org.apache.flink.api.connector.source.SourceReader<T,SplitT>	createReader(org.apache.flink.api.connector.source.SourceReaderContext readerContext)
FileSplitAssigner.Provider	getAssignerFactory()
org.apache.flink.api.connector.source.Boundedness	getBoundedness()
ContinuousEnumerationSettings	getContinuousEnumerationSettings()
org.apache.flink.core.io.SimpleVersionedSerializer<PendingSplitsCheckpoint<SplitT>>	getEnumeratorCheckpointSerializer()
org.apache.flink.api.common.typeinfo.TypeInformation<T>	getProducedType()
abstract org.apache.flink.core.io.SimpleVersionedSerializer<SplitT>	getSplitSerializer()
org.apache.flink.api.connector.source.SplitEnumerator<SplitT,PendingSplitsCheckpoint<SplitT>>	restoreEnumerator(org.apache.flink.api.connector.source.SplitEnumeratorContext<SplitT> enumContext, PendingSplitsCheckpoint<SplitT> checkpoint)

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

构造器详细资料

AbstractFileSource

protected AbstractFileSource(org.apache.flink.core.fs.Path[] inputPaths,
                             FileEnumerator.Provider fileEnumerator,
                             FileSplitAssigner.Provider splitAssigner,
                             BulkFormat<T,SplitT> readerFormat,
                             @Nullable
                             ContinuousEnumerationSettings continuousEnumerationSettings)

方法详细资料

getAssignerFactory

public FileSplitAssigner.Provider getAssignerFactory()

getContinuousEnumerationSettings

@Nullable
public ContinuousEnumerationSettings getContinuousEnumerationSettings()

getBoundedness

public org.apache.flink.api.connector.source.Boundedness getBoundedness()

指定者:

getBoundedness 在接口中 org.apache.flink.api.connector.source.Source<T,SplitT extends FileSourceSplit,PendingSplitsCheckpoint<SplitT extends FileSourceSplit>>

createReader

public org.apache.flink.api.connector.source.SourceReader<T,SplitT> createReader(org.apache.flink.api.connector.source.SourceReaderContext readerContext)

指定者:

createReader 在接口中 org.apache.flink.api.connector.source.Source<T,SplitT extends FileSourceSplit,PendingSplitsCheckpoint<SplitT extends FileSourceSplit>>

createEnumerator

public org.apache.flink.api.connector.source.SplitEnumerator<SplitT,PendingSplitsCheckpoint<SplitT>> createEnumerator(org.apache.flink.api.connector.source.SplitEnumeratorContext<SplitT> enumContext)

指定者:

createEnumerator 在接口中 org.apache.flink.api.connector.source.Source<T,SplitT extends FileSourceSplit,PendingSplitsCheckpoint<SplitT extends FileSourceSplit>>

restoreEnumerator

public org.apache.flink.api.connector.source.SplitEnumerator<SplitT,PendingSplitsCheckpoint<SplitT>> restoreEnumerator(org.apache.flink.api.connector.source.SplitEnumeratorContext<SplitT> enumContext,
                                                                                                                       PendingSplitsCheckpoint<SplitT> checkpoint)

指定者:

restoreEnumerator 在接口中 org.apache.flink.api.connector.source.Source<T,SplitT extends FileSourceSplit,PendingSplitsCheckpoint<SplitT extends FileSourceSplit>>

getSplitSerializer

public abstract org.apache.flink.core.io.SimpleVersionedSerializer<SplitT> getSplitSerializer()

指定者:

getSplitSerializer 在接口中 org.apache.flink.api.connector.source.Source<T,SplitT extends FileSourceSplit,PendingSplitsCheckpoint<SplitT extends FileSourceSplit>>

getEnumeratorCheckpointSerializer

public org.apache.flink.core.io.SimpleVersionedSerializer<PendingSplitsCheckpoint<SplitT>> getEnumeratorCheckpointSerializer()

指定者:

getEnumeratorCheckpointSerializer 在接口中 org.apache.flink.api.connector.source.Source<T,SplitT extends FileSourceSplit,PendingSplitsCheckpoint<SplitT extends FileSourceSplit>>

getProducedType

public org.apache.flink.api.common.typeinfo.TypeInformation<T> getProducedType()

指定者:

getProducedType 在接口中 org.apache.flink.api.java.typeutils.ResultTypeQueryable<T>