org.apache.flink.connector.file.src.assigners

类 LocalityAwareSplitAssigner

java.lang.Object

org.apache.flink.connector.file.src.assigners.LocalityAwareSplitAssigner

所有已实现的接口:

FileSplitAssigner

@PublicEvolving
public class LocalityAwareSplitAssigner
extends Object
implements FileSplitAssigner

A FileSplitAssigner that assigns to each host preferably splits that are local, before assigning splits that are not local.

Implementation Note: This class is an adjusted copy of the previous API's class LocatableInputSplitAssigner and reproduces the same assignment logic, for compatibility. The logic has not been changed or optimized.

嵌套类概要

从接口继承的嵌套类/接口 org.apache.flink.connector.file.src.assigners.FileSplitAssigner

FileSplitAssigner.Provider

构造器概要

构造器

构造器和说明
LocalityAwareSplitAssigner(Collection<FileSourceSplit> splits)

方法概要

限定符和类型	方法和说明
void	addSplits(Collection<FileSourceSplit> splits) Adds a set of splits to this assigner.
Optional<FileSourceSplit>	getNext(String host) Gets the next split.
Collection<FileSourceSplit>	remainingSplits() Gets the remaining splits that this assigner has pending.

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

构造器详细资料

LocalityAwareSplitAssigner

public LocalityAwareSplitAssigner(Collection<FileSourceSplit> splits)

方法详细资料

getNext

public Optional<FileSourceSplit> getNext(@Nullable
                                         String host)

从接口复制的说明: FileSplitAssigner

Gets the next split.

When this method returns an empty Optional, then the set of splits is assumed to be done and the source will finish once the readers finished their current splits.

指定者:

getNext 在接口中 FileSplitAssigner

addSplits

public void addSplits(Collection<FileSourceSplit> splits)

从接口复制的说明: FileSplitAssigner

Adds a set of splits to this assigner. This happens for example when some split processing failed and the splits need to be re-added, or when new splits got discovered.

指定者:

addSplits 在接口中 FileSplitAssigner

remainingSplits

public Collection<FileSourceSplit> remainingSplits()

从接口复制的说明: FileSplitAssigner

Gets the remaining splits that this assigner has pending.

指定者:

remainingSplits 在接口中 FileSplitAssigner