org.apache.flink.connector.mongodb.source.enumerator.splitter

类 MongoSampleSplitter

java.lang.Object

org.apache.flink.connector.mongodb.source.enumerator.splitter.MongoSampleSplitter

@Internal
public class MongoSampleSplitter
extends Object

Sample Partitioner

Samples the collection to generate partitions.

Uses the average document size to split the collection into average sized chunks

The partitioner samples the collection, projects and sorts by the partition fields. Then uses every samplesPerPartition as the value to use to calculate the partition boundaries.

• scan.partition.size: The average size (MB) for each partition. Note: Uses the average document size to determine the number of documents per partition so may not be even. Defaults to: 64mb.
• scan.partition.samples: The number of samples to take per partition. Defaults to: 10. The total number of samples taken is calculated as: samples per partition * (count of documents / number of documents per partition).

构造器概要

构造器

构造器和说明
MongoSampleSplitter()

方法概要

限定符和类型	方法和说明
static Collection<MongoScanSourceSplit>	split(MongoSplitContext splitContext)

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

构造器详细资料

MongoSampleSplitter

public MongoSampleSplitter()

方法详细资料

split

public static Collection<MongoScanSourceSplit> split(MongoSplitContext splitContext)