Package io.delta.kernel.internal

Class PaginatedScanImpl

Object

io.delta.kernel.internal.PaginatedScanImpl

All Implemented Interfaces:

PaginatedScan, Scan

public class PaginatedScanImpl
extends Object
implements PaginatedScan

Implementation of PaginatedScan

Constructor Summary

Constructors

Constructor	Description
PaginatedScanImpl(ScanImpl baseScan, String tablePath, long tableVersion, long pageSize, LogSegment logSegment, Optional<Predicate> predicate, Optional<Row> pageTokenRowOpt)

Method Summary

Modifier and Type	Method	Description
Optional<Predicate>	getRemainingFilter()	Get the remaining filter that is not guaranteed to be satisfied for the data Delta Kernel returns.
PaginatedScanFilesIterator	getScanFiles(Engine engine)	Get a paginated iterator of Scan files for the current page.
PaginatedScanFilesIterator	getScanFiles(Engine engine, boolean includeStates)
Row	getScanState(Engine engine)	Get the scan state associated with the current scan.

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

PaginatedScanImpl

public PaginatedScanImpl(ScanImpl baseScan,
 String tablePath,
 long tableVersion,
 long pageSize,
 LogSegment logSegment,
 Optional<Predicate> predicate,
 Optional<Row> pageTokenRowOpt)

Method Details

getRemainingFilter

public Optional<Predicate> getRemainingFilter()

Description copied from interface: Scan

Get the remaining filter that is not guaranteed to be satisfied for the data Delta Kernel returns. This filter is used by Delta Kernel to do data skipping when possible.

Specified by:

getRemainingFilter in interface Scan

Returns:

the remaining filter as a Predicate.

getScanState

public Row getScanState(Engine engine)

Description copied from interface: Scan

Get the scan state associated with the current scan. This state is common across all files in the scan to be read.

Specified by:

getScanState in interface Scan

Parameters:

engine - Engine instance to use in Delta Kernel.

Returns:

Scan state in Row format.

getScanFiles

public PaginatedScanFilesIterator getScanFiles(Engine engine)

Description copied from interface: PaginatedScan

Get a paginated iterator of Scan files for the current page.

Specified by:

getScanFiles in interface PaginatedScan

Specified by:

getScanFiles in interface Scan

Parameters:

engine - Engine instance to use in Delta Kernel.

Returns:

iterator of FilteredColumnarBatchs for the current page.

See Also:

getScanFiles

public PaginatedScanFilesIterator getScanFiles(Engine engine,
 boolean includeStates)