Package com.lancedb.lance.spark.read

Class FilterPushDown

java.lang.Object

com.lancedb.lance.spark.read.FilterPushDown

public class FilterPushDown
extends Object

Constructor Summary

Constructors

Constructor	Description
FilterPushDown()

Method Summary

Modifier and Type	Method	Description
static Optional<String>	compileFiltersToSqlWhereClause(org.apache.spark.sql.sources.Filter[] filters)	Create SQL 'where clause' from Spark filters.
static boolean	isFilterSupported(org.apache.spark.sql.sources.Filter filter)
static org.apache.spark.sql.sources.Filter[][]	processFilters(org.apache.spark.sql.sources.Filter[] filters)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

FilterPushDown

public FilterPushDown()

Method Details

compileFiltersToSqlWhereClause

public static Optional<String> compileFiltersToSqlWhereClause(org.apache.spark.sql.sources.Filter[] filters)

Create SQL 'where clause' from Spark filters.

Parameters:

filters - Supported spark filters

Returns:

where clause, or Optional.empty() if filters do not exist

processFilters

public static org.apache.spark.sql.sources.Filter[][] processFilters(org.apache.spark.sql.sources.Filter[] filters)

Parameters:

filters - filters to see if Lance supported the filter push down

Returns:

the accepted push down filters (row 0) and rejected post scan filters (row 1)

isFilterSupported

public static boolean isFilterSupported(org.apache.spark.sql.sources.Filter filter)