Class ColumnIndexFilter
java.lang.Object
org.apache.parquet.internal.filter2.columnindex.ColumnIndexFilter
- All Implemented Interfaces:
FilterPredicate.Visitor<RowRanges>
Filter implementation based on column indexes.
No filtering will be applied for columns where no column index is available.
Offset index is required for all the columns in the projection, therefore a
ColumnIndexStore.MissingOffsetIndexException will
be thrown from any visit methods if any of the required offset indexes is missing.-
Method Summary
Modifier and TypeMethodDescriptionstatic RowRangescalculateRowRanges(FilterCompat.Filter filter, ColumnIndexStore columnIndexStore, Set<org.apache.parquet.hadoop.metadata.ColumnPath> paths, long rowCount) Calculates the row ranges containing the indexes of the rows might match the specified filter.visit(Operators.And and) <T extends Comparable<T>>
RowRangesvisit(Operators.Contains<T> contains) <T extends Comparable<T>>
RowRangesvisit(Operators.Eq<T> eq) <T extends Comparable<T>>
RowRangesvisit(Operators.Gt<T> gt) <T extends Comparable<T>>
RowRangesvisit(Operators.GtEq<T> gtEq) <T extends Comparable<T>>
RowRangesvisit(Operators.In<T> in) <T extends Comparable<T>,U extends UserDefinedPredicate<T>>
RowRangesvisit(Operators.LogicalNotUserDefined<T, U> udp) <T extends Comparable<T>>
RowRangesvisit(Operators.Lt<T> lt) <T extends Comparable<T>>
RowRangesvisit(Operators.LtEq<T> ltEq) visit(Operators.Not not) <T extends Comparable<T>>
RowRangesvisit(Operators.NotEq<T> notEq) <T extends Comparable<T>>
RowRangesvisit(Operators.NotIn<T> notIn) visit(Operators.Or or) <T extends Comparable<T>,U extends UserDefinedPredicate<T>>
RowRangesvisit(Operators.UserDefined<T, U> udp)
-
Method Details
-
calculateRowRanges
public static RowRanges calculateRowRanges(FilterCompat.Filter filter, ColumnIndexStore columnIndexStore, Set<org.apache.parquet.hadoop.metadata.ColumnPath> paths, long rowCount) Calculates the row ranges containing the indexes of the rows might match the specified filter.- Parameters:
filter- to be used for filtering the rowscolumnIndexStore- the store for providing column/offset indexespaths- the paths of the columns used in the actual projection; a column not being part of the projection will be handled as containingnullvalues only even if the column has values written in the filerowCount- the total number of rows in the row-group- Returns:
- the ranges of the possible matching row indexes; the returned ranges will contain all the rows if any of the required offset index is missing
-
visit
- Specified by:
visitin interfaceFilterPredicate.Visitor<RowRanges>
-
visit
- Specified by:
visitin interfaceFilterPredicate.Visitor<RowRanges>
-
visit
- Specified by:
visitin interfaceFilterPredicate.Visitor<RowRanges>
-
visit
- Specified by:
visitin interfaceFilterPredicate.Visitor<RowRanges>
-
visit
- Specified by:
visitin interfaceFilterPredicate.Visitor<RowRanges>
-
visit
- Specified by:
visitin interfaceFilterPredicate.Visitor<RowRanges>
-
visit
- Specified by:
visitin interfaceFilterPredicate.Visitor<RowRanges>
-
visit
- Specified by:
visitin interfaceFilterPredicate.Visitor<RowRanges>
-
visit
- Specified by:
visitin interfaceFilterPredicate.Visitor<RowRanges>
-
visit
public <T extends Comparable<T>,U extends UserDefinedPredicate<T>> RowRanges visit(Operators.UserDefined<T, U> udp) - Specified by:
visitin interfaceFilterPredicate.Visitor<RowRanges>
-
visit
public <T extends Comparable<T>,U extends UserDefinedPredicate<T>> RowRanges visit(Operators.LogicalNotUserDefined<T, U> udp) - Specified by:
visitin interfaceFilterPredicate.Visitor<RowRanges>
-
visit
- Specified by:
visitin interfaceFilterPredicate.Visitor<RowRanges>
-
visit
- Specified by:
visitin interfaceFilterPredicate.Visitor<RowRanges>
-
visit
- Specified by:
visitin interfaceFilterPredicate.Visitor<RowRanges>
-