Builds a balanced output predicate in bottom up approach, by applying binary operator op pair by pair on input predicates exprs recursively. Example: exprs = [a, b, c, d], op = And, returns (a And b) And (c And d) exprs = [a, b, c, d, e, f], op = And, returns ((a And b) And (c And d)) And (e And f)

Matches a plan whose output should be small enough to be used in broadcast join.

Returns true if expr can be evaluated using only the output of plan. This method can be used to determine when it is acceptable to move expression evaluation within a query plan.

For example consider a join between two relations R(a, b) and S(c, d).

- canEvaluate(EqualTo(a,b), R) returns true - canEvaluate(EqualTo(a,c), R) returns false - canEvaluate(Literal(1), R) returns true as literals CAN be evaluated on any plan

Returns true iff expr could be evaluated as a condition within join.

Returns a filter that its reference is a subset of outputSet and it contains the maximum constraints from condition. This is used for predicate pushdown. When there is no such filter, None is returned.

Find the origin of where the input references of expression exp were scanned in the tree of plan, and if they originate from a single leaf node. Returns optional tuple with Expression, undoing any projections and aliasing that has been done along the way from plan to origin, and the origin LeafNode plan from which all the exp

Returns whether an expression is likely to be selective

Merge an Alias(Alias(x)) into Alias(x) preserving metadata.

If the outer alias has explicit metadata, it is preserved. Else if the inner alias has explicit metadata, the result has explicit outer.metadata. Else both are deriving the metadata. the result is deriving metadata, with the union of noninheritable keys.

Merge any stack of aliases under the top-level alias, and then drops any aliases deeper in the expression tree. So Alias1(Alias2(Alias3(Foo(Alias4(x))))) becomes Alias5(Foo(x)) where Alias5 preserves the metadata of Alias{1,2,3} and the name and exprId of Alias1. Alias4 is simply removed.

Replace all attributes, that reference an alias, with the aliased expression

Replace all attributes, that reference an alias, with the aliased expression, but keep the name of the outermost attribute.

See. [SPARK-32290] LeftAnti(condition: Or(EqualTo(a=b), IsNull(EqualTo(a=b))) will almost certainly be planned as a Broadcast Nested Loop join, which is very time consuming because it's an O(M*N) calculation. But if it's a single column case O(M*N) calculation could be optimized into O(M) using hash lookup instead of loop lookup.