object DeduplicateUnionChildOutput
Deduplicates columns with same ExprIds in single Union child output, by placing aliases on non-first duplicates.
Linear Supertypes
Ordering
- Alphabetic
- By Inheritance
Inherited
- DeduplicateUnionChildOutput
- AnyRef
- Any
- Hide All
- Show All
Visibility
- Public
- Protected
Value Members
- final def !=(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
- final def ##: Int
- Definition Classes
- AnyRef → Any
- final def ==(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
- final def asInstanceOf[T0]: T0
- Definition Classes
- Any
- def clone(): AnyRef
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.CloneNotSupportedException]) @IntrinsicCandidate() @native()
- def deduplicateOutputPerChild(union: Union): Union
Deduplicate expression IDs at the scope of each individual child output.
Deduplicate expression IDs at the scope of each individual child output. This is necessary to handle the following case:
-- The correct answer is (1, 1), (1, 2). Without deduplication it would be (1, 1), because -- aggregation would be done only based on the first column. SELECT a, a FROM VALUES (1, 1), (1, 2) AS t1 (a, b) UNION SELECT a, b FROM VALUES (1, 1), (1, 2) AS t2 (a, b)
Putting Alias introduces a new expression ID for the attribute duplicates in the output. We also add
is_duplicatemetadata so that AttributeSeq.getCandidatesForResolution doesn't produce conflicting candidates when resolving names in the upper Project - this is technically still the same attribute.See SPARK-37865 for more details.
- final def eq(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
- def equals(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef → Any
- final def getClass(): Class[_ <: AnyRef]
- Definition Classes
- AnyRef → Any
- Annotations
- @IntrinsicCandidate() @native()
- def hashCode(): Int
- Definition Classes
- AnyRef → Any
- Annotations
- @IntrinsicCandidate() @native()
- final def isInstanceOf[T0]: Boolean
- Definition Classes
- Any
- final def ne(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
- final def notify(): Unit
- Definition Classes
- AnyRef
- Annotations
- @IntrinsicCandidate() @native()
- final def notifyAll(): Unit
- Definition Classes
- AnyRef
- Annotations
- @IntrinsicCandidate() @native()
- final def synchronized[T0](arg0: => T0): T0
- Definition Classes
- AnyRef
- def toString(): String
- Definition Classes
- AnyRef → Any
- final def wait(arg0: Long, arg1: Int): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.InterruptedException])
- final def wait(arg0: Long): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.InterruptedException]) @native()
- final def wait(): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.InterruptedException])
Deprecated Value Members
- def finalize(): Unit
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.Throwable]) @Deprecated
- Deprecated
(Since version 9)