Packages

o

org.apache.spark.sql.catalyst.expressions.codegen

GenerateUnsafeProjection

object GenerateUnsafeProjection extends CodeGenerator[Seq[Expression], UnsafeProjection]

Generates a Projection that returns an UnsafeRow.

It generates the code for all the expressions, computes the total length for all the columns (can be accessed via variables), and then copies the data into a scratch buffer space in the form of UnsafeRow (the scratch buffer will grow as needed).

Note

The returned UnsafeRow will be pointed to a scratch buffer inside the projection.

Linear Supertypes
CodeGenerator[Seq[Expression], UnsafeProjection], Logging, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. GenerateUnsafeProjection
  2. CodeGenerator
  3. Logging
  4. AnyRef
  5. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. Protected

Type Members

  1. implicit class LogStringContext extends AnyRef
    Definition Classes
    Logging
  2. case class Schema(dataType: DataType, nullable: Boolean) extends Product with Serializable

Value Members

  1. final def !=(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  2. final def ##: Int
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  4. final def asInstanceOf[T0]: T0
    Definition Classes
    Any
  5. def bind(in: Seq[Expression], inputSchema: Seq[Attribute]): Seq[Expression]

    Binds an input expression to a given input schema

    Binds an input expression to a given input schema

    Attributes
    protected
    Definition Classes
    GenerateUnsafeProjection → CodeGenerator
  6. def canSupport(dataType: DataType): Boolean

    Returns true iff we support this data type.

  7. def canonicalize(in: Seq[Expression]): Seq[Expression]

    Canonicalizes an input expression.

    Canonicalizes an input expression. Used to avoid double caching expressions that differ only cosmetically.

    Attributes
    protected
    Definition Classes
    GenerateUnsafeProjection → CodeGenerator
  8. def clone(): AnyRef
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.CloneNotSupportedException]) @IntrinsicCandidate() @native()
  9. def create(references: Seq[Expression]): UnsafeProjection

    Generates a class for a given input expression.

    Generates a class for a given input expression. Called when there is not cached code already available.

    Attributes
    protected
    Definition Classes
    GenerateUnsafeProjection → CodeGenerator
  10. def createCode(ctx: CodegenContext, expressions: Seq[Expression], useSubexprElimination: Boolean = false): ExprCode
  11. final def eq(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  12. def equals(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef → Any
  13. def generate(expressions: Seq[Expression], subexpressionEliminationEnabled: Boolean): UnsafeProjection
  14. def generate(expressions: Seq[Expression]): UnsafeProjection

    Generates the requested evaluator given already bound expression(s).

    Generates the requested evaluator given already bound expression(s).

    Definition Classes
    CodeGenerator
  15. def generate(expressions: Seq[Expression], inputSchema: Seq[Attribute]): UnsafeProjection

    Generates the requested evaluator binding the given expression(s) to the inputSchema.

    Generates the requested evaluator binding the given expression(s) to the inputSchema.

    Definition Classes
    CodeGenerator
  16. val genericMutableRowType: String
    Attributes
    protected
    Definition Classes
    CodeGenerator
  17. final def getClass(): Class[_ <: AnyRef]
    Definition Classes
    AnyRef → Any
    Annotations
    @IntrinsicCandidate() @native()
  18. def hashCode(): Int
    Definition Classes
    AnyRef → Any
    Annotations
    @IntrinsicCandidate() @native()
  19. def initializeLogIfNecessary(isInterpreter: Boolean, silent: Boolean): Boolean
    Attributes
    protected
    Definition Classes
    Logging
  20. def initializeLogIfNecessary(isInterpreter: Boolean): Unit
    Attributes
    protected
    Definition Classes
    Logging
  21. final def isInstanceOf[T0]: Boolean
    Definition Classes
    Any
  22. def isTraceEnabled(): Boolean
    Attributes
    protected
    Definition Classes
    Logging
  23. def log: Logger
    Attributes
    protected
    Definition Classes
    Logging
  24. def logDebug(msg: => String, throwable: Throwable): Unit
    Attributes
    protected
    Definition Classes
    Logging
  25. def logDebug(entry: LogEntry, throwable: Throwable): Unit
    Attributes
    protected
    Definition Classes
    Logging
  26. def logDebug(entry: LogEntry): Unit
    Attributes
    protected
    Definition Classes
    Logging
  27. def logDebug(msg: => String): Unit
    Attributes
    protected
    Definition Classes
    Logging
  28. def logError(msg: => String, throwable: Throwable): Unit
    Attributes
    protected
    Definition Classes
    Logging
  29. def logError(entry: LogEntry, throwable: Throwable): Unit
    Attributes
    protected
    Definition Classes
    Logging
  30. def logError(entry: LogEntry): Unit
    Attributes
    protected
    Definition Classes
    Logging
  31. def logError(msg: => String): Unit
    Attributes
    protected
    Definition Classes
    Logging
  32. def logInfo(msg: => String, throwable: Throwable): Unit
    Attributes
    protected
    Definition Classes
    Logging
  33. def logInfo(entry: LogEntry, throwable: Throwable): Unit
    Attributes
    protected
    Definition Classes
    Logging
  34. def logInfo(entry: LogEntry): Unit
    Attributes
    protected
    Definition Classes
    Logging
  35. def logInfo(msg: => String): Unit
    Attributes
    protected
    Definition Classes
    Logging
  36. def logName: String
    Attributes
    protected
    Definition Classes
    Logging
  37. def logTrace(msg: => String, throwable: Throwable): Unit
    Attributes
    protected
    Definition Classes
    Logging
  38. def logTrace(entry: LogEntry, throwable: Throwable): Unit
    Attributes
    protected
    Definition Classes
    Logging
  39. def logTrace(entry: LogEntry): Unit
    Attributes
    protected
    Definition Classes
    Logging
  40. def logTrace(msg: => String): Unit
    Attributes
    protected
    Definition Classes
    Logging
  41. def logWarning(msg: => String, throwable: Throwable): Unit
    Attributes
    protected
    Definition Classes
    Logging
  42. def logWarning(entry: LogEntry, throwable: Throwable): Unit
    Attributes
    protected
    Definition Classes
    Logging
  43. def logWarning(entry: LogEntry): Unit
    Attributes
    protected
    Definition Classes
    Logging
  44. def logWarning(msg: => String): Unit
    Attributes
    protected
    Definition Classes
    Logging
  45. final def ne(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  46. def newCodeGenContext(): CodegenContext

    Create a new codegen context for expression evaluator, used to store those expressions that don't support codegen

    Create a new codegen context for expression evaluator, used to store those expressions that don't support codegen

    Definition Classes
    CodeGenerator
  47. final def notify(): Unit
    Definition Classes
    AnyRef
    Annotations
    @IntrinsicCandidate() @native()
  48. final def notifyAll(): Unit
    Definition Classes
    AnyRef
    Annotations
    @IntrinsicCandidate() @native()
  49. final def synchronized[T0](arg0: => T0): T0
    Definition Classes
    AnyRef
  50. def toString(): String
    Definition Classes
    AnyRef → Any
  51. final def wait(arg0: Long, arg1: Int): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.InterruptedException])
  52. final def wait(arg0: Long): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.InterruptedException]) @native()
  53. final def wait(): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.InterruptedException])
  54. def withLogContext(context: Map[String, String])(body: => Unit): Unit
    Attributes
    protected
    Definition Classes
    Logging

Deprecated Value Members

  1. def finalize(): Unit
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.Throwable]) @Deprecated
    Deprecated

    (Since version 9)

Inherited from CodeGenerator[Seq[Expression], UnsafeProjection]

Inherited from Logging

Inherited from AnyRef

Inherited from Any

Ungrouped