Packages

o

org.apache.spark.sql.execution.streaming

TransformWithStateKeyValueRowSchemaUtils

object TransformWithStateKeyValueRowSchemaUtils

Helper object for getting schema of key/value row that are used in state schema files and to be passed into RocksDBStateKey(/Value)Encoder.

Linear Supertypes
AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. TransformWithStateKeyValueRowSchemaUtils
  2. AnyRef
  3. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. Protected

Value Members

  1. final def !=(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  2. final def ##: Int
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  4. final def asInstanceOf[T0]: T0
    Definition Classes
    Any
  5. def clone(): AnyRef
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.CloneNotSupportedException]) @IntrinsicCandidate() @native()
  6. final def eq(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  7. def equals(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef → Any
  8. final def getClass(): Class[_ <: AnyRef]
    Definition Classes
    AnyRef → Any
    Annotations
    @IntrinsicCandidate() @native()
  9. def getCompositeKeySchema(groupingKeySchema: StructType, userKeySchema: StructType): StructType

    Creates a schema that is the concatenation of the grouping key and a user-defined key.

    Creates a schema that is the concatenation of the grouping key and a user-defined key. This is used by MapState to create a composite key that is then treated as an "elementKey" by OneToOneTTLState.

  10. def getExpirationMsRowSchema(): StructType

    Represents the schema of a single long value, which is used to store the expiration timestamp of elements in the minimum index, managed by OneToManyTTLState.

  11. def getTTLRowKeySchema(keySchema: StructType): StructType

    Represents the schema of keys in the TTL index, managed by TTLState implementations.

    Represents the schema of keys in the TTL index, managed by TTLState implementations. There is no value associated with entries in the TTL index, so there is no method called, for example, getTTLValueSchema.

  12. def getValueSchemaWithTTL(schema: StructType, hasTTL: Boolean): StructType

    Represents the schema of an element with TTL in the primary index.

    Represents the schema of an element with TTL in the primary index. We store the expiration of each value along with the value itself, since each value has its own TTL. It is used as the value schema of every value, for every stateful variable.

  13. def hashCode(): Int
    Definition Classes
    AnyRef → Any
    Annotations
    @IntrinsicCandidate() @native()
  14. final def isInstanceOf[T0]: Boolean
    Definition Classes
    Any
  15. final def ne(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  16. final def notify(): Unit
    Definition Classes
    AnyRef
    Annotations
    @IntrinsicCandidate() @native()
  17. final def notifyAll(): Unit
    Definition Classes
    AnyRef
    Annotations
    @IntrinsicCandidate() @native()
  18. final def synchronized[T0](arg0: => T0): T0
    Definition Classes
    AnyRef
  19. def toString(): String
    Definition Classes
    AnyRef → Any
  20. final def wait(arg0: Long, arg1: Int): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.InterruptedException])
  21. final def wait(arg0: Long): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.InterruptedException]) @native()
  22. final def wait(): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.InterruptedException])

Deprecated Value Members

  1. def finalize(): Unit
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.Throwable]) @Deprecated
    Deprecated

    (Since version 9)

Inherited from AnyRef

Inherited from Any

Ungrouped