case class DeltaSharingSourceOffset(sourceVersion: Long, tableId: String, tableVersion: Long, index: Long, isStartingVersion: Boolean) extends Offset with Product with Serializable

Tracks how far we processed in when reading changes from the Sharing Server.

sourceVersion

The version of serialization that this offset is encoded with.

tableId

The id of the table we are reading from. Used to detect misconfiguration when restarting a query.

tableVersion

The version of the table that we are currently processing.

index

The index in the sequence of AddFiles in this version. Used to break large commits into multiple batches. This index is created by sorting on url.

isStartingVersion

Whether this offset denotes a query that is starting rather than processing changes. When starting a new query, we first process all data present in the table at the start and then move on to processing new data that has arrived.

Linear Supertypes
Serializable, Product, Equals, Offset, Offset, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. DeltaSharingSourceOffset
  2. Serializable
  3. Product
  4. Equals
  5. Offset
  6. Offset
  7. AnyRef
  8. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. Protected

Instance Constructors

  1. new DeltaSharingSourceOffset(sourceVersion: Long, tableId: String, tableVersion: Long, index: Long, isStartingVersion: Boolean)

    sourceVersion

    The version of serialization that this offset is encoded with.

    tableId

    The id of the table we are reading from. Used to detect misconfiguration when restarting a query.

    tableVersion

    The version of the table that we are currently processing.

    index

    The index in the sequence of AddFiles in this version. Used to break large commits into multiple batches. This index is created by sorting on url.

    isStartingVersion

    Whether this offset denotes a query that is starting rather than processing changes. When starting a new query, we first process all data present in the table at the start and then move on to processing new data that has arrived.

Value Members

  1. final def !=(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  2. final def ##: Int
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  4. final def asInstanceOf[T0]: T0
    Definition Classes
    Any
  5. def clone(): AnyRef
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.CloneNotSupportedException]) @IntrinsicCandidate() @native()
  6. def compare(otherOffset: DeltaSharingSourceOffset): Int

    Compare two DeltaSharingSourceOffsets which are on the same table.

    Compare two DeltaSharingSourceOffsets which are on the same table.

    returns

    0 for equivalent offsets. negative if this offset is less than otherOffset. Positive if this offset is greater than otherOffset

  7. final def eq(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  8. def equals(arg0: AnyRef): Boolean
    Definition Classes
    Offset → AnyRef → Any
  9. final def getClass(): Class[_ <: AnyRef]
    Definition Classes
    AnyRef → Any
    Annotations
    @IntrinsicCandidate() @native()
  10. def hashCode(): Int
    Definition Classes
    Offset → AnyRef → Any
  11. val index: Long
  12. final def isInstanceOf[T0]: Boolean
    Definition Classes
    Any
  13. val isStartingVersion: Boolean
  14. def json(): String
    Definition Classes
    DeltaSharingSourceOffset → Offset
  15. final def ne(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  16. final def notify(): Unit
    Definition Classes
    AnyRef
    Annotations
    @IntrinsicCandidate() @native()
  17. final def notifyAll(): Unit
    Definition Classes
    AnyRef
    Annotations
    @IntrinsicCandidate() @native()
  18. def productElementNames: Iterator[String]
    Definition Classes
    Product
  19. val sourceVersion: Long
  20. final def synchronized[T0](arg0: => T0): T0
    Definition Classes
    AnyRef
  21. val tableId: String
  22. val tableVersion: Long
  23. def toString(): String
    Definition Classes
    Offset → AnyRef → Any
  24. final def wait(arg0: Long, arg1: Int): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.InterruptedException])
  25. final def wait(arg0: Long): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.InterruptedException]) @native()
  26. final def wait(): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.InterruptedException])

Deprecated Value Members

  1. def finalize(): Unit
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.Throwable]) @Deprecated
    Deprecated

    (Since version 9)

Inherited from Serializable

Inherited from Product

Inherited from Equals

Inherited from Offset

Inherited from Offset

Inherited from AnyRef

Inherited from Any

Ungrouped