Type Members

1.  trait AbstractBatchBackfillingCommitCoordinatorClient extends CommitCoordinatorClient with LoggingShims

   An abstract CommitCoordinatorClient which triggers backfills every n commits.

   An abstract CommitCoordinatorClient which triggers backfills every n commits. - every commit version which satisfies commitVersion % batchSize == 0 will trigger a backfill.

2.  trait CatalogOwnedCommitCoordinatorBuilder extends CommitCoordinatorBuilder

   An extended builder interface for CommitCoordinatorClient with CatalogOwned table feature

3.  trait CommitCoordinatorBuilder extends AnyRef

   A builder interface for CommitCoordinatorClient

4.  class InMemoryCommitCoordinator extends AbstractBatchBackfillingCommitCoordinatorClient
5.  case class InMemoryCommitCoordinatorBuilder(batchSize: Long) extends CatalogOwnedCommitCoordinatorBuilder with Product with Serializable

   The InMemoryCommitCoordinatorBuilder class is responsible for creating singleton instances of InMemoryCommitCoordinator with the specified batchSize.

6.  class InMemoryUCClient extends UCClient

   An in-memory implementation of UCClient for testing purposes.

   An in-memory implementation of UCClient for testing purposes. This implementation simulates Unity Catalog operations without actually connecting to a remote service. It maintains all state in memory in InMemoryUCCommitCoordinator

   This class provides a lightweight way to test Delta table operations that would normally require interaction with the Unity Catalog.

   Example usage:

   val metastoreId = "test-metastore"
   val ucCommitCoordinator = new InMemoryUCCommitCoordinator()
   val client = new InMemoryUCClient(metastoreId, ucCommitCoordinator)
   
   // Use the client for testing
   val getCommitsResponse = client.getCommits(
       "tableId",
       new URI("tableUri"),
       Optional.empty(),
       Optional.empty())

7.  class InMemoryUCCommitCoordinator extends AnyRef

   A mock UC commit coordinator for testing purposes.

8.  case class TableCommitCoordinatorClient(commitCoordinatorClient: CommitCoordinatorClient, logPath: Path, tableConf: Map[String, String], hadoopConf: Configuration, logStore: LogStore) extends Product with Serializable

   A wrapper around CommitCoordinatorClient that provides a more user-friendly API for committing/ accessing commits to a specific table.

   A wrapper around CommitCoordinatorClient that provides a more user-friendly API for committing/ accessing commits to a specific table. This class takes care of passing the table specific configuration to the underlying CommitCoordinatorClient e.g. logPath / logStore / coordinatedCommitsTableConf / hadoopConf.

   commitCoordinatorClient

   the underlying CommitCoordinatorClient

   logPath

   the path to the log directory

   tableConf

   the table specific coordinated-commits configuration

   hadoopConf

   hadoop configuration

   logStore

   the log store

9.  trait UCClientFactory extends AnyRef