Class LogStoreProvider

Object
io.delta.kernel.defaults.internal.logstore.LogStoreProvider

public class LogStoreProvider extends Object
Utility class to provide the correct LogStore based on the scheme of the path.
  • Constructor Details

    • LogStoreProvider

      public LogStoreProvider()
  • Method Details

    • getLogStore

      public static io.delta.storage.LogStore getLogStore(org.apache.hadoop.conf.Configuration hadoopConf, String scheme)
      Get the LogStore instance for the given scheme and configuration. Callers can set io.delta.kernel.logStore.<scheme>.impl to specify the LogStore implementation to use for scheme.

      If not set, the default LogStore implementation (given below) for the scheme will be used.

      • s3, s3a, s3n: S3SingleDriverLogStore
      • abfs, abfss, adl, wasb, wasbs: AzureLogStore
      • gs: GCSLogStore
      • hdfs, file: HDFSLogStore
      • remaining: HDFSLogStore
      Parameters:
      hadoopConf - Configuration to use for creating the LogStore.
      scheme - Scheme of the path.
      Returns:
      LogStore instance.
      Throws:
      IllegalArgumentException - if the LogStore implementation is not found or can not be instantiated.