Packages

c

org.apache.spark.sql.internal

ReadOnlySQLConf

class ReadOnlySQLConf extends SQLConf

A readonly SQLConf that will be created by tasks running at the executor side. It reads the configs from the local properties which are propagated from driver to executors.

Linear Supertypes
SQLConf, SqlApiConf, Logging, Serializable, Serializable, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. ReadOnlySQLConf
  2. SQLConf
  3. SqlApiConf
  4. Logging
  5. Serializable
  6. Serializable
  7. AnyRef
  8. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new ReadOnlySQLConf(context: TaskContext)

Value Members

  1. final def !=(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  4. def adaptiveExecutionEnabled: Boolean
    Definition Classes
    SQLConf
  5. def adaptiveExecutionLogLevel: String
    Definition Classes
    SQLConf
  6. def addSingleFileInAddFile: Boolean
    Definition Classes
    SQLConf
  7. def advancedPartitionPredicatePushdownEnabled: Boolean
    Definition Classes
    SQLConf
  8. def allowAutoGeneratedAliasForView: Boolean
    Definition Classes
    SQLConf
  9. def allowCreatingUDTFromString: Boolean
    Definition Classes
    SQLConf → SqlApiConf
  10. def allowNegativeScaleOfDecimalEnabled: Boolean
    Definition Classes
    SQLConf → SqlApiConf
  11. def allowNonEmptyLocationInCTAS: Boolean
    Definition Classes
    SQLConf
  12. def allowStarWithSingleTableIdentifierInCount: Boolean
    Definition Classes
    SQLConf
  13. def allowedDynamicUDTClasses: Seq[String]
    Definition Classes
    SQLConf → SqlApiConf
  14. def allowsTempViewCreationWithMultipleNameparts: Boolean
    Definition Classes
    SQLConf
  15. def analyzerMaxIterations: Int

    ************************ Spark SQL Params/Hints *******************

    ************************ Spark SQL Params/Hints *******************

    Definition Classes
    SQLConf
  16. def ansiEnabled: Boolean
    Definition Classes
    SQLConf → SqlApiConf
  17. def ansiRelationPrecedence: Boolean
    Definition Classes
    SQLConf
  18. def arrowLocalRelationThreshold: Long
    Definition Classes
    SQLConf
  19. def arrowMaxRecordsPerBatch: Int
    Definition Classes
    SQLConf
  20. def arrowPySparkEnabled: Boolean
    Definition Classes
    SQLConf
  21. def arrowPySparkFallbackEnabled: Boolean
    Definition Classes
    SQLConf
  22. def arrowPySparkSelfDestructEnabled: Boolean
    Definition Classes
    SQLConf
  23. def arrowSafeTypeConversion: Boolean
    Definition Classes
    SQLConf
  24. def arrowSparkREnabled: Boolean
    Definition Classes
    SQLConf
  25. def arrowUseLargeVarTypes: Boolean
    Definition Classes
    SQLConf
  26. final def asInstanceOf[T0]: T0
    Definition Classes
    Any
  27. def autoBroadcastJoinThreshold: Long
    Definition Classes
    SQLConf
  28. def autoBucketedScanEnabled: Boolean
    Definition Classes
    SQLConf
  29. def autoSizeUpdateEnabled: Boolean
    Definition Classes
    SQLConf
  30. def avroCompressionCodec: String
    Definition Classes
    SQLConf
  31. def avroDeflateLevel: Int
    Definition Classes
    SQLConf
  32. def avroFilterPushDown: Boolean
    Definition Classes
    SQLConf
  33. def broadcastHashJoinOutputPartitioningExpandLimit: Int
    Definition Classes
    SQLConf
  34. def broadcastTimeout: Long
    Definition Classes
    SQLConf
  35. def bucketingEnabled: Boolean
    Definition Classes
    SQLConf
  36. def bucketingMaxBuckets: Int
    Definition Classes
    SQLConf
  37. def cacheVectorizedReaderEnabled: Boolean
    Definition Classes
    SQLConf
  38. def cartesianProductExecBufferInMemoryThreshold: Int
    Definition Classes
    SQLConf
  39. def cartesianProductExecBufferSpillThreshold: Int
    Definition Classes
    SQLConf
  40. def caseSensitiveAnalysis: Boolean
    Definition Classes
    SQLConf → SqlApiConf
  41. def caseSensitiveInferenceMode: SQLConf.HiveCaseSensitiveInferenceMode.Value
    Definition Classes
    SQLConf
  42. def castDatetimeToString: Boolean
    Definition Classes
    SQLConf
  43. def cboEnabled: Boolean
    Definition Classes
    SQLConf
  44. def charVarcharAsString: Boolean
    Definition Classes
    SQLConf → SqlApiConf
  45. def checkpointLocation: Option[String]
    Definition Classes
    SQLConf
  46. def checkpointRenamedFileCheck: Boolean
    Definition Classes
    SQLConf
  47. def chunkBase64StringEnabled: Boolean
    Definition Classes
    SQLConf
  48. def clear(): Unit
    Definition Classes
    ReadOnlySQLConf → SQLConf
  49. def cliPrintHeader: Boolean
    Definition Classes
    SQLConf
  50. def clone(): SQLConf
    Definition Classes
    ReadOnlySQLConf → SQLConf → AnyRef
  51. def coalesceBucketsInJoinEnabled: Boolean
    Definition Classes
    SQLConf
  52. def coalesceBucketsInJoinMaxBucketRatio: Int
    Definition Classes
    SQLConf
  53. def coalesceShufflePartitionsEnabled: Boolean
    Definition Classes
    SQLConf
  54. def codegenCacheMaxEntries: Int
    Definition Classes
    SQLConf
  55. def codegenComments: Boolean
    Definition Classes
    SQLConf
  56. def codegenFactoryMode: String
    Definition Classes
    SQLConf
  57. def codegenFallback: Boolean
    Definition Classes
    SQLConf
  58. def codegenSplitAggregateFunc: Boolean
    Definition Classes
    SQLConf
  59. def columnBatchSize: Int
    Definition Classes
    SQLConf
  60. def columnNameOfCorruptRecord: String
    Definition Classes
    SQLConf
  61. def concatBinaryAsString: Boolean
    Definition Classes
    SQLConf
  62. def constraintPropagationEnabled: Boolean
    Definition Classes
    SQLConf
  63. def contains(key: String): Boolean

    Return whether a given key is set in this SQLConf.

    Return whether a given key is set in this SQLConf.

    Definition Classes
    SQLConf
  64. def continuousStreamingEpochBacklogQueueSize: Int
    Definition Classes
    SQLConf
  65. def continuousStreamingExecutorPollIntervalMs: Long
    Definition Classes
    SQLConf
  66. def continuousStreamingExecutorQueueSize: Int
    Definition Classes
    SQLConf
  67. def convertCTAS: Boolean
    Definition Classes
    SQLConf
  68. def copy(entries: (ConfigEntry[_], Any)*): SQLConf
    Definition Classes
    ReadOnlySQLConf → SQLConf
  69. def crossJoinEnabled: Boolean
    Definition Classes
    SQLConf
  70. def csvColumnPruning: Boolean
    Definition Classes
    SQLConf
  71. def csvEnableDateTimeParsingFallback: Option[Boolean]
    Definition Classes
    SQLConf
  72. def csvExpressionOptimization: Boolean
    Definition Classes
    SQLConf
  73. def csvFilterPushDown: Boolean
    Definition Classes
    SQLConf
  74. def dataFramePivotMaxValues: Int
    Definition Classes
    SQLConf
  75. def dataFrameRetainGroupColumns: Boolean
    Definition Classes
    SQLConf
  76. def dataFrameSelfJoinAutoResolveAmbiguity: Boolean
    Definition Classes
    SQLConf
  77. def datetimeJava8ApiEnabled: Boolean
    Definition Classes
    SQLConf → SqlApiConf
  78. def decimalOperationsAllowPrecisionLoss: Boolean
    Definition Classes
    SQLConf
  79. def decorrelateInnerQueryEnabled: Boolean
    Definition Classes
    SQLConf
  80. def defaultColumnAllowedProviders: String
    Definition Classes
    SQLConf
  81. def defaultDataSourceName: String
    Definition Classes
    SQLConf
  82. def defaultDatabase: String
    Definition Classes
    SQLConf
  83. def defaultNumShufflePartitions: Int
    Definition Classes
    SQLConf
  84. def defaultSizeInBytes: Long
    Definition Classes
    SQLConf
  85. def disabledJdbcConnectionProviders: String
    Definition Classes
    SQLConf
  86. def disabledV2StreamingMicroBatchReaders: String
    Definition Classes
    SQLConf
  87. def disabledV2StreamingWriters: String
    Definition Classes
    SQLConf
  88. def doubleQuotedIdentifiers: Boolean
    Definition Classes
    SQLConf → SqlApiConf
  89. def dynamicPartitionPruningEnabled: Boolean
    Definition Classes
    SQLConf
  90. def dynamicPartitionPruningFallbackFilterRatio: Double
    Definition Classes
    SQLConf
  91. def dynamicPartitionPruningReuseBroadcastOnly: Boolean
    Definition Classes
    SQLConf
  92. def dynamicPartitionPruningUseStats: Boolean
    Definition Classes
    SQLConf
  93. def eltOutputAsString: Boolean
    Definition Classes
    SQLConf
  94. def enableDefaultColumns: Boolean
    Definition Classes
    SQLConf
  95. def enableRadixSort: Boolean
    Definition Classes
    SQLConf
  96. def enableTwoLevelAggMap: Boolean
    Definition Classes
    SQLConf
  97. def enableVectorizedHashMap: Boolean
    Definition Classes
    SQLConf
  98. def enforceReservedKeywords: Boolean
    Definition Classes
    SQLConf → SqlApiConf
  99. final def eq(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  100. def equals(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  101. def errorMessageFormat: ErrorMessageFormat.Value
    Definition Classes
    SQLConf
  102. def escapedStringLiterals: Boolean
    Definition Classes
    SQLConf
  103. def exchangeReuseEnabled: Boolean
    Definition Classes
    SQLConf
  104. def exponentLiteralAsDecimalEnabled: Boolean
    Definition Classes
    SQLConf → SqlApiConf
  105. def fallBackToHdfsForStatsEnabled: Boolean
    Definition Classes
    SQLConf
  106. def fastFailFileFormatOutput: Boolean
    Definition Classes
    SQLConf
  107. def fastHashAggregateRowMaxCapacityBit: Int
    Definition Classes
    SQLConf
  108. def fetchShuffleBlocksInBatch: Boolean
    Definition Classes
    SQLConf
  109. def fileCommitProtocolClass: String
    Definition Classes
    SQLConf
  110. def fileCompressionFactor: Double
    Definition Classes
    SQLConf
  111. def fileSinkLogCleanupDelay: Long
    Definition Classes
    SQLConf
  112. def fileSinkLogCompactInterval: Int
    Definition Classes
    SQLConf
  113. def fileSinkLogDeletion: Boolean
    Definition Classes
    SQLConf
  114. def fileSourceLogCleanupDelay: Long
    Definition Classes
    SQLConf
  115. def fileSourceLogCompactInterval: Int
    Definition Classes
    SQLConf
  116. def fileSourceLogDeletion: Boolean
    Definition Classes
    SQLConf
  117. def fileStreamSinkMetadataIgnored: Boolean
    Definition Classes
    SQLConf
  118. def filesMaxPartitionBytes: Long
    Definition Classes
    SQLConf
  119. def filesMaxPartitionNum: Option[Int]
    Definition Classes
    SQLConf
  120. def filesMinPartitionNum: Option[Int]
    Definition Classes
    SQLConf
  121. def filesOpenCostInBytes: Long
    Definition Classes
    SQLConf
  122. def filesourcePartitionFileCacheSize: Long
    Definition Classes
    SQLConf
  123. def finalize(): Unit
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  124. def gatherFastStats: Boolean
    Definition Classes
    SQLConf
  125. def getAllConfs: Map[String, String]

    Return all the configuration properties that have been set (i.e.

    Return all the configuration properties that have been set (i.e. not the default). This creates a new copy of the config properties in the form of a Map.

    Definition Classes
    SQLConf
  126. def getAllDefinedConfs: Seq[(String, String, String, String)]

    Return all the configuration definitions that have been defined in SQLConf.

    Return all the configuration definitions that have been defined in SQLConf. Each definition contains key, defaultValue and doc.

    Definition Classes
    SQLConf
  127. final def getClass(): Class[_]
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  128. def getConf[T](entry: OptionalConfigEntry[T]): Option[T]

    Return the value of an optional Spark SQL configuration property for the given key.

    Return the value of an optional Spark SQL configuration property for the given key. If the key is not set yet, returns None.

    Definition Classes
    SQLConf
  129. def getConf[T](entry: ConfigEntry[T]): T

    Return the value of Spark SQL configuration property for the given key.

    Return the value of Spark SQL configuration property for the given key. If the key is not set yet, return defaultValue in ConfigEntry.

    Definition Classes
    SQLConf
  130. def getConf[T](entry: ConfigEntry[T], defaultValue: T): T

    Return the value of Spark SQL configuration property for the given key.

    Return the value of Spark SQL configuration property for the given key. If the key is not set yet, return defaultValue. This is useful when defaultValue in ConfigEntry is not the desired one.

    Definition Classes
    SQLConf
  131. def getConfString(key: String, defaultValue: String): String

    Return the string value of Spark SQL configuration property for the given key.

    Return the string value of Spark SQL configuration property for the given key. If the key is not set yet, return defaultValue.

    Definition Classes
    SQLConf
  132. def getConfString(key: String): String

    Return the value of Spark SQL configuration property for the given key.

    Return the value of Spark SQL configuration property for the given key.

    Definition Classes
    SQLConf
    Annotations
    @throws( "if key is not set" )
  133. def groupByAliases: Boolean
    Definition Classes
    SQLConf
  134. def groupByOrdinal: Boolean
    Definition Classes
    SQLConf
  135. def groupingIdWithAppendedUserGroupByEnabled: Boolean
    Definition Classes
    SQLConf
  136. def hashCode(): Int
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  137. def hintErrorHandler: HintErrorHandler

    Returns the error handler for handling hint errors.

    Returns the error handler for handling hint errors.

    Definition Classes
    SQLConf
  138. def histogramEnabled: Boolean
    Definition Classes
    SQLConf
  139. def histogramNumBins: Int
    Definition Classes
    SQLConf
  140. def histogramNumericPropagateInputType: Boolean
    Definition Classes
    SQLConf
  141. def hiveThriftServerSingleSession: Boolean
    Definition Classes
    SQLConf
  142. def hugeMethodLimit: Int
    Definition Classes
    SQLConf
  143. def ignoreCorruptFiles: Boolean
    Definition Classes
    SQLConf
  144. def ignoreDataLocality: Boolean
    Definition Classes
    SQLConf
  145. def ignoreMissingFiles: Boolean
    Definition Classes
    SQLConf
  146. def ignoreMissingParquetFieldId: Boolean
    Definition Classes
    SQLConf
  147. def inMemoryPartitionPruning: Boolean
    Definition Classes
    SQLConf
  148. def inMemoryTableScanStatisticsEnabled: Boolean
    Definition Classes
    SQLConf
  149. def inferDictAsStruct: Boolean
    Definition Classes
    SQLConf
  150. def initializeLogIfNecessary(isInterpreter: Boolean, silent: Boolean): Boolean
    Attributes
    protected
    Definition Classes
    Logging
  151. def initializeLogIfNecessary(isInterpreter: Boolean): Unit
    Attributes
    protected
    Definition Classes
    Logging
  152. def integerGroupingIdEnabled: Boolean
    Definition Classes
    SQLConf
  153. final def isInstanceOf[T0]: Boolean
    Definition Classes
    Any
  154. def isModifiable(key: String): Boolean
    Definition Classes
    SQLConf
  155. def isOrcSchemaMergingEnabled: Boolean
    Definition Classes
    SQLConf
  156. def isParquetBinaryAsString: Boolean
    Definition Classes
    SQLConf
  157. def isParquetINT96AsTimestamp: Boolean
    Definition Classes
    SQLConf
  158. def isParquetINT96TimestampConversion: Boolean
    Definition Classes
    SQLConf
  159. def isParquetSchemaMergingEnabled: Boolean
    Definition Classes
    SQLConf
  160. def isParquetSchemaRespectSummaries: Boolean
    Definition Classes
    SQLConf
  161. def isReplEagerEvalEnabled: Boolean
    Definition Classes
    SQLConf
  162. def isStateSchemaCheckEnabled: Boolean
    Definition Classes
    SQLConf
  163. def isTraceEnabled(): Boolean
    Attributes
    protected
    Definition Classes
    Logging
  164. def isUnsupportedOperationCheckEnabled: Boolean
    Definition Classes
    SQLConf
  165. def joinReorderCardWeight: Double
    Definition Classes
    SQLConf
  166. def joinReorderDPStarFilter: Boolean
    Definition Classes
    SQLConf
  167. def joinReorderDPThreshold: Int
    Definition Classes
    SQLConf
  168. def joinReorderEnabled: Boolean
    Definition Classes
    SQLConf
  169. def jsonEnableDateTimeParsingFallback: Option[Boolean]
    Definition Classes
    SQLConf
  170. def jsonEnablePartialResults: Boolean
    Definition Classes
    SQLConf
  171. def jsonExpressionOptimization: Boolean
    Definition Classes
    SQLConf
  172. def jsonFilterPushDown: Boolean
    Definition Classes
    SQLConf
  173. def jsonGeneratorIgnoreNullFields: Boolean
    Definition Classes
    SQLConf
  174. def jsonWriteNullIfWithDefaultValue: Boolean
    Definition Classes
    SQLConf
  175. def legacyInferArrayTypeFromFirstElement: Boolean
    Definition Classes
    SQLConf
  176. def legacyIntervalEnabled: Boolean
    Definition Classes
    SQLConf
  177. def legacyMsSqlServerNumericMappingEnabled: Boolean
    Definition Classes
    SQLConf
  178. def legacyNegativeIndexInArrayInsert: Boolean
    Definition Classes
    SQLConf
  179. def legacyParquetNanosAsLong: Boolean
    Definition Classes
    SQLConf
  180. def legacyPathOptionBehavior: Boolean
    Definition Classes
    SQLConf
  181. def legacySizeOfNull: Boolean
    Definition Classes
    SQLConf
  182. def legacyStatisticalAggregate: Boolean
    Definition Classes
    SQLConf
  183. def legacyTimeParserPolicy: LegacyBehaviorPolicy.Value
    Definition Classes
    SQLConf → SqlApiConf
  184. def limitInitialNumPartitions: Int
    Definition Classes
    SQLConf
  185. def limitScaleUpFactor: Int
    Definition Classes
    SQLConf
  186. def literalPickMinimumPrecision: Boolean
    Definition Classes
    SQLConf
  187. def log: Logger
    Attributes
    protected
    Definition Classes
    Logging
  188. def logDebug(msg: ⇒ String, throwable: Throwable): Unit
    Attributes
    protected
    Definition Classes
    Logging
  189. def logDebug(msg: ⇒ String): Unit
    Attributes
    protected
    Definition Classes
    Logging
  190. def logError(msg: ⇒ String, throwable: Throwable): Unit
    Attributes
    protected
    Definition Classes
    Logging
  191. def logError(msg: ⇒ String): Unit
    Attributes
    protected
    Definition Classes
    Logging
  192. def logInfo(msg: ⇒ String, throwable: Throwable): Unit
    Attributes
    protected
    Definition Classes
    Logging
  193. def logInfo(msg: ⇒ String): Unit
    Attributes
    protected
    Definition Classes
    Logging
  194. def logName: String
    Attributes
    protected
    Definition Classes
    Logging
  195. def logTrace(msg: ⇒ String, throwable: Throwable): Unit
    Attributes
    protected
    Definition Classes
    Logging
  196. def logTrace(msg: ⇒ String): Unit
    Attributes
    protected
    Definition Classes
    Logging
  197. def logWarning(msg: ⇒ String, throwable: Throwable): Unit
    Attributes
    protected
    Definition Classes
    Logging
  198. def logWarning(msg: ⇒ String): Unit
    Attributes
    protected
    Definition Classes
    Logging
  199. def loggingMaxLinesForCodegen: Int
    Definition Classes
    SQLConf
  200. def manageFilesourcePartitions: Boolean
    Definition Classes
    SQLConf
  201. def maxBatchesToRetainInMemory: Int
    Definition Classes
    SQLConf
  202. def maxConcurrentOutputFileWriters: Int
    Definition Classes
    SQLConf
  203. def maxMetadataStringLength: Int
    Definition Classes
    SQLConf
  204. def maxNestedViewDepth: Int
    Definition Classes
    SQLConf
  205. def maxPlanStringLength: Int
    Definition Classes
    SQLConf
  206. def maxRecordsPerFile: Long
    Definition Classes
    SQLConf
  207. def maxToStringFields: Int
    Definition Classes
    SQLConf → SqlApiConf
  208. def metadataCacheTTL: Long
    Definition Classes
    SQLConf
  209. def metastoreDropPartitionsByName: Boolean
    Definition Classes
    SQLConf
  210. def metastorePartitionPruning: Boolean
    Definition Classes
    SQLConf
  211. def metastorePartitionPruningFallbackOnException: Boolean
    Definition Classes
    SQLConf
  212. def metastorePartitionPruningFastFallback: Boolean
    Definition Classes
    SQLConf
  213. def metastorePartitionPruningInSetThreshold: Int
    Definition Classes
    SQLConf
  214. def methodSplitThreshold: Int
    Definition Classes
    SQLConf
  215. def minBatchesToRetain: Int
    Definition Classes
    SQLConf
  216. def nameNonStructGroupingKeyAsValue: Boolean
    Definition Classes
    SQLConf
  217. def ndvMaxError: Double
    Definition Classes
    SQLConf
  218. final def ne(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  219. def nestedPruningOnExpressions: Boolean
    Definition Classes
    SQLConf
  220. def nestedSchemaPruningEnabled: Boolean
    Definition Classes
    SQLConf
  221. def nonEmptyPartitionRatioForBroadcastJoin: Double
    Definition Classes
    SQLConf
  222. final def notify(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  223. final def notifyAll(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  224. def numShufflePartitions: Int
    Definition Classes
    SQLConf
  225. def objectAggSortBasedFallbackThreshold: Int
    Definition Classes
    SQLConf
  226. def offHeapColumnVectorEnabled: Boolean
    Definition Classes
    SQLConf
  227. def optimizeNullAwareAntiJoin: Boolean
    Definition Classes
    SQLConf
  228. def optimizerExcludedRules: Option[String]
    Definition Classes
    SQLConf
  229. def optimizerInSetConversionThreshold: Int
    Definition Classes
    SQLConf
  230. def optimizerInSetSwitchThreshold: Int
    Definition Classes
    SQLConf
  231. def optimizerMaxIterations: Int
    Definition Classes
    SQLConf
  232. def optimizerMetadataOnly: Boolean
    Definition Classes
    SQLConf
  233. def orcAggregatePushDown: Boolean
    Definition Classes
    SQLConf
  234. def orcCompressionCodec: String
    Definition Classes
    SQLConf
  235. def orcFilterPushDown: Boolean
    Definition Classes
    SQLConf
  236. def orcVectorizedReaderBatchSize: Int
    Definition Classes
    SQLConf
  237. def orcVectorizedReaderEnabled: Boolean
    Definition Classes
    SQLConf
  238. def orcVectorizedReaderNestedColumnEnabled: Boolean
    Definition Classes
    SQLConf
  239. def orcVectorizedWriterBatchSize: Int
    Definition Classes
    SQLConf
  240. def orderByOrdinal: Boolean
    Definition Classes
    SQLConf
  241. def pandasGroupedMapAssignColumnsByName: Boolean
    Definition Classes
    SQLConf
  242. def pandasStructHandlingMode: String
    Definition Classes
    SQLConf
  243. def pandasUDFBufferSize: Int
    Definition Classes
    SQLConf
  244. def parallelFileListingInStatsComputation: Boolean
    Definition Classes
    SQLConf
  245. def parallelPartitionDiscoveryParallelism: Int
    Definition Classes
    SQLConf
  246. def parallelPartitionDiscoveryThreshold: Int
    Definition Classes
    SQLConf
  247. def parquetAggregatePushDown: Boolean
    Definition Classes
    SQLConf
  248. def parquetCompressionCodec: String
    Definition Classes
    SQLConf
  249. def parquetFieldIdReadEnabled: Boolean
    Definition Classes
    SQLConf
  250. def parquetFieldIdWriteEnabled: Boolean
    Definition Classes
    SQLConf
  251. def parquetFilterPushDown: Boolean
    Definition Classes
    SQLConf
  252. def parquetFilterPushDownDate: Boolean
    Definition Classes
    SQLConf
  253. def parquetFilterPushDownDecimal: Boolean
    Definition Classes
    SQLConf
  254. def parquetFilterPushDownInFilterThreshold: Int
    Definition Classes
    SQLConf
  255. def parquetFilterPushDownStringPredicate: Boolean
    Definition Classes
    SQLConf
  256. def parquetFilterPushDownTimestamp: Boolean
    Definition Classes
    SQLConf
  257. def parquetInferTimestampNTZEnabled: Boolean
    Definition Classes
    SQLConf
  258. def parquetOutputCommitterClass: String
    Definition Classes
    SQLConf
  259. def parquetOutputTimestampType: SQLConf.ParquetOutputTimestampType.Value
    Definition Classes
    SQLConf
  260. def parquetRecordFilterEnabled: Boolean
    Definition Classes
    SQLConf
  261. def parquetVectorizedReaderBatchSize: Int
    Definition Classes
    SQLConf
  262. def parquetVectorizedReaderEnabled: Boolean
    Definition Classes
    SQLConf
  263. def parquetVectorizedReaderNestedColumnEnabled: Boolean
    Definition Classes
    SQLConf
  264. def partitionColumnTypeInferenceEnabled: Boolean
    Definition Classes
    SQLConf
  265. def partitionOverwriteMode: SQLConf.PartitionOverwriteMode.Value
    Definition Classes
    SQLConf
  266. def percentileAccuracy: Int
    Definition Classes
    SQLConf
  267. def planChangeBatches: Option[String]
    Definition Classes
    SQLConf
  268. def planChangeLogLevel: String
    Definition Classes
    SQLConf
  269. def planChangeRules: Option[String]
    Definition Classes
    SQLConf
  270. def planStatsEnabled: Boolean
    Definition Classes
    SQLConf
  271. def plannedWriteEnabled: Boolean
    Definition Classes
    SQLConf
  272. def preferSortMergeJoin: Boolean
    Definition Classes
    SQLConf
  273. def pysparkJVMStacktraceEnabled: Boolean
    Definition Classes
    SQLConf
  274. def pysparkSimplifiedTraceback: Boolean
    Definition Classes
    SQLConf
  275. def pysparkWorkerPythonExecutable: Option[String]
    Definition Classes
    SQLConf
  276. def rangeExchangeSampleSizePerPartition: Int
    Definition Classes
    SQLConf
  277. def readSideCharPadding: Boolean
    Definition Classes
    SQLConf
  278. val reader: ConfigReader
    Attributes
    protected
    Definition Classes
    ReadOnlySQLConf → SQLConf
  279. def redactOptions[K, V](options: Seq[(K, V)]): Seq[(K, V)]

    Redacts the given option map according to the description of SQL_OPTIONS_REDACTION_PATTERN.

    Redacts the given option map according to the description of SQL_OPTIONS_REDACTION_PATTERN.

    Definition Classes
    SQLConf
  280. def redactOptions[K, V](options: Map[K, V]): Map[K, V]

    Redacts the given option map according to the description of SQL_OPTIONS_REDACTION_PATTERN.

    Redacts the given option map according to the description of SQL_OPTIONS_REDACTION_PATTERN.

    Definition Classes
    SQLConf
  281. def replEagerEvalMaxNumRows: Int
    Definition Classes
    SQLConf
  282. def replEagerEvalTruncate: Int
    Definition Classes
    SQLConf
  283. def replaceDatabricksSparkAvroEnabled: Boolean
    Definition Classes
    SQLConf
  284. def replaceExceptWithFilter: Boolean
    Definition Classes
    SQLConf
  285. def resolver: Resolver

    Returns the Resolver for the current configuration, which can be used to determine if two identifiers are equal.

    Returns the Resolver for the current configuration, which can be used to determine if two identifiers are equal.

    Definition Classes
    SQLConf
  286. def runSQLonFile: Boolean
    Definition Classes
    SQLConf
  287. def runtimeFilterBloomFilterEnabled: Boolean
    Definition Classes
    SQLConf
  288. def runtimeFilterCreationSideThreshold: Long
    Definition Classes
    SQLConf
  289. def runtimeFilterSemiJoinReductionEnabled: Boolean
    Definition Classes
    SQLConf
  290. def runtimeRowLevelOperationGroupFilterEnabled: Boolean
    Definition Classes
    SQLConf
  291. def serializerNestedSchemaPruningEnabled: Boolean
    Definition Classes
    SQLConf
  292. def sessionLocalTimeZone: String
    Definition Classes
    SQLConf → SqlApiConf
  293. def sessionWindowBufferInMemoryThreshold: Int
    Definition Classes
    SQLConf
  294. def sessionWindowBufferSpillThreshold: Int
    Definition Classes
    SQLConf
  295. def setCommandRejectsSparkCoreConfs: Boolean
    Definition Classes
    SQLConf
  296. def setConf[T](entry: ConfigEntry[T], value: T): Unit

    Set the given Spark SQL configuration property.

    Set the given Spark SQL configuration property.

    Definition Classes
    SQLConf
  297. def setConf(props: Properties): Unit

    Set Spark SQL configuration properties.

    Set Spark SQL configuration properties.

    Definition Classes
    SQLConf
  298. def setConfString(key: String, value: String): Unit

    Set the given Spark SQL configuration property using a string value.

    Set the given Spark SQL configuration property using a string value.

    Definition Classes
    SQLConf
  299. def setConfWithCheck(key: String, value: String): Unit
    Attributes
    protected
    Definition Classes
    ReadOnlySQLConf → SQLConf
  300. def setOpsPrecedenceEnforced: Boolean
    Definition Classes
    SQLConf → SqlApiConf
  301. val settings: Map[String, String]
    Definition Classes
    ReadOnlySQLConf → SQLConf
  302. def sortBeforeRepartition: Boolean
    Definition Classes
    SQLConf
  303. def sortMergeJoinExecBufferInMemoryThreshold: Int
    Definition Classes
    SQLConf
  304. def sortMergeJoinExecBufferSpillThreshold: Int
    Definition Classes
    SQLConf
  305. def starSchemaDetection: Boolean
    Definition Classes
    SQLConf
  306. def starSchemaFTRatio: Double
    Definition Classes
    SQLConf
  307. def stateStoreCompressionCodec: String
    Definition Classes
    SQLConf
  308. def stateStoreFormatValidationEnabled: Boolean
    Definition Classes
    SQLConf
  309. def stateStoreMinDeltasForSnapshot: Int
    Definition Classes
    SQLConf
  310. def stateStoreProviderClass: String
    Definition Classes
    SQLConf
  311. def stateStoreSkipNullsForStreamStreamJoins: Boolean
    Definition Classes
    SQLConf
  312. def statefulOperatorCorrectnessCheckEnabled: Boolean
    Definition Classes
    SQLConf
  313. def storeAnalyzedPlanForView: Boolean
    Definition Classes
    SQLConf
  314. def storeAssignmentPolicy: SQLConf.StoreAssignmentPolicy.Value
    Definition Classes
    SQLConf
  315. def streamingFileCommitProtocolClass: String
    Definition Classes
    SQLConf
  316. def streamingMaintenanceInterval: Long
    Definition Classes
    SQLConf
  317. def streamingMetricsEnabled: Boolean
    Definition Classes
    SQLConf
  318. def streamingNoDataMicroBatchesEnabled: Boolean
    Definition Classes
    SQLConf
  319. def streamingNoDataProgressEventInterval: Long
    Definition Classes
    SQLConf
  320. def streamingPollingDelay: Long
    Definition Classes
    SQLConf
  321. def streamingProgressRetention: Int
    Definition Classes
    SQLConf
  322. def streamingSchemaInference: Boolean
    Definition Classes
    SQLConf
  323. def streamingSessionWindowMergeSessionInLocalPartition: Boolean
    Definition Classes
    SQLConf
  324. def stringRedactionPattern: Option[Regex]
    Definition Classes
    SQLConf
  325. def subexpressionEliminationCacheMaxEntries: Int
    Definition Classes
    SQLConf
  326. def subexpressionEliminationEnabled: Boolean
    Definition Classes
    SQLConf
  327. def subexpressionEliminationSkipForShotcutExpr: Boolean
    Definition Classes
    SQLConf
  328. def subqueryReuseEnabled: Boolean
    Definition Classes
    SQLConf
  329. def supportQuotedRegexColumnName: Boolean
    Definition Classes
    SQLConf
  330. final def synchronized[T0](arg0: ⇒ T0): T0
    Definition Classes
    AnyRef
  331. def tableRelationCacheSize: Int
    Definition Classes
    SQLConf
  332. def timestampType: AtomicType
    Definition Classes
    SQLConf → SqlApiConf
  333. def toString(): String
    Definition Classes
    AnyRef → Any
  334. def topKSortFallbackThreshold: Int
    Definition Classes
    SQLConf
  335. def truncateTableIgnorePermissionAcl: Boolean
    Definition Classes
    SQLConf
  336. def tvfAllowMultipleTableArguments: Boolean
    Definition Classes
    SQLConf
  337. def uiExplainMode: String
    Definition Classes
    SQLConf
  338. def unsetConf(entry: ConfigEntry[_]): Unit
    Definition Classes
    ReadOnlySQLConf → SQLConf
  339. def unsetConf(key: String): Unit
    Definition Classes
    ReadOnlySQLConf → SQLConf
  340. def useCompression: Boolean
    Definition Classes
    SQLConf
  341. def useCurrentSQLConfigsForView: Boolean
    Definition Classes
    SQLConf
  342. def useDeprecatedKafkaOffsetFetching: Boolean
    Definition Classes
    SQLConf
  343. def useNullsForMissingDefaultColumnValues: Boolean
    Definition Classes
    SQLConf
  344. def useObjectHashAggregation: Boolean
    Definition Classes
    SQLConf
  345. def usePartitionEvaluator: Boolean
    Definition Classes
    SQLConf
  346. def useV1Command: Boolean
    Definition Classes
    SQLConf
  347. def v2BucketingEnabled: Boolean
    Definition Classes
    SQLConf
  348. def v2BucketingPartiallyClusteredDistributionEnabled: Boolean
    Definition Classes
    SQLConf
  349. def v2BucketingPushPartValuesEnabled: Boolean
    Definition Classes
    SQLConf
  350. def validatePartitionColumns: Boolean
    Definition Classes
    SQLConf
  351. def variableSubstituteEnabled: Boolean
    Definition Classes
    SQLConf
  352. def verifyPartitionPath: Boolean
    Definition Classes
    SQLConf
  353. final def wait(): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  354. final def wait(arg0: Long, arg1: Int): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  355. final def wait(arg0: Long): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native()
  356. def warehousePath: String
    Definition Classes
    SQLConf
  357. def wholeStageEnabled: Boolean
    Definition Classes
    SQLConf
  358. def wholeStageMaxNumFields: Int
    Definition Classes
    SQLConf
  359. def wholeStageSplitConsumeFuncByOperator: Boolean
    Definition Classes
    SQLConf
  360. def wholeStageUseIdInClassName: Boolean
    Definition Classes
    SQLConf
  361. def windowExecBufferInMemoryThreshold: Int
    Definition Classes
    SQLConf
  362. def windowExecBufferSpillThreshold: Int
    Definition Classes
    SQLConf
  363. def windowGroupLimitThreshold: Int
    Definition Classes
    SQLConf
  364. def writeLegacyParquetFormat: Boolean
    Definition Classes
    SQLConf

Inherited from SQLConf

Inherited from SqlApiConf

Inherited from Logging

Inherited from Serializable

Inherited from Serializable

Inherited from AnyRef

Inherited from Any

Ungrouped