Uses of Class
com.google.cloud.hadoop.fs.gcs.HadoopConfigurationProperty

Packages that use HadoopConfigurationProperty

Package	Description
com.google.cloud.hadoop.fs.gcs

Uses of HadoopConfigurationProperty in com.google.cloud.hadoop.fs.gcs

Fields in com.google.cloud.hadoop.fs.gcs declared as HadoopConfigurationProperty

Modifier and Type	Field	Description
static final HadoopConfigurationProperty<Long>	GoogleHadoopFileSystemConfiguration.BLOCK_SIZE	Configuration key for default block size of a file.
static final HadoopConfigurationProperty<String>	GoogleHadoopFileSystemConfiguration.DELEGATION_TOKEN_BINDING_CLASS	Configuration key for Delegation Token binding class.
static final HadoopConfigurationProperty<Boolean>	GoogleHadoopFileSystemConfiguration.GCE_BUCKET_DELETE_ENABLE	If true, recursive delete on a path that refers to a GCS bucket itself ('/' for any bucket-rooted GoogleHadoopFileSystem) or delete on that path when it's empty will result in fully deleting the GCS bucket.
static final HadoopConfigurationProperty<Boolean>	GoogleHadoopFileSystemConfiguration.GCS_APPENDABLE_OBJECTS_FINALIZE_BEFORE_CLOSE	Flag to enable finalizing object before closing bidi write channel.
static final HadoopConfigurationProperty<String>	GoogleHadoopFileSystemConfiguration.GCS_APPLICATION_NAME_SUFFIX	Configuration key for adding a suffix to the GHFS application name sent to GCS.
static final HadoopConfigurationProperty<Integer>	GoogleHadoopFileSystemConfiguration.GCS_BATCH_THREADS	Configuration key for a number of threads to execute batch requests.
static final HadoopConfigurationProperty<Integer>	GoogleHadoopFileSystemConfiguration.GCS_BIDI_CLIENT_INITIALIZATION_TIMEOUT	Sets the total amount of time, we would wait for bidi client initialization.
static final HadoopConfigurationProperty<Integer>	GoogleHadoopFileSystemConfiguration.GCS_BIDI_THREAD_COUNT	Number of threads used by ThreadPoolExecutor in bidi channel.
static final HadoopConfigurationProperty<GoogleCloudStorageFileSystemOptions.ClientType>	GoogleHadoopFileSystemConfiguration.GCS_CLIENT_TYPE	Configuration key to configure client to use for GCS access.
static final HadoopConfigurationProperty<AsyncWriteChannelOptions.UploadType>	GoogleHadoopFileSystemConfiguration.GCS_CLIENT_UPLOAD_TYPE	Configuration key to configure the properties to optimize gcs-write.
static final HadoopConfigurationProperty<Boolean>	GoogleHadoopFileSystemConfiguration.GCS_CLOUD_LOGGING_ENABLE	Configuration key to export logs to Google cloud logging.
static final HadoopConfigurationProperty<Boolean>	GoogleHadoopFileSystemConfiguration.GCS_COPY_WITH_REWRITE_ENABLE	Configuration key for enabling the use of Rewrite requests for copy operations.
static final HadoopConfigurationProperty<Boolean>	GoogleHadoopFileSystemConfiguration.GCS_CREATE_ITEMS_CONFLICT_CHECK_ENABLE	Configuration key for enabling check to ensure that conflicting directories do not exist when creating files and conflicting files do not exist when creating directories.
static final HadoopConfigurationProperty<String>	GoogleHadoopFileSystemConfiguration.GCS_ENCRYPTION_ALGORITHM	Configuration key for the CSEK encryption algorithm.
static final HadoopConfigurationProperty<RedactedString>	GoogleHadoopFileSystemConfiguration.GCS_ENCRYPTION_KEY	Configuration key for the CSEK encryption key.
static final HadoopConfigurationProperty<RedactedString>	GoogleHadoopFileSystemConfiguration.GCS_ENCRYPTION_KEY_HASH	Configuration key for sha256 hash of the CSEK encryption key.
static final HadoopConfigurationProperty<Integer>	GoogleHadoopFileSystemConfiguration.GCS_FADVISE_REQUEST_TRACK_COUNT	Configuration key for number of request to track for adapting the access pattern i.e.
static final HadoopConfigurationProperty<GoogleHadoopFileSystem.GcsFileChecksumType>	GoogleHadoopFileSystemConfiguration.GCS_FILE_CHECKSUM_TYPE	Configuration key for which type of FileChecksum to return; if a particular file doesn't support the requested type, then getFileChecksum() will return null for that file.
static final HadoopConfigurationProperty<GoogleHadoopFileSystem.GlobAlgorithm>	GoogleHadoopFileSystemConfiguration.GCS_GLOB_ALGORITHM	Configuration key for customizing glob search algorithm.
static final HadoopConfigurationProperty<Long>	GoogleHadoopFileSystemConfiguration.GCS_GRPC_CHECK_INTERVAL_TIMEOUT	Configuration key for check interval for gRPC request timeout to GCS.
static final HadoopConfigurationProperty<Boolean>	GoogleHadoopFileSystemConfiguration.GCS_GRPC_CHECKSUMS_ENABLE	Configuration key for enabling checksum validation for the gRPC API.
static final HadoopConfigurationProperty<Boolean>	GoogleHadoopFileSystemConfiguration.GCS_GRPC_DIRECTPATH_ENABLE	Configuration key for enabling use of directpath gRPC API for read/write.
static final HadoopConfigurationProperty<Boolean>	GoogleHadoopFileSystemConfiguration.GCS_GRPC_ENABLE	Configuration key for enabling use of the gRPC API for read/write.
static final HadoopConfigurationProperty<Long>	GoogleHadoopFileSystemConfiguration.GCS_GRPC_READ_MESSAGE_TIMEOUT	Configuration key for the message timeout for gRPC read requests to GCS.
static final HadoopConfigurationProperty<Long>	GoogleHadoopFileSystemConfiguration.GCS_GRPC_READ_TIMEOUT	Configuration key for the connection timeout for gRPC read requests to GCS.
static final HadoopConfigurationProperty<Boolean>	GoogleHadoopFileSystemConfiguration.GCS_GRPC_READ_ZEROCOPY_ENABLE	Configuration key for enabling the zero-copy deserializer for the gRPC API.
static final HadoopConfigurationProperty<Boolean>	GoogleHadoopFileSystemConfiguration.GCS_GRPC_TRAFFICDIRECTOR_ENABLE	Configuration key for enabling use of traffic director gRPC API for read/write.
static final HadoopConfigurationProperty<Integer>	GoogleHadoopFileSystemConfiguration.GCS_GRPC_UPLOAD_BUFFERED_REQUESTS	Configuration key for the number of requests to be buffered for uploads to GCS.
static final HadoopConfigurationProperty<Boolean>	GoogleHadoopFileSystemConfiguration.GCS_GRPC_WRITE_ENABLE	Configuration key to configure client to use for GCS access.
static final HadoopConfigurationProperty<Long>	GoogleHadoopFileSystemConfiguration.GCS_GRPC_WRITE_MESSAGE_TIMEOUT	Configuration key for the message timeout for gRPC write requests to GCS.
static final HadoopConfigurationProperty<Long>	GoogleHadoopFileSystemConfiguration.GCS_GRPC_WRITE_TIMEOUT	Configuration key for the connect timeout for gRPC write requests to GCS.
static final HadoopConfigurationProperty<Boolean>	GoogleHadoopFileSystemConfiguration.GCS_HIERARCHICAL_NAMESPACE_ENABLE	Configuration key for enabling hierarchical namespace buckets.
static final HadoopConfigurationProperty<Boolean>	GoogleHadoopFileSystemConfiguration.GCS_HNS_OPTIMIZATION_ENABLE	Configuration key to enable Hierarchical Namespace (HNS) optimizations.
static final HadoopConfigurationProperty<Long>	GoogleHadoopFileSystemConfiguration.GCS_HTTP_CONNECT_TIMEOUT	Configuration key for the connect timeout for HTTP request to GCS.
static final HadoopConfigurationProperty<Map<String,String>>	GoogleHadoopFileSystemConfiguration.GCS_HTTP_HEADERS	Configuration key for the headers for HTTP request to GCS.
static final HadoopConfigurationProperty<Integer>	GoogleHadoopFileSystemConfiguration.GCS_HTTP_MAX_RETRY	Configuration key for the max number of retries for failed HTTP request to GCS.
static final HadoopConfigurationProperty<GoogleCloudStorageReadOptions.Fadvise>	GoogleHadoopFileSystemConfiguration.GCS_INPUT_STREAM_FADVISE	Tunes reading objects behavior to optimize HTTP GET requests for various use cases.
static final HadoopConfigurationProperty<Boolean>	GoogleHadoopFileSystemConfiguration.GCS_INPUT_STREAM_FAST_FAIL_ON_NOT_FOUND_ENABLE	If true, on opening a file we will proactively perform a metadata GET to check whether the object exists, even though the underlying channel will not open a data stream until read() is actually called.
static final HadoopConfigurationProperty<Long>	GoogleHadoopFileSystemConfiguration.GCS_INPUT_STREAM_INPLACE_SEEK_LIMIT	If forward seeks are within this many bytes of the current position, seeks are performed by reading and discarding bytes in-place rather than opening a new underlying stream.
static final HadoopConfigurationProperty<Long>	GoogleHadoopFileSystemConfiguration.GCS_INPUT_STREAM_MIN_RANGE_REQUEST_SIZE	Minimum size in bytes of the HTTP Range header set in GCS request when opening new stream to read an object.
static final HadoopConfigurationProperty<Boolean>	GoogleHadoopFileSystemConfiguration.GCS_INPUT_STREAM_SUPPORT_GZIP_ENCODING_ENABLE	If false, reading a file with GZIP content encoding (HTTP header "Content-Encoding: gzip") will result in failure (IOException is thrown).
static final HadoopConfigurationProperty<Boolean>	GoogleHadoopFileSystemConfiguration.GCS_LAZY_INITIALIZATION_ENABLE	Configuration key for enabling lazy initialization of GCS FS instance.
static final HadoopConfigurationProperty<String>	GoogleHadoopFileSystemConfiguration.GCS_MARKER_FILE_PATTERN	Configuration key for marker file pattern.
static final HadoopConfigurationProperty<Integer>	GoogleHadoopFileSystemConfiguration.GCS_MAX_LIST_ITEMS_PER_CALL	Configuration key for number of items to return per call to the list* GCS RPCs.
static final HadoopConfigurationProperty<Integer>	GoogleHadoopFileSystemConfiguration.GCS_MAX_REQUESTS_PER_BATCH	Configuration key for a max number of GCS RPCs in batch request.
static final HadoopConfigurationProperty<Long>	GoogleHadoopFileSystemConfiguration.GCS_MAX_WAIT_TIME_EMPTY_OBJECT_CREATE	Configuration key for modifying the maximum amount of time to wait for empty object creation.
static final HadoopConfigurationProperty<GoogleCloudStorageOptions.MetricsSink>	GoogleHadoopFileSystemConfiguration.GCS_METRICS_SINK	Configuration key to enable publishing metrics to Google cloud monitoring.
static final HadoopConfigurationProperty<Boolean>	GoogleHadoopFileSystemConfiguration.GCS_OPERATION_BIDI_API_ENABLE	Flag to enable the bidirectional Rapid Storage API.
static final HadoopConfigurationProperty<Boolean>	GoogleHadoopFileSystemConfiguration.GCS_OPERATION_MOVE_ENABLE	Configuration key for enabling move operation in gcs instead of copy+delete.
static final HadoopConfigurationProperty<Boolean>	GoogleHadoopFileSystemConfiguration.GCS_OPERATION_TRACE_LOG_ENABLE	Configuration key to enable operational level traces
static final HadoopConfigurationProperty<Long>	GoogleHadoopFileSystemConfiguration.GCS_OUTPUT_STREAM_BUFFER_SIZE	Configuration key for setting write buffer size.
static final HadoopConfigurationProperty<Boolean>	GoogleHadoopFileSystemConfiguration.GCS_OUTPUT_STREAM_DIRECT_UPLOAD_ENABLE	Configuration key for enabling GCS direct upload.
static final HadoopConfigurationProperty<Long>	GoogleHadoopFileSystemConfiguration.GCS_OUTPUT_STREAM_PIPE_BUFFER_SIZE	Configuration key for setting pipe buffer size.
static final HadoopConfigurationProperty<AsyncWriteChannelOptions.PipeType>	GoogleHadoopFileSystemConfiguration.GCS_OUTPUT_STREAM_PIPE_TYPE	Configuration key for setting pipe type.
static final HadoopConfigurationProperty<Long>	GoogleHadoopFileSystemConfiguration.GCS_OUTPUT_STREAM_SYNC_MIN_INTERVAL	Configuration key for the minimal time interval between consecutive sync/hsync/hflush calls.
static final HadoopConfigurationProperty<Long>	GoogleHadoopFileSystemConfiguration.GCS_OUTPUT_STREAM_UPLOAD_CACHE_SIZE	Configuration for setting GCS upload cache size.
static final HadoopConfigurationProperty<Long>	GoogleHadoopFileSystemConfiguration.GCS_OUTPUT_STREAM_UPLOAD_CHUNK_SIZE	Configuration key for setting GCS upload chunk size.
static final HadoopConfigurationProperty<Long>	GoogleHadoopFileSystemConfiguration.GCS_PCU_BUFFER_CAPACITY	Configuration key to configure the buffer capacity for UploadType.PARALLEL_COMPOSITE_UPLOAD.
static final HadoopConfigurationProperty<Integer>	GoogleHadoopFileSystemConfiguration.GCS_PCU_BUFFER_COUNT	Configuration key to configure the Buffers for UploadType.PARALLEL_COMPOSITE_UPLOAD.
static final HadoopConfigurationProperty<AsyncWriteChannelOptions.PartFileCleanupType>	GoogleHadoopFileSystemConfiguration.GCS_PCU_PART_FILE_CLEANUP_TYPE	Configuration key to clean up strategy of part files created via UploadType.PARALLEL_COMPOSITE_UPLOAD.
static final HadoopConfigurationProperty<String>	GoogleHadoopFileSystemConfiguration.GCS_PCU_PART_FILE_NAME_PREFIX	Configuration key to set up the naming strategy of part files created via UploadType.PARALLEL_COMPOSITE_UPLOAD.
static final HadoopConfigurationProperty<Boolean>	GoogleHadoopFileSystemConfiguration.GCS_PERFORMANCE_CACHE_ENABLE	Configuration key for using a local item cache to supplement GCS API "getFile" results.
static final HadoopConfigurationProperty<Long>	GoogleHadoopFileSystemConfiguration.GCS_PERFORMANCE_CACHE_MAX_ENTRY_AGE	Configuration key for maximum time a GoogleCloudStorageItemInfo will remain "valid" in the performance cache before it's invalidated.
static final HadoopConfigurationProperty<String>	GoogleHadoopFileSystemConfiguration.GCS_PROJECT_ID	Configuration key for GCS project ID.
static final HadoopConfigurationProperty<Boolean>	GoogleHadoopFileSystemConfiguration.GCS_REPAIR_IMPLICIT_DIRECTORIES_ENABLE	Configuration key for enabling automatic repair of implicit directories whenever detected inside delete and rename calls.
static final HadoopConfigurationProperty<Collection<String>>	GoogleHadoopFileSystemConfiguration.GCS_REQUESTER_PAYS_BUCKETS	Configuration key for GCS Requester Pays Buckets.
static final HadoopConfigurationProperty<RequesterPaysOptions.RequesterPaysMode>	GoogleHadoopFileSystemConfiguration.GCS_REQUESTER_PAYS_MODE	Configuration key for GCS project ID.
static final HadoopConfigurationProperty<String>	GoogleHadoopFileSystemConfiguration.GCS_REQUESTER_PAYS_PROJECT_ID	Configuration key for GCS Requester Pays Project ID.
static final HadoopConfigurationProperty<Long>	GoogleHadoopFileSystemConfiguration.GCS_REWRITE_MAX_CHUNK_SIZE	Configuration key for specifying max number of bytes rewritten in a single rewrite request when fs.gs.copy.with.rewrite.enable is set to 'true'.
static final HadoopConfigurationProperty<String>	GoogleHadoopFileSystemConfiguration.GCS_ROOT_URL	Configuration key for the Cloud Storage API endpoint root URL.
static final HadoopConfigurationProperty<String>	GoogleHadoopFileSystemConfiguration.GCS_SERVICE_PATH	Configuration key for the Cloud Storage API endpoint service path.
static final HadoopConfigurationProperty<Boolean>	GoogleHadoopFileSystemConfiguration.GCS_STATUS_PARALLEL_ENABLE	If true, executes GCS requests in listStatus and getFileStatus methods in parallel to reduce latency.
static final HadoopConfigurationProperty<Boolean>	GoogleHadoopFileSystemConfiguration.GCS_STORAGE_CLIENT_CACHING	Configuration key to enable JAVA_STORAGE client caching across FS objects.
static final HadoopConfigurationProperty<Boolean>	GoogleHadoopFileSystemConfiguration.GCS_TRACE_LOG_ENABLE	Configuration key to enable logging of additional trace details.
static final HadoopConfigurationProperty<Integer>	GoogleHadoopFileSystemConfiguration.GCS_VECTORED_READ_MERGED_RANGE_MAX_SIZE	Maximum size allowed for a merged range request.
static final HadoopConfigurationProperty<Integer>	GoogleHadoopFileSystemConfiguration.GCS_VECTORED_READ_RANGE_MIN_SEEK	Minimum distance that will be seeked without merging the ranges together.
static final HadoopConfigurationProperty<Integer>	GoogleHadoopFileSystemConfiguration.GCS_VECTORED_READ_THREADS	Maximum threads to process individual FileRange requests
static final HadoopConfigurationProperty<String>	GoogleHadoopFileSystemConfiguration.GCS_WORKING_DIRECTORY	Configuration key for initial working directory of a GHFS instance.
static final HadoopConfigurationProperty<Boolean>	GoogleHadoopFileSystemConfiguration.GCS_WRITE_ROLLING_CHECKSUM_ENABLE	Configuration key for rolling checksum on writes.
static final HadoopConfigurationProperty<Collection<String>>	GoogleHadoopFileSystemConfiguration.GCS_WRITE_TEMPORARY_FILES_PATH	Configuration key to configure the Path where uploads will be parked on disk.
static final HadoopConfigurationProperty<String>	GoogleHadoopFileSystemConfiguration.PERMISSIONS_TO_REPORT	Key for the permissions that we report a file or directory to have.