com.google.cloud.hadoop.gcsio

Class GoogleCloudStorageOptions

java.lang.Object

com.google.cloud.hadoop.gcsio.GoogleCloudStorageOptions

public class GoogleCloudStorageOptions
extends java.lang.Object

Configuration options for the GoogleCloudStorage class.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	GoogleCloudStorageOptions.Builder Mutable builder for the GoogleCloudStorageOptions class.

Field Summary

Fields

Modifier and Type	Field and Description
static boolean	AUTO_REPAIR_IMPLICIT_DIRECTORIES_DEFAULT Default setting for enabling auto-repair of implicit directories.
static boolean	COPY_WITH_REWRITE_DEFAULT Default setting for whether or not to use rewrite request for copy operation.
static boolean	CREATE_EMPTY_MARKER_OBJECT_DEFAULT Default setting for whether or not to create a marker file when beginning file creation.
static RequesterPaysOptions	DEFAULT_REQUESTER_PAYS_OPTIONS
static int	HTTP_REQUEST_CONNECT_TIMEOUT Default setting for connect timeout (in millisecond) of GCS HTTP request.
static int	HTTP_REQUEST_READ_TIMEOUT Default setting for read timeout (in millisecond) of GCS HTTP request.
static boolean	INFER_IMPLICIT_DIRECTORIES_DEFAULT Default setting for enabling inferring of implicit directories.
static int	MAX_HTTP_REQUEST_RETRIES Default setting for maximum number of GCS HTTP request retires.
static long	MAX_LIST_ITEMS_PER_CALL_DEFAULT Default number of items to return per call to the list* GCS RPCs.
static long	MAX_REQUESTS_PER_BATCH_DEFAULT Default setting for maximum number of requests per GCS batch.
static int	MAX_WAIT_MILLIS_FOR_EMPTY_OBJECT_CREATION Default setting for the length of time to wait for empty objects to appear if we believe we are in a race with multiple workers.

Constructor Summary

Constructors

Modifier	Constructor and Description
	GoogleCloudStorageOptions(boolean autoRepairImplicitDirectoriesEnabled, boolean inferImplicitDirectoriesEnabled, java.lang.String projectId, java.lang.String appName, long maxListItemsPerCall, long maxRequestsPerBatch, boolean createMarkerFile, HttpTransportFactory.HttpTransportType transportType, java.lang.String proxyAddress, AsyncWriteChannelOptions writeChannelOptions)
protected	GoogleCloudStorageOptions(GoogleCloudStorageOptions.Builder builder)

Method Summary

Modifier and Type	Method and Description
java.lang.String	getAppName()
int	getHttpRequestConnectTimeout()
int	getHttpRequestReadTimeout()
int	getMaxHttpRequestRetries()
long	getMaxListItemsPerCall()
long	getMaxRequestsPerBatch()
int	getMaxWaitMillisForEmptyObjectCreation()
java.lang.String	getProjectId()
java.lang.String	getProxyAddress()
RequesterPaysOptions	getRequesterPaysOptions()
HttpTransportFactory.HttpTransportType	getTransportType()
AsyncWriteChannelOptions	getWriteChannelOptions()
boolean	isAutoRepairImplicitDirectoriesEnabled()
boolean	isCopyWithRewriteEnabled()
boolean	isInferImplicitDirectoriesEnabled()
boolean	isMarkerFileCreationEnabled()
static GoogleCloudStorageOptions.Builder	newBuilder()
void	throwIfNotValid()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

MAX_LIST_ITEMS_PER_CALL_DEFAULT

public static final long MAX_LIST_ITEMS_PER_CALL_DEFAULT

Default number of items to return per call to the list* GCS RPCs.

See Also:

Constant Field Values

AUTO_REPAIR_IMPLICIT_DIRECTORIES_DEFAULT

public static final boolean AUTO_REPAIR_IMPLICIT_DIRECTORIES_DEFAULT

Default setting for enabling auto-repair of implicit directories.

See Also:

Constant Field Values

INFER_IMPLICIT_DIRECTORIES_DEFAULT

public static final boolean INFER_IMPLICIT_DIRECTORIES_DEFAULT

Default setting for enabling inferring of implicit directories.

See Also:

Constant Field Values

MAX_REQUESTS_PER_BATCH_DEFAULT

public static final long MAX_REQUESTS_PER_BATCH_DEFAULT

Default setting for maximum number of requests per GCS batch.

See Also:

Constant Field Values

MAX_HTTP_REQUEST_RETRIES

public static final int MAX_HTTP_REQUEST_RETRIES

Default setting for maximum number of GCS HTTP request retires.

See Also:

Constant Field Values

HTTP_REQUEST_CONNECT_TIMEOUT

public static final int HTTP_REQUEST_CONNECT_TIMEOUT

Default setting for connect timeout (in millisecond) of GCS HTTP request.

See Also:

Constant Field Values

HTTP_REQUEST_READ_TIMEOUT

public static final int HTTP_REQUEST_READ_TIMEOUT

Default setting for read timeout (in millisecond) of GCS HTTP request.

See Also:

Constant Field Values

CREATE_EMPTY_MARKER_OBJECT_DEFAULT

public static final boolean CREATE_EMPTY_MARKER_OBJECT_DEFAULT

Default setting for whether or not to create a marker file when beginning file creation.

See Also:

Constant Field Values

MAX_WAIT_MILLIS_FOR_EMPTY_OBJECT_CREATION

public static final int MAX_WAIT_MILLIS_FOR_EMPTY_OBJECT_CREATION

Default setting for the length of time to wait for empty objects to appear if we believe we are in a race with multiple workers.

See Also:

Constant Field Values

DEFAULT_REQUESTER_PAYS_OPTIONS

public static final RequesterPaysOptions DEFAULT_REQUESTER_PAYS_OPTIONS

COPY_WITH_REWRITE_DEFAULT

public static final boolean COPY_WITH_REWRITE_DEFAULT

Default setting for whether or not to use rewrite request for copy operation.

See Also:

Constant Field Values

Constructor Detail

GoogleCloudStorageOptions

protected GoogleCloudStorageOptions(GoogleCloudStorageOptions.Builder builder)

GoogleCloudStorageOptions

public GoogleCloudStorageOptions(boolean autoRepairImplicitDirectoriesEnabled,
                                 boolean inferImplicitDirectoriesEnabled,
                                 java.lang.String projectId,
                                 java.lang.String appName,
                                 long maxListItemsPerCall,
                                 long maxRequestsPerBatch,
                                 boolean createMarkerFile,
                                 HttpTransportFactory.HttpTransportType transportType,
                                 java.lang.String proxyAddress,
                                 AsyncWriteChannelOptions writeChannelOptions)

Method Detail

newBuilder

public static GoogleCloudStorageOptions.Builder newBuilder()

isAutoRepairImplicitDirectoriesEnabled

public boolean isAutoRepairImplicitDirectoriesEnabled()

isInferImplicitDirectoriesEnabled

public boolean isInferImplicitDirectoriesEnabled()

getProjectId

@Nullable
public java.lang.String getProjectId()

getAppName

public java.lang.String getAppName()

getTransportType

public HttpTransportFactory.HttpTransportType getTransportType()

getProxyAddress

public java.lang.String getProxyAddress()

getMaxListItemsPerCall

public long getMaxListItemsPerCall()

getWriteChannelOptions

public AsyncWriteChannelOptions getWriteChannelOptions()

getMaxRequestsPerBatch

public long getMaxRequestsPerBatch()

getMaxHttpRequestRetries

public int getMaxHttpRequestRetries()

getHttpRequestConnectTimeout

public int getHttpRequestConnectTimeout()

getHttpRequestReadTimeout

public int getHttpRequestReadTimeout()

isMarkerFileCreationEnabled

public boolean isMarkerFileCreationEnabled()

getMaxWaitMillisForEmptyObjectCreation

public int getMaxWaitMillisForEmptyObjectCreation()

getRequesterPaysOptions

public RequesterPaysOptions getRequesterPaysOptions()

isCopyWithRewriteEnabled

public boolean isCopyWithRewriteEnabled()

throwIfNotValid

public void throwIfNotValid()