| Package | Description |
|---|---|
| org.apache.hadoop.fs.s3a |
S3A Filesystem.
|
| org.apache.hadoop.fs.s3a.auth |
Authentication and permissions support.
|
| org.apache.hadoop.fs.s3a.auth.delegation |
Extensible delegation token support for the S3A connector.
|
| org.apache.hadoop.fs.s3a.impl |
Implementation classes private to the S3A store.
|
| org.apache.hadoop.fs.s3a.s3guard |
This package contains classes related to S3Guard: a feature of S3A to mask
the eventual consistency behavior of S3 and optimize access patterns by
coordinating with a strongly consistent external store for file system
metadata.
|
| Modifier and Type | Method and Description |
|---|---|
Invoker |
S3AOpContext.getInvoker() |
Invoker |
S3AReadOpContext.getReadInvoker()
Get invoker to use for read operations.
|
Invoker |
S3AOpContext.getS3guardInvoker() |
| Modifier and Type | Method and Description |
|---|---|
protected com.amazonaws.services.s3.model.ObjectMetadata |
S3AFileSystem.getObjectMetadata(String key,
ChangeTracker changeTracker,
Invoker changeInvoker,
String operation)
Request object metadata; increments counters in the process.
|
| Constructor and Description |
|---|
S3AOpContext(boolean isS3GuardEnabled,
Invoker invoker,
org.apache.hadoop.fs.FileSystem.Statistics stats,
S3AStatisticsContext instrumentation,
org.apache.hadoop.fs.FileStatus dstFileStatus)
Constructor using common invoker and retry policy.
|
S3AOpContext(boolean isS3GuardEnabled,
Invoker invoker,
Invoker s3guardInvoker,
org.apache.hadoop.fs.FileSystem.Statistics stats,
S3AStatisticsContext instrumentation,
org.apache.hadoop.fs.FileStatus dstFileStatus)
Alternate constructor that allows passing in two invokers, the common
one, and another with the S3Guard Retry Policy.
|
S3AReadOpContext(org.apache.hadoop.fs.Path path,
boolean isS3GuardEnabled,
Invoker invoker,
Invoker s3guardInvoker,
org.apache.hadoop.fs.FileSystem.Statistics stats,
S3AStatisticsContext instrumentation,
org.apache.hadoop.fs.FileStatus dstFileStatus,
S3AInputPolicy inputPolicy,
ChangeDetectionPolicy changeDetectionPolicy,
long readahead)
Instantiate.
|
UploadIterator(com.amazonaws.services.s3.AmazonS3 s3,
Invoker invoker,
String bucketName,
int maxKeys,
String prefix) |
| Modifier and Type | Method and Description |
|---|---|
static STSClientFactory.STSClient |
STSClientFactory.createClientConnection(com.amazonaws.services.securitytoken.AWSSecurityTokenService tokenService,
Invoker invoker)
Create an STS Client instance.
|
static MarshalledCredentials |
MarshalledCredentialBinding.requestSessionCredentials(com.amazonaws.auth.AWSCredentialsProvider parentCredentials,
com.amazonaws.ClientConfiguration awsConf,
String stsEndpoint,
String stsRegion,
int duration,
Invoker invoker)
Request a set of credentials from an STS endpoint.
|
| Modifier and Type | Method and Description |
|---|---|
protected Invoker |
SessionTokenBinding.getInvoker()
Get the invoker for STS calls.
|
| Modifier and Type | Method and Description |
|---|---|
Invoker |
StoreContext.getInvoker() |
| Modifier and Type | Method and Description |
|---|---|
StoreContextBuilder |
StoreContextBuilder.setInvoker(Invoker invoke) |
| Constructor and Description |
|---|
StoreContext(URI fsURI,
String bucket,
org.apache.hadoop.conf.Configuration configuration,
String username,
org.apache.hadoop.security.UserGroupInformation owner,
ExecutorService executor,
int executorCapacity,
Invoker invoker,
S3AStatisticsContext instrumentation,
S3AStorageStatistics storageStatistics,
S3AInputPolicy inputPolicy,
ChangeDetectionPolicy changeDetectionPolicy,
boolean multiObjectDeleteEnabled,
MetadataStore metadataStore,
boolean useListV1,
ContextAccessors contextAccessors,
ITtlTimeProvider timeProvider)
Deprecated.
as public method: use
StoreContextBuilder. |
| Modifier and Type | Method and Description |
|---|---|
Invoker |
DynamoDBMetadataStore.getInvoker()
Get the operation invoker for write operations.
|
| Constructor and Description |
|---|
DynamoDBMetadataStoreTableManager(com.amazonaws.services.dynamodbv2.document.DynamoDB dynamoDB,
String tableName,
String region,
com.amazonaws.services.dynamodbv2.AmazonDynamoDB amazonDynamoDB,
org.apache.hadoop.conf.Configuration conf,
Invoker readOp,
org.apache.hadoop.io.retry.RetryPolicy batchWriteCapacityExceededEvents) |
Copyright © 2008–2021 Apache Software Foundation. All rights reserved.