org.apache.gobblin.util

Class ProxiedFileSystemCache

java.lang.Object

org.apache.gobblin.util.ProxiedFileSystemCache

public class ProxiedFileSystemCache
extends Object

A cache for storing a mapping between Hadoop users and user FileSystem objects.

This classes uses Guava's Cache for storing the user to FileSystem mapping, and creates the FileSystems using the ProxiedFileSystemUtils class.

See Also:

Cache, ProxiedFileSystemUtils

Constructor Summary

Constructors

Constructor and Description
ProxiedFileSystemCache()

Method Summary

Modifier and Type	Method and Description
static org.apache.hadoop.fs.FileSystem	getProxiedFileSystem(@NonNull String userNameToProxyAs, Properties properties, org.apache.hadoop.conf.Configuration conf) Deprecated. use #fromProperties
static org.apache.hadoop.fs.FileSystem	getProxiedFileSystem(@NonNull String userNameToProxyAs, Properties properties, URI fsURI) Deprecated. use #fromProperties
static org.apache.hadoop.fs.FileSystem	getProxiedFileSystem(@NonNull String userNameToProxyAs, Properties properties, URI fsURI, org.apache.hadoop.conf.Configuration configuration) Deprecated. Use #fromProperties
static org.apache.hadoop.fs.FileSystem	getProxiedFileSystemUsingKeytab(State state, URI fsURI, org.apache.hadoop.conf.Configuration conf) Deprecated. use #fromKeytab.
static org.apache.hadoop.fs.FileSystem	getProxiedFileSystemUsingKeytab(@NonNull String userNameToProxyAs, String superUserName, org.apache.hadoop.fs.Path superUserKeytabLocation, URI fsURI, org.apache.hadoop.conf.Configuration conf) Deprecated. use #fromKeytab.
static org.apache.hadoop.fs.FileSystem	getProxiedFileSystemUsingToken(@NonNull String userNameToProxyAs, org.apache.hadoop.security.token.Token<?> userNameToken, URI fsURI, org.apache.hadoop.conf.Configuration conf) Deprecated. use #fromToken.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

ProxiedFileSystemCache

public ProxiedFileSystemCache()

Method Detail

getProxiedFileSystem

@Deprecated
public static org.apache.hadoop.fs.FileSystem getProxiedFileSystem(@NonNull
                                                                               @NonNull String userNameToProxyAs,
                                                                               Properties properties,
                                                                               URI fsURI)
                                                                        throws IOException

Deprecated. use #fromProperties

Gets a FileSystem that can perform any operations allowed by the specified userNameToProxyAs.

Parameters:

userNameToProxyAs - The name of the user the super user should proxy as

properties - Properties containing initialization properties.

fsURI - The URI for the FileSystem that should be created.

Returns:

a FileSystem that can execute commands on behalf of the specified userNameToProxyAs

Throws:

IOException

getProxiedFileSystem

@Deprecated
public static org.apache.hadoop.fs.FileSystem getProxiedFileSystem(@NonNull
                                                                               @NonNull String userNameToProxyAs,
                                                                               Properties properties,
                                                                               org.apache.hadoop.conf.Configuration conf)
                                                                        throws IOException

Deprecated. use #fromProperties

Gets a FileSystem that can perform any operations allowed by the specified userNameToProxyAs.

Parameters:

userNameToProxyAs - The name of the user the super user should proxy as

properties - Properties containing initialization properties.

conf - The Configuration for the FileSystem that should be created.

Returns:

a FileSystem that can execute commands on behalf of the specified userNameToProxyAs

Throws:

IOException

getProxiedFileSystem

@Deprecated
public static org.apache.hadoop.fs.FileSystem getProxiedFileSystem(@NonNull
                                                                               @NonNull String userNameToProxyAs,
                                                                               Properties properties,
                                                                               URI fsURI,
                                                                               org.apache.hadoop.conf.Configuration configuration)
                                                                        throws IOException

Deprecated. Use #fromProperties

Gets a FileSystem that can perform any operations allowed by the specified userNameToProxyAs.

Parameters:

userNameToProxyAs - The name of the user the super user should proxy as

properties - Properties containing initialization properties.

fsURI - The URI for the FileSystem that should be created.

configuration - The Configuration for the FileSystem that should be created.

Returns:

a FileSystem that can execute commands on behalf of the specified userNameToProxyAs

Throws:

IOException

getProxiedFileSystemUsingKeytab

@Deprecated
public static org.apache.hadoop.fs.FileSystem getProxiedFileSystemUsingKeytab(State state,
                                                                                          URI fsURI,
                                                                                          org.apache.hadoop.conf.Configuration conf)
                                                                                   throws ExecutionException

Deprecated. use #fromKeytab.

Cached version of ProxiedFileSystemUtils.createProxiedFileSystemUsingKeytab(State, URI, Configuration).

Throws:

ExecutionException

getProxiedFileSystemUsingKeytab

@Deprecated
public static org.apache.hadoop.fs.FileSystem getProxiedFileSystemUsingKeytab(@NonNull
                                                                                          @NonNull String userNameToProxyAs,
                                                                                          String superUserName,
                                                                                          org.apache.hadoop.fs.Path superUserKeytabLocation,
                                                                                          URI fsURI,
                                                                                          org.apache.hadoop.conf.Configuration conf)
                                                                                   throws ExecutionException

Deprecated. use #fromKeytab.

Cached version of ProxiedFileSystemUtils.createProxiedFileSystemUsingKeytab(String, String, Path, URI, Configuration).

Throws:

ExecutionException

getProxiedFileSystemUsingToken

@Deprecated
public static org.apache.hadoop.fs.FileSystem getProxiedFileSystemUsingToken(@NonNull
                                                                                         @NonNull String userNameToProxyAs,
                                                                                         org.apache.hadoop.security.token.Token<?> userNameToken,
                                                                                         URI fsURI,
                                                                                         org.apache.hadoop.conf.Configuration conf)
                                                                                  throws ExecutionException

Deprecated. use #fromToken.

Cached version of ProxiedFileSystemUtils.createProxiedFileSystemUsingToken(String, Token, URI, Configuration).

Throws:

ExecutionException