com.edmunds.rest.databricks.service

Class DbfsServiceImpl

java.lang.Object

com.edmunds.rest.databricks.service.DatabricksService

com.edmunds.rest.databricks.service.DbfsServiceImpl

All Implemented Interfaces:

DbfsService

public class DbfsServiceImpl
extends DatabricksService
implements DbfsService

The implementation of DbfsService.

Field Summary

Fields inherited from class com.edmunds.rest.databricks.service.DatabricksService

client, mapper

Constructor Summary

Constructors

Constructor and Description
DbfsServiceImpl(DatabricksRestClient client)

Method Summary

Modifier and Type	Method and Description
FileInfoDTO	getInfo(String path) Get info of a specific file or directory on dbfs.
FileInfoDTO[]	ls(String path) Lists files and directories in a dbfs path.
void	mkdirs(String path) Makes a directory (and parent directories) at a given path.
void	mv(String sourcePath, String destinationPath) Moves a file from one path to another.
DbfsReadDTO	read(String path) Will read a whole file.
DbfsReadDTO	read(String path, long offset, long length) Reads a file from dbfs.
void	rm(String path, boolean recursive) Removes a dbfs path.
void	write(String path, InputStream inputStream, boolean overwrite) Will create a file and write to that file on dbfs.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

DbfsServiceImpl

public DbfsServiceImpl(DatabricksRestClient client)

Method Detail

rm

public void rm(String path,
               boolean recursive)
        throws IOException,
               DatabricksRestException

Description copied from interface: DbfsService

Removes a dbfs path.

Specified by:

rm in interface DbfsService

Parameters:

path - the path to delete

recursive - whether or not it should be recursive

Throws:

IOException - any other errors

DatabricksRestException - any errors in request

See Also:

Documentation

getInfo

public FileInfoDTO getInfo(String path)
                    throws IOException,
                           DatabricksRestException

Description copied from interface: DbfsService

Get info of a specific file or directory on dbfs.

Specified by:

getInfo in interface DbfsService

Parameters:

path - the dbfs path

Returns:

the file info status object

Throws:

IOException - any other errors

DatabricksRestException - any errors in request

See Also:

Documentation

ls

public FileInfoDTO[] ls(String path)
                 throws IOException,
                        DatabricksRestException

Description copied from interface: DbfsService

Lists files and directories in a dbfs path.

Specified by:

ls in interface DbfsService

Parameters:

path - the dbfs path

Returns:

an array of file info objects.

Throws:

IOException - any other errors

DatabricksRestException - any errors in request

See Also:

Documentation

mkdirs

public void mkdirs(String path)
            throws IOException,
                   DatabricksRestException

Description copied from interface: DbfsService

Makes a directory (and parent directories) at a given path.

Specified by:

mkdirs in interface DbfsService

Parameters:

path - the dbfs path to create

Throws:

IOException - any other errors

DatabricksRestException - any errors in request

See Also:

Documentation

mv

public void mv(String sourcePath,
               String destinationPath)
        throws IOException,
               DatabricksRestException

Description copied from interface: DbfsService

Moves a file from one path to another.

Specified by:

mv in interface DbfsService

Parameters:

sourcePath - the source dbfs path

destinationPath - the destination dbfs path

Throws:

IOException - any other errors

DatabricksRestException - any errors with request

See Also:

Documentation

write

public void write(String path,
                  InputStream inputStream,
                  boolean overwrite)
           throws IOException,
                  DatabricksRestException

Description copied from interface: DbfsService

Will create a file and write to that file on dbfs. Combination of:

Specified by:

write in interface DbfsService

Parameters:

path - the path to create a file/write to

inputStream - the stream to output to dbfs

overwrite - whether or not you want to overwrite the file

Throws:

IOException - if any other errors

DatabricksRestException - any errors in request

See Also:

Documentation and, Documentation

read

public DbfsReadDTO read(String path,
                        long offset,
                        long length)
                 throws IOException,
                        DatabricksRestException

Description copied from interface: DbfsService

Reads a file from dbfs.

Specified by:

read in interface DbfsService

Parameters:

path - the dbfs path to read from

offset - the offset of the file you want to read from

length - how many bytes you want to read

Returns:

the read DTO object

Throws:

IOException - any other errors

DatabricksRestException - any errors in request

See Also:

Documentation

read

public DbfsReadDTO read(String path)
                 throws IOException,
                        DatabricksRestException

Description copied from interface: DbfsService

Will read a whole file.

Specified by:

read in interface DbfsService

Parameters:

path - the dbfs path to read from

Returns:

the dbfs read DTO object

Throws:

IOException - any other errors

DatabricksRestException - any errors in request

See Also:

Documentation