package hadoop
- Alphabetic
- By Inheritance
- hadoop
- Implicits
- AnyRef
- Any
- Hide All
- Show All
- Public
- All
Type Members
- class HadoopAttributeStore extends BlobLayerAttributeStore
- case class HadoopCatalogConfig(compressionFactor: Double, metadataFileName: String, layerDataDir: (LayerId) ⇒ String) extends Product with Serializable
-
class
HadoopCollectionLayerReader extends CollectionLayerReader[LayerId] with LazyLogging
Handles reading raster RDDs and their metadata from S3.
- class HadoopCollectionReader extends AnyRef
- case class HadoopGeoTiffInfoReader(path: String, config: SerializableConfiguration, tiffExtensions: Seq[String] = ..., streaming: Boolean = true) extends GeoTiffInfoReader with Product with Serializable
- class HadoopLayerCopier extends LayerCopier[LayerId]
- class HadoopLayerDeleter extends LazyLogging with LayerDeleter[LayerId]
- case class HadoopLayerHeader(keyClass: String, valueClass: String, path: URI, layerType: LayerType = AvroLayerType) extends LayerHeader with Product with Serializable
- class HadoopLayerManager extends LayerManager[LayerId]
- class HadoopLayerMover extends LayerMover[LayerId]
-
class
HadoopLayerProvider extends AttributeStoreProvider with LayerReaderProvider with LayerWriterProvider with ValueReaderProvider with CollectionLayerReaderProvider
Provides HadoopAttributeStore instance for URI with
hdfs,hdfs+file,s3n,s3a,wasbandwasbsschemes.Provides HadoopAttributeStore instance for URI with
hdfs,hdfs+file,s3n,s3a,wasbandwasbsschemes. The uri represents Hadoop Path of catalog root.wasbandwasbsprovide support for the Hadoop Azure connector. Additional configuration is required for this. This Provider intentinally does not handle thes3scheme because the Hadoop implemintation is poor. That support is provided by HadoopAttributeStore -
class
HadoopLayerReader extends FilteringLayerReader[LayerId] with LazyLogging
Handles reading raster RDDs and their metadata from S3.
- class HadoopLayerWriter extends LayerWriter[LayerId] with LazyLogging
- trait HadoopRasterMethods[T] extends MethodExtensions[T]
- trait HadoopSparkContextMethods extends AnyRef
- class HadoopValueReader extends OverzoomingValueReader
-
class
HdfsRangeReader extends RangeReader
This class extends RangeReader by reading chunks out of a GeoTiff on HDFS.
This class extends RangeReader by reading chunks out of a GeoTiff on HDFS.
- returns
A new instance of S3RangeReader.
- trait Implicits extends AnyRef
-
implicit
class
HadoopSparkContextMethodsWrapper extends HadoopSparkContextMethods
- Definition Classes
- Implicits
-
implicit
class
withGeoTiffHadoopWriteMethods[T <: CellGrid] extends HadoopRasterMethods[GeoTiff[T]]
- Definition Classes
- Implicits
-
implicit
class
withJpgHadoopWriteMethods extends HadoopRasterMethods[Jpg]
- Definition Classes
- Implicits
-
implicit
class
withPngHadoopWriteMethods extends HadoopRasterMethods[Png]
- Definition Classes
- Implicits
-
implicit
class
withSaveBytesToHadoopMethods[K] extends SaveBytesToHadoopMethods[K]
- Definition Classes
- Implicits
-
implicit
class
withSaveToHadoopMethods[K, V] extends SaveToHadoopMethods[K, V]
- Definition Classes
- Implicits
- class KeyPartitioner[K] extends Partitioner
- abstract class LineScanner extends Iterator[String] with Closeable
- class SaveBytesToHadoopMethods[K] extends AnyRef
- class SaveToHadoopMethods[K, V] extends AnyRef
-
case class
SerializableConfiguration(value: Configuration) extends Serializable with Product
From Spark codebase.
From Spark codebase. Allows us to use the Hadoop Configuration in serializable tasks
- implicit class withHadoopConfigurationMethods extends MethodExtensions[Configuration]
Value Members
- implicit def stringToPath(path: String): Path
- object HadoopAttributeStore extends Serializable
- object HadoopCatalogConfig extends Serializable
- object HadoopCollectionLayerReader
- object HadoopCollectionReader
-
object
HadoopGeoTiffRDD extends LazyLogging
Allows for reading of whole or windowed GeoTiff as RDD[(K, V)]s through Hadoop FileSystem API.
- object HadoopGeoTiffReader
- object HadoopJpgReader
- object HadoopLayerCopier
- object HadoopLayerDeleter
- object HadoopLayerHeader extends Serializable
- object HadoopLayerMover
- object HadoopLayerReader
- object HadoopLayerReindexer
- object HadoopLayerWriter
- object HadoopPngReader
- object HadoopRDDReader extends LazyLogging
- object HadoopRDDWriter extends LazyLogging
- object HadoopValueReader
- object HdfsRangeReader
- object HdfsUtils extends LazyLogging
- object Implicits extends Implicits
- object KeyPartitioner extends Serializable
- object SaveToHadoop