package hadoop

Linear Supertypes
Implicits, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. hadoop
  2. Implicits
  3. AnyRef
  4. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Type Members

  1. class HadoopAttributeStore extends BlobLayerAttributeStore
  2. case class HadoopCatalogConfig(compressionFactor: Double, metadataFileName: String, layerDataDir: (LayerId) ⇒ String) extends Product with Serializable
  3. class HadoopCollectionLayerReader extends CollectionLayerReader[LayerId] with LazyLogging

    Handles reading raster RDDs and their metadata from S3.

  4. class HadoopCollectionReader extends AnyRef
  5. case class HadoopGeoTiffInfoReader(path: String, config: SerializableConfiguration, tiffExtensions: Seq[String] = ..., streaming: Boolean = true) extends GeoTiffInfoReader with Product with Serializable
  6. class HadoopLayerCopier extends LayerCopier[LayerId]
  7. class HadoopLayerDeleter extends LazyLogging with LayerDeleter[LayerId]
  8. case class HadoopLayerHeader(keyClass: String, valueClass: String, path: URI, layerType: LayerType = AvroLayerType) extends LayerHeader with Product with Serializable
  9. class HadoopLayerManager extends LayerManager[LayerId]
  10. class HadoopLayerMover extends LayerMover[LayerId]
  11. class HadoopLayerProvider extends AttributeStoreProvider with LayerReaderProvider with LayerWriterProvider with ValueReaderProvider with CollectionLayerReaderProvider

    Provides HadoopAttributeStore instance for URI with hdfs, hdfs+file, s3n, s3a, wasb and wasbs schemes.

    Provides HadoopAttributeStore instance for URI with hdfs, hdfs+file, s3n, s3a, wasb and wasbs schemes. The uri represents Hadoop Path of catalog root. wasb and wasbs provide support for the Hadoop Azure connector. Additional configuration is required for this. This Provider intentinally does not handle the s3 scheme because the Hadoop implemintation is poor. That support is provided by HadoopAttributeStore

  12. class HadoopLayerReader extends FilteringLayerReader[LayerId] with LazyLogging

    Handles reading raster RDDs and their metadata from S3.

  13. class HadoopLayerWriter extends LayerWriter[LayerId] with LazyLogging
  14. trait HadoopRasterMethods[T] extends MethodExtensions[T]
  15. trait HadoopSparkContextMethods extends AnyRef
  16. class HadoopValueReader extends OverzoomingValueReader
  17. class HdfsRangeReader extends RangeReader

    This class extends RangeReader by reading chunks out of a GeoTiff on HDFS.

    This class extends RangeReader by reading chunks out of a GeoTiff on HDFS.

    returns

    A new instance of S3RangeReader.

  18. trait Implicits extends AnyRef
  19. implicit class HadoopSparkContextMethodsWrapper extends HadoopSparkContextMethods
    Definition Classes
    Implicits
  20. implicit class withGeoTiffHadoopWriteMethods[T <: CellGrid] extends HadoopRasterMethods[GeoTiff[T]]
    Definition Classes
    Implicits
  21. implicit class withJpgHadoopWriteMethods extends HadoopRasterMethods[Jpg]
    Definition Classes
    Implicits
  22. implicit class withPngHadoopWriteMethods extends HadoopRasterMethods[Png]
    Definition Classes
    Implicits
  23. implicit class withSaveBytesToHadoopMethods[K] extends SaveBytesToHadoopMethods[K]
    Definition Classes
    Implicits
  24. implicit class withSaveToHadoopMethods[K, V] extends SaveToHadoopMethods[K, V]
    Definition Classes
    Implicits
  25. class KeyPartitioner[K] extends Partitioner
  26. abstract class LineScanner extends Iterator[String] with Closeable
  27. class SaveBytesToHadoopMethods[K] extends AnyRef
  28. class SaveToHadoopMethods[K, V] extends AnyRef
  29. case class SerializableConfiguration(value: Configuration) extends Serializable with Product

    From Spark codebase.

    From Spark codebase. Allows us to use the Hadoop Configuration in serializable tasks

  30. implicit class withHadoopConfigurationMethods extends MethodExtensions[Configuration]

Value Members

  1. implicit def stringToPath(path: String): Path
  2. object HadoopAttributeStore extends Serializable
  3. object HadoopCatalogConfig extends Serializable
  4. object HadoopCollectionLayerReader
  5. object HadoopCollectionReader
  6. object HadoopGeoTiffRDD extends LazyLogging

    Allows for reading of whole or windowed GeoTiff as RDD[(K, V)]s through Hadoop FileSystem API.

  7. object HadoopGeoTiffReader
  8. object HadoopJpgReader
  9. object HadoopLayerCopier
  10. object HadoopLayerDeleter
  11. object HadoopLayerHeader extends Serializable
  12. object HadoopLayerMover
  13. object HadoopLayerReader
  14. object HadoopLayerReindexer
  15. object HadoopLayerWriter
  16. object HadoopPngReader
  17. object HadoopRDDReader extends LazyLogging
  18. object HadoopRDDWriter extends LazyLogging
  19. object HadoopValueReader
  20. object HdfsRangeReader
  21. object HdfsUtils extends LazyLogging
  22. object Implicits extends Implicits
  23. object KeyPartitioner extends Serializable
  24. object SaveToHadoop

Inherited from Implicits

Inherited from AnyRef

Inherited from Any

Ungrouped