com.datastax.spark.connector.rdd

CassandraRDD

class CassandraRDD[R] extends RDD[R] with Logging

RDD representing a Cassandra table. This class is the main entry point for analyzing data in Cassandra database with Spark. Obtain objects of this class by calling cassandraTable.

Configuration properties should be passed in the SparkConf configuration of SparkContext. CassandraRDD needs to open connection to Cassandra, therefore it requires appropriate connection property values to be present in SparkConf. For the list of required and available properties, see CassandraConnector.

CassandraRDD divides the dataset into smaller partitions, processed locally on every cluster node. A data partition consists of one or more contiguous token ranges. To reduce the number of roundtrips to Cassandra, every partition is fetched in batches. The following properties control the number of partitions and the fetch size:

A CassandraRDD object gets serialized and sent to every Spark executor.

By default, reads are performed at ConsistencyLevel.LOCAL_ONE in order to leverage data-locality and minimize network traffic. This read consistency level is controlled by the following property:

If a Cassandra node fails or gets overloaded during read, queries are retried to a different node.

Linear Supertypes
Logging, RDD[R], Logging, Serializable, Serializable, AnyRef, Any
Known Subclasses
Ordering
  1. Alphabetic
  2. By inheritance
Inherited
  1. CassandraRDD
  2. Logging
  3. RDD
  4. Logging
  5. Serializable
  6. Serializable
  7. AnyRef
  8. Any
Implicitly
  1. by toRDDFunctions
  2. by any2stringadd
  3. by any2stringfmt
  4. by any2ArrowAssoc
  5. by any2Ensuring
  1. Hide All
  2. Show all
Learn more about member selection
Visibility
  1. Public
  2. All

Value Members

  1. final def !=(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  2. final def !=(arg0: Any): Boolean

    Definition Classes
    Any
  3. final def ##(): Int

    Definition Classes
    AnyRef → Any
  4. def +(other: String): String

    Implicit information
    This member is added by an implicit conversion from CassandraRDD[R] to StringAdd performed by method any2stringadd in scala.Predef.
    Definition Classes
    StringAdd
  5. def ++(other: RDD[R]): RDD[R]

    Definition Classes
    RDD
  6. def ->[B](y: B): (CassandraRDD[R], B)

    Implicit information
    This member is added by an implicit conversion from CassandraRDD[R] to ArrowAssoc[CassandraRDD[R]] performed by method any2ArrowAssoc in scala.Predef.
    Definition Classes
    ArrowAssoc
    Annotations
    @inline()
  7. final def ==(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  8. final def ==(arg0: Any): Boolean

    Definition Classes
    Any
  9. def aggregate[U](zeroValue: U)(seqOp: (U, R) ⇒ U, combOp: (U, U) ⇒ U)(implicit arg0: ClassTag[U]): U

    Definition Classes
    RDD
  10. def as[B, A0, A1, A2, A3, A4, A5, A6, A7, A8, A9, A10, A11](f: (A0, A1, A2, A3, A4, A5, A6, A7, A8, A9, A10, A11) ⇒ B)(implicit arg0: ClassTag[B], arg1: TypeConverter[A0], arg2: TypeConverter[A1], arg3: TypeConverter[A2], arg4: TypeConverter[A3], arg5: TypeConverter[A4], arg6: TypeConverter[A5], arg7: TypeConverter[A6], arg8: TypeConverter[A7], arg9: TypeConverter[A8], arg10: TypeConverter[A9], arg11: TypeConverter[A10], arg12: TypeConverter[A11]): CassandraRDD[B]

  11. def as[B, A0, A1, A2, A3, A4, A5, A6, A7, A8, A9, A10](f: (A0, A1, A2, A3, A4, A5, A6, A7, A8, A9, A10) ⇒ B)(implicit arg0: ClassTag[B], arg1: TypeConverter[A0], arg2: TypeConverter[A1], arg3: TypeConverter[A2], arg4: TypeConverter[A3], arg5: TypeConverter[A4], arg6: TypeConverter[A5], arg7: TypeConverter[A6], arg8: TypeConverter[A7], arg9: TypeConverter[A8], arg10: TypeConverter[A9], arg11: TypeConverter[A10]): CassandraRDD[B]

  12. def as[B, A0, A1, A2, A3, A4, A5, A6, A7, A8, A9](f: (A0, A1, A2, A3, A4, A5, A6, A7, A8, A9) ⇒ B)(implicit arg0: ClassTag[B], arg1: TypeConverter[A0], arg2: TypeConverter[A1], arg3: TypeConverter[A2], arg4: TypeConverter[A3], arg5: TypeConverter[A4], arg6: TypeConverter[A5], arg7: TypeConverter[A6], arg8: TypeConverter[A7], arg9: TypeConverter[A8], arg10: TypeConverter[A9]): CassandraRDD[B]

  13. def as[B, A0, A1, A2, A3, A4, A5, A6, A7, A8](f: (A0, A1, A2, A3, A4, A5, A6, A7, A8) ⇒ B)(implicit arg0: ClassTag[B], arg1: TypeConverter[A0], arg2: TypeConverter[A1], arg3: TypeConverter[A2], arg4: TypeConverter[A3], arg5: TypeConverter[A4], arg6: TypeConverter[A5], arg7: TypeConverter[A6], arg8: TypeConverter[A7], arg9: TypeConverter[A8]): CassandraRDD[B]

  14. def as[B, A0, A1, A2, A3, A4, A5, A6, A7](f: (A0, A1, A2, A3, A4, A5, A6, A7) ⇒ B)(implicit arg0: ClassTag[B], arg1: TypeConverter[A0], arg2: TypeConverter[A1], arg3: TypeConverter[A2], arg4: TypeConverter[A3], arg5: TypeConverter[A4], arg6: TypeConverter[A5], arg7: TypeConverter[A6], arg8: TypeConverter[A7]): CassandraRDD[B]

  15. def as[B, A0, A1, A2, A3, A4, A5, A6](f: (A0, A1, A2, A3, A4, A5, A6) ⇒ B)(implicit arg0: ClassTag[B], arg1: TypeConverter[A0], arg2: TypeConverter[A1], arg3: TypeConverter[A2], arg4: TypeConverter[A3], arg5: TypeConverter[A4], arg6: TypeConverter[A5], arg7: TypeConverter[A6]): CassandraRDD[B]

  16. def as[B, A0, A1, A2, A3, A4, A5](f: (A0, A1, A2, A3, A4, A5) ⇒ B)(implicit arg0: ClassTag[B], arg1: TypeConverter[A0], arg2: TypeConverter[A1], arg3: TypeConverter[A2], arg4: TypeConverter[A3], arg5: TypeConverter[A4], arg6: TypeConverter[A5]): CassandraRDD[B]

  17. def as[B, A0, A1, A2, A3, A4](f: (A0, A1, A2, A3, A4) ⇒ B)(implicit arg0: ClassTag[B], arg1: TypeConverter[A0], arg2: TypeConverter[A1], arg3: TypeConverter[A2], arg4: TypeConverter[A3], arg5: TypeConverter[A4]): CassandraRDD[B]

  18. def as[B, A0, A1, A2, A3](f: (A0, A1, A2, A3) ⇒ B)(implicit arg0: ClassTag[B], arg1: TypeConverter[A0], arg2: TypeConverter[A1], arg3: TypeConverter[A2], arg4: TypeConverter[A3]): CassandraRDD[B]

  19. def as[B, A0, A1, A2](f: (A0, A1, A2) ⇒ B)(implicit arg0: ClassTag[B], arg1: TypeConverter[A0], arg2: TypeConverter[A1], arg3: TypeConverter[A2]): CassandraRDD[B]

  20. def as[B, A0, A1](f: (A0, A1) ⇒ B)(implicit arg0: ClassTag[B], arg1: TypeConverter[A0], arg2: TypeConverter[A1]): CassandraRDD[B]

  21. def as[B, A0](f: (A0) ⇒ B)(implicit arg0: ClassTag[B], arg1: TypeConverter[A0]): CassandraRDD[B]

    Maps each row into object of a different type using provided function taking column value(s) as argument(s).

    Maps each row into object of a different type using provided function taking column value(s) as argument(s). Can be used to convert each row to a tuple or a case class object:

    sc.cassandraTable("ks", "table").select("column1").as((s: String) => s)                 // yields CassandraRDD[String]
    sc.cassandraTable("ks", "table").select("column1", "column2").as((_: String, _: Long))  // yields CassandraRDD[(String, Long)]
    
    case class MyRow(key: String, value: Long)
    sc.cassandraTable("ks", "table").select("column1", "column2").as(MyRow)                 // yields CassandraRDD[MyRow]
  22. final def asInstanceOf[T0]: T0

    Definition Classes
    Any
  23. def cache(): CassandraRDD.this.type

    Definition Classes
    RDD
  24. def cartesian[U](other: RDD[U])(implicit arg0: ClassTag[U]): RDD[(R, U)]

    Definition Classes
    RDD
  25. def checkpoint(): Unit

    Definition Classes
    RDD
  26. def clearDependencies(): Unit

    Attributes
    protected
    Definition Classes
    RDD
  27. def clone(): AnyRef

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  28. def coalesce(numPartitions: Int, shuffle: Boolean)(implicit ord: Ordering[R]): RDD[R]

    Definition Classes
    RDD
  29. def collect[U](f: PartialFunction[R, U])(implicit arg0: ClassTag[U]): RDD[U]

    Definition Classes
    RDD
  30. def collect(): Array[R]

    Definition Classes
    RDD
  31. val columnNames: ColumnSelector

  32. def compute(split: Partition, context: TaskContext): Iterator[R]

    Definition Classes
    CassandraRDD → RDD
  33. val connector: CassandraConnector

  34. def context: SparkContext

    Definition Classes
    RDD
  35. def count(): Long

    Definition Classes
    RDD
  36. def countApprox(timeout: Long, confidence: Double): PartialResult[BoundedDouble]

    Definition Classes
    RDD
    Annotations
    @Experimental()
  37. def countApproxDistinct(relativeSD: Double): Long

    Definition Classes
    RDD
  38. def countApproxDistinct(p: Int, sp: Int): Long

    Definition Classes
    RDD
    Annotations
    @Experimental()
  39. def countByValue()(implicit ord: Ordering[R]): Map[R, Long]

    Definition Classes
    RDD
  40. def countByValueApprox(timeout: Long, confidence: Double)(implicit ord: Ordering[R]): PartialResult[Map[R, BoundedDouble]]

    Definition Classes
    RDD
    Annotations
    @Experimental()
  41. final def dependencies: Seq[Dependency[_]]

    Definition Classes
    RDD
  42. def distinct(): RDD[R]

    Definition Classes
    RDD
  43. def distinct(numPartitions: Int)(implicit ord: Ordering[R]): RDD[R]

    Definition Classes
    RDD
  44. def ensuring(cond: (CassandraRDD[R]) ⇒ Boolean, msg: ⇒ Any): CassandraRDD[R]

    Implicit information
    This member is added by an implicit conversion from CassandraRDD[R] to Ensuring[CassandraRDD[R]] performed by method any2Ensuring in scala.Predef.
    Definition Classes
    Ensuring
  45. def ensuring(cond: (CassandraRDD[R]) ⇒ Boolean): CassandraRDD[R]

    Implicit information
    This member is added by an implicit conversion from CassandraRDD[R] to Ensuring[CassandraRDD[R]] performed by method any2Ensuring in scala.Predef.
    Definition Classes
    Ensuring
  46. def ensuring(cond: Boolean, msg: ⇒ Any): CassandraRDD[R]

    Implicit information
    This member is added by an implicit conversion from CassandraRDD[R] to Ensuring[CassandraRDD[R]] performed by method any2Ensuring in scala.Predef.
    Definition Classes
    Ensuring
  47. def ensuring(cond: Boolean): CassandraRDD[R]

    Implicit information
    This member is added by an implicit conversion from CassandraRDD[R] to Ensuring[CassandraRDD[R]] performed by method any2Ensuring in scala.Predef.
    Definition Classes
    Ensuring
  48. final def eq(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  49. def equals(arg0: Any): Boolean

    Definition Classes
    AnyRef → Any
  50. def filter(f: (R) ⇒ Boolean): RDD[R]

    Definition Classes
    RDD
  51. def finalize(): Unit

    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  52. def first(): R

    Definition Classes
    RDD
  53. def firstParent[U](implicit arg0: ClassTag[U]): RDD[U]

    Attributes
    protected[org.apache.spark]
    Definition Classes
    RDD
  54. def flatMap[U](f: (R) ⇒ TraversableOnce[U])(implicit arg0: ClassTag[U]): RDD[U]

    Definition Classes
    RDD
  55. def fold(zeroValue: R)(op: (R, R) ⇒ R): R

    Definition Classes
    RDD
  56. def foreach(f: (R) ⇒ Unit): Unit

    Definition Classes
    RDD
  57. def foreachPartition(f: (Iterator[R]) ⇒ Unit): Unit

    Definition Classes
    RDD
  58. def formatted(fmtstr: String): String

    Implicit information
    This member is added by an implicit conversion from CassandraRDD[R] to StringFormat performed by method any2stringfmt in scala.Predef.
    Definition Classes
    StringFormat
    Annotations
    @inline()
  59. def getCheckpointFile: Option[String]

    Definition Classes
    RDD
  60. final def getClass(): Class[_]

    Definition Classes
    AnyRef → Any
  61. def getDependencies: Seq[Dependency[_]]

    Attributes
    protected
    Definition Classes
    RDD
  62. def getPartitions: Array[Partition]

    Definition Classes
    CassandraRDD → RDD
  63. def getPreferredLocations(split: Partition): Seq[String]

    Definition Classes
    CassandraRDD → RDD
  64. def getSparkClassLoader: ClassLoader

    Get the ClassLoader which loaded Spark.

    Get the ClassLoader which loaded Spark.

    Definition Classes
    Logging
  65. def getStorageLevel: StorageLevel

    Definition Classes
    RDD
  66. def glom(): RDD[Array[R]]

    Definition Classes
    RDD
  67. def groupBy[K](f: (R) ⇒ K, p: Partitioner)(implicit kt: ClassTag[K], ord: Ordering[K]): RDD[(K, Iterable[R])]

    Definition Classes
    RDD
  68. def groupBy[K](f: (R) ⇒ K, numPartitions: Int)(implicit kt: ClassTag[K]): RDD[(K, Iterable[R])]

    Definition Classes
    RDD
  69. def groupBy[K](f: (R) ⇒ K)(implicit kt: ClassTag[K]): RDD[(K, Iterable[R])]

    Definition Classes
    RDD
  70. def hashCode(): Int

    Definition Classes
    AnyRef → Any
  71. val id: Int

    Definition Classes
    RDD
  72. def intersection(other: RDD[R], numPartitions: Int): RDD[R]

    Definition Classes
    RDD
  73. def intersection(other: RDD[R], partitioner: Partitioner)(implicit ord: Ordering[R]): RDD[R]

    Definition Classes
    RDD
  74. def intersection(other: RDD[R]): RDD[R]

    Definition Classes
    RDD
  75. def isCheckpointed: Boolean

    Definition Classes
    RDD
  76. final def isInstanceOf[T0]: Boolean

    Definition Classes
    Any
  77. def isTraceEnabled(): Boolean

    Definition Classes
    CassandraRDD → Logging → Logging
  78. final def iterator(split: Partition, context: TaskContext): Iterator[R]

    Definition Classes
    RDD
  79. def keyBy[K](f: (R) ⇒ K): RDD[(K, R)]

    Definition Classes
    RDD
  80. val keyspaceName: String

  81. def log: Logger

    Definition Classes
    CassandraRDD → Logging → Logging
  82. def logDebug(msg: ⇒ String, throwable: Throwable): Unit

    Definition Classes
    CassandraRDD → Logging → Logging
  83. def logDebug(msg: ⇒ String): Unit

    Definition Classes
    CassandraRDD → Logging → Logging
  84. def logError(msg: ⇒ String, throwable: Throwable): Unit

    Definition Classes
    CassandraRDD → Logging → Logging
  85. def logError(msg: ⇒ String): Unit

    Definition Classes
    CassandraRDD → Logging → Logging
  86. def logInfo(msg: ⇒ String, throwable: Throwable): Unit

    Definition Classes
    CassandraRDD → Logging → Logging
  87. def logInfo(msg: ⇒ String): Unit

    Definition Classes
    CassandraRDD → Logging → Logging
  88. def logName: String

    Definition Classes
    CassandraRDD → Logging → Logging
  89. def logTrace(msg: ⇒ String, throwable: Throwable): Unit

    Definition Classes
    CassandraRDD → Logging → Logging
  90. def logTrace(msg: ⇒ String): Unit

    Definition Classes
    CassandraRDD → Logging → Logging
  91. def logWarning(msg: ⇒ String, throwable: Throwable): Unit

    Definition Classes
    CassandraRDD → Logging → Logging
  92. def logWarning(msg: ⇒ String): Unit

    Definition Classes
    CassandraRDD → Logging → Logging
  93. def map[U](f: (R) ⇒ U)(implicit arg0: ClassTag[U]): RDD[U]

    Definition Classes
    RDD
  94. def mapPartitions[U](f: (Iterator[R]) ⇒ Iterator[U], preservesPartitioning: Boolean)(implicit arg0: ClassTag[U]): RDD[U]

    Definition Classes
    RDD
  95. def mapPartitionsWithContext[U](f: (TaskContext, Iterator[R]) ⇒ Iterator[U], preservesPartitioning: Boolean)(implicit arg0: ClassTag[U]): RDD[U]

    Definition Classes
    RDD
    Annotations
    @DeveloperApi()
  96. def mapPartitionsWithIndex[U](f: (Int, Iterator[R]) ⇒ Iterator[U], preservesPartitioning: Boolean)(implicit arg0: ClassTag[U]): RDD[U]

    Definition Classes
    RDD
  97. def max()(implicit ord: Ordering[R]): R

    Definition Classes
    RDD
  98. def min()(implicit ord: Ordering[R]): R

    Definition Classes
    RDD
  99. var name: String

    Definition Classes
    RDD
  100. final def ne(arg0: AnyRef): Boolean

    Definition Classes
    AnyRef
  101. final def notify(): Unit

    Definition Classes
    AnyRef
  102. final def notifyAll(): Unit

    Definition Classes
    AnyRef
  103. val partitioner: Option[Partitioner]

    Definition Classes
    RDD
  104. final def partitions: Array[Partition]

    Definition Classes
    RDD
  105. def persist(): CassandraRDD.this.type

    Definition Classes
    RDD
  106. def persist(newLevel: StorageLevel): CassandraRDD.this.type

    Definition Classes
    RDD
  107. def pipe(command: Seq[String], env: Map[String, String], printPipeContext: ((String) ⇒ Unit) ⇒ Unit, printRDDElement: (R, (String) ⇒ Unit) ⇒ Unit, separateWorkingDir: Boolean): RDD[String]

    Definition Classes
    RDD
  108. def pipe(command: String, env: Map[String, String]): RDD[String]

    Definition Classes
    RDD
  109. def pipe(command: String): RDD[String]

    Definition Classes
    RDD
  110. final def preferredLocations(split: Partition): Seq[String]

    Definition Classes
    RDD
  111. def randomSplit(weights: Array[Double], seed: Long): Array[RDD[R]]

    Definition Classes
    RDD
  112. val readConf: ReadConf

  113. def reduce(f: (R, R) ⇒ R): R

    Definition Classes
    RDD
  114. def repartition(numPartitions: Int)(implicit ord: Ordering[R]): RDD[R]

    Definition Classes
    RDD
  115. def sample(withReplacement: Boolean, fraction: Double, seed: Long): RDD[R]

    Definition Classes
    RDD
  116. def saveAsObjectFile(path: String): Unit

    Definition Classes
    RDD
  117. def saveAsTextFile(path: String, codec: Class[_ <: CompressionCodec]): Unit

    Definition Classes
    RDD
  118. def saveAsTextFile(path: String): Unit

    Definition Classes
    RDD
  119. def saveToCassandra(keyspaceName: String, tableName: String, columns: ColumnSelector = AllColumns, writeConf: WriteConf = ...)(implicit connector: CassandraConnector = ..., rwf: RowWriterFactory[R]): Unit

    Saves the data from RDD to a Cassandra table.

    Saves the data from RDD to a Cassandra table. Uses the specified column names.

    keyspaceName

    the name of the Keyspace to use

    tableName

    the name of the Table to use

    writeConf

    additional configuration object allowing to set consistency level, batch size, etc.

    Implicit information
    This member is added by an implicit conversion from CassandraRDD[R] to RDDFunctions[R] performed by method toRDDFunctions in com.datastax.spark.connector. This conversion will take place only if R is accompanied by a ClassTag, which is a runtime representation of its type that survives erasure (R: ClassTag).
    Definition Classes
    RDDFunctions → WritableToCassandra
    See also

    com.datastax.spark.connector.writer.WritableToCassandra

  120. def select(columns: String*): CassandraRDD[R]

    Narrows down the selected set of columns.

    Narrows down the selected set of columns. Use this for better performance, when you don't need all the columns in the result RDD. When called multiple times, it selects the subset of the already selected columns, so after a column was removed by the previous select call, it is not possible to add it back.

  121. lazy val selectedColumnNames: Seq[String]

    Returns the names of columns to be selected from the table.

  122. def setName(_name: String): CassandraRDD.this.type

    Definition Classes
    RDD
  123. def sortBy[K](f: (R) ⇒ K, ascending: Boolean, numPartitions: Int)(implicit ord: Ordering[K], ctag: ClassTag[K]): RDD[R]

    Definition Classes
    RDD
  124. def sparkContext: SparkContext

    Definition Classes
    RDD
  125. def subtract(other: RDD[R], p: Partitioner)(implicit ord: Ordering[R]): RDD[R]

    Definition Classes
    RDD
  126. def subtract(other: RDD[R], numPartitions: Int): RDD[R]

    Definition Classes
    RDD
  127. def subtract(other: RDD[R]): RDD[R]

    Definition Classes
    RDD
  128. final def synchronized[T0](arg0: ⇒ T0): T0

    Definition Classes
    AnyRef
  129. lazy val tableDef: TableDef

  130. val tableName: String

  131. def take(num: Int): Array[R]

    Definition Classes
    RDD
  132. def takeOrdered(num: Int)(implicit ord: Ordering[R]): Array[R]

    Definition Classes
    RDD
  133. def takeSample(withReplacement: Boolean, num: Int, seed: Long): Array[R]

    Definition Classes
    RDD
  134. def toDebugString: String

    Definition Classes
    RDD
  135. def toJavaRDD(): JavaRDD[R]

    Definition Classes
    RDD
  136. def toLocalIterator: Iterator[R]

    Definition Classes
    RDD
  137. def toString(): String

    Definition Classes
    RDD → AnyRef → Any
  138. def top(num: Int)(implicit ord: Ordering[R]): Array[R]

    Definition Classes
    RDD
  139. def union(other: RDD[R]): RDD[R]

    Definition Classes
    RDD
  140. def unpersist(blocking: Boolean): CassandraRDD.this.type

    Definition Classes
    RDD
  141. lazy val verify: Unit

  142. final def wait(): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  143. final def wait(arg0: Long, arg1: Int): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  144. final def wait(arg0: Long): Unit

    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  145. def where(cql: String, values: Any*): CassandraRDD[R]

    Adds a CQL WHERE predicate(s) to the query.

    Adds a CQL WHERE predicate(s) to the query. Useful for leveraging secondary indexes in Cassandra. Implicitly adds an ALLOW FILTERING clause to the WHERE clause, however beware that some predicates might be rejected by Cassandra, particularly in cases when they filter on an unindexed, non-clustering column.

  146. val where: CqlWhereClause

  147. def withConnector(connector: CassandraConnector): CassandraRDD[R]

    Returns a copy of this Cassandra RDD with specified connector

  148. def withReadConf(readConf: ReadConf): CassandraRDD[R]

    Allows to set custom read configuration, e.

    Allows to set custom read configuration, e.g. consistency level or fetch size.

  149. def zip[U](other: RDD[U])(implicit arg0: ClassTag[U]): RDD[(R, U)]

    Definition Classes
    RDD
  150. def zipPartitions[B, C, D, V](rdd2: RDD[B], rdd3: RDD[C], rdd4: RDD[D])(f: (Iterator[R], Iterator[B], Iterator[C], Iterator[D]) ⇒ Iterator[V])(implicit arg0: ClassTag[B], arg1: ClassTag[C], arg2: ClassTag[D], arg3: ClassTag[V]): RDD[V]

    Definition Classes
    RDD
  151. def zipPartitions[B, C, D, V](rdd2: RDD[B], rdd3: RDD[C], rdd4: RDD[D], preservesPartitioning: Boolean)(f: (Iterator[R], Iterator[B], Iterator[C], Iterator[D]) ⇒ Iterator[V])(implicit arg0: ClassTag[B], arg1: ClassTag[C], arg2: ClassTag[D], arg3: ClassTag[V]): RDD[V]

    Definition Classes
    RDD
  152. def zipPartitions[B, C, V](rdd2: RDD[B], rdd3: RDD[C])(f: (Iterator[R], Iterator[B], Iterator[C]) ⇒ Iterator[V])(implicit arg0: ClassTag[B], arg1: ClassTag[C], arg2: ClassTag[V]): RDD[V]

    Definition Classes
    RDD
  153. def zipPartitions[B, C, V](rdd2: RDD[B], rdd3: RDD[C], preservesPartitioning: Boolean)(f: (Iterator[R], Iterator[B], Iterator[C]) ⇒ Iterator[V])(implicit arg0: ClassTag[B], arg1: ClassTag[C], arg2: ClassTag[V]): RDD[V]

    Definition Classes
    RDD
  154. def zipPartitions[B, V](rdd2: RDD[B])(f: (Iterator[R], Iterator[B]) ⇒ Iterator[V])(implicit arg0: ClassTag[B], arg1: ClassTag[V]): RDD[V]

    Definition Classes
    RDD
  155. def zipPartitions[B, V](rdd2: RDD[B], preservesPartitioning: Boolean)(f: (Iterator[R], Iterator[B]) ⇒ Iterator[V])(implicit arg0: ClassTag[B], arg1: ClassTag[V]): RDD[V]

    Definition Classes
    RDD
  156. def zipWithIndex(): RDD[(R, Long)]

    Definition Classes
    RDD
  157. def zipWithUniqueId(): RDD[(R, Long)]

    Definition Classes
    RDD
  158. def →[B](y: B): (CassandraRDD[R], B)

    Implicit information
    This member is added by an implicit conversion from CassandraRDD[R] to ArrowAssoc[CassandraRDD[R]] performed by method any2ArrowAssoc in scala.Predef.
    Definition Classes
    ArrowAssoc

Shadowed Implicit Value Members

  1. val self: Any

    Implicit information
    This member is added by an implicit conversion from CassandraRDD[R] to StringAdd performed by method any2stringadd in scala.Predef.
    Shadowing
    This implicitly inherited member is ambiguous. One or more implicitly inherited members have similar signatures, so calling this member may produce an ambiguous implicit conversion compiler error.
    To access this member you can use a type ascription:
    (cassandraRDD: StringAdd).self
    Definition Classes
    StringAdd
  2. val self: Any

    Implicit information
    This member is added by an implicit conversion from CassandraRDD[R] to StringFormat performed by method any2stringfmt in scala.Predef.
    Shadowing
    This implicitly inherited member is ambiguous. One or more implicitly inherited members have similar signatures, so calling this member may produce an ambiguous implicit conversion compiler error.
    To access this member you can use a type ascription:
    (cassandraRDD: StringFormat).self
    Definition Classes
    StringFormat
  3. val sparkContext: SparkContext

    Implicit information
    This member is added by an implicit conversion from CassandraRDD[R] to RDDFunctions[R] performed by method toRDDFunctions in com.datastax.spark.connector. This conversion will take place only if R is accompanied by a ClassTag, which is a runtime representation of its type that survives erasure (R: ClassTag).
    Shadowing
    This implicitly inherited member is shadowed by one or more members in this class.
    To access this member you can use a type ascription:
    (cassandraRDD: RDDFunctions[R]).sparkContext
    Definition Classes
    RDDFunctions → WritableToCassandra

Deprecated Value Members

  1. def filterWith[A](constructA: (Int) ⇒ A)(p: (R, A) ⇒ Boolean): RDD[R]

    Definition Classes
    RDD
    Annotations
    @deprecated
    Deprecated

    (Since version 1.0.0) use mapPartitionsWithIndex and filter

  2. def flatMapWith[A, U](constructA: (Int) ⇒ A, preservesPartitioning: Boolean)(f: (R, A) ⇒ Seq[U])(implicit arg0: ClassTag[U]): RDD[U]

    Definition Classes
    RDD
    Annotations
    @deprecated
    Deprecated

    (Since version 1.0.0) use mapPartitionsWithIndex and flatMap

  3. def foreachWith[A](constructA: (Int) ⇒ A)(f: (R, A) ⇒ Unit): Unit

    Definition Classes
    RDD
    Annotations
    @deprecated
    Deprecated

    (Since version 1.0.0) use mapPartitionsWithIndex and foreach

  4. def mapPartitionsWithSplit[U](f: (Int, Iterator[R]) ⇒ Iterator[U], preservesPartitioning: Boolean)(implicit arg0: ClassTag[U]): RDD[U]

    Definition Classes
    RDD
    Annotations
    @deprecated
    Deprecated

    (Since version 0.7.0) use mapPartitionsWithIndex

  5. def mapWith[A, U](constructA: (Int) ⇒ A, preservesPartitioning: Boolean)(f: (R, A) ⇒ U)(implicit arg0: ClassTag[U]): RDD[U]

    Definition Classes
    RDD
    Annotations
    @deprecated
    Deprecated

    (Since version 1.0.0) use mapPartitionsWithIndex

  6. def toArray(): Array[R]

    Definition Classes
    RDD
    Annotations
    @deprecated
    Deprecated

    (Since version 1.0.0) use collect

  7. def x: CassandraRDD[R]

    Implicit information
    This member is added by an implicit conversion from CassandraRDD[R] to ArrowAssoc[CassandraRDD[R]] performed by method any2ArrowAssoc in scala.Predef.
    Shadowing
    This implicitly inherited member is ambiguous. One or more implicitly inherited members have similar signatures, so calling this member may produce an ambiguous implicit conversion compiler error.
    To access this member you can use a type ascription:
    (cassandraRDD: ArrowAssoc[CassandraRDD[R]]).x
    Definition Classes
    ArrowAssoc
    Annotations
    @deprecated
    Deprecated

    (Since version 2.10.0) Use leftOfArrow instead

  8. def x: CassandraRDD[R]

    Implicit information
    This member is added by an implicit conversion from CassandraRDD[R] to Ensuring[CassandraRDD[R]] performed by method any2Ensuring in scala.Predef.
    Shadowing
    This implicitly inherited member is ambiguous. One or more implicitly inherited members have similar signatures, so calling this member may produce an ambiguous implicit conversion compiler error.
    To access this member you can use a type ascription:
    (cassandraRDD: Ensuring[CassandraRDD[R]]).x
    Definition Classes
    Ensuring
    Annotations
    @deprecated
    Deprecated

    (Since version 2.10.0) Use resultOfEnsuring instead

Inherited from Logging

Inherited from RDD[R]

Inherited from Logging

Inherited from Serializable

Inherited from Serializable

Inherited from AnyRef

Inherited from Any

Inherited by implicit conversion toRDDFunctions from CassandraRDD[R] to RDDFunctions[R]

Inherited by implicit conversion any2stringadd from CassandraRDD[R] to StringAdd

Inherited by implicit conversion any2stringfmt from CassandraRDD[R] to StringFormat

Inherited by implicit conversion any2ArrowAssoc from CassandraRDD[R] to ArrowAssoc[CassandraRDD[R]]

Inherited by implicit conversion any2Ensuring from CassandraRDD[R] to Ensuring[CassandraRDD[R]]

Ungrouped