split

Type Members

1. class SplitSampleRDDFunctions[T] extends Serializable

   

   Enhances RDDs with methods for split-sampling

   Enhances RDDs with methods for split-sampling

   T

   The row type of the RDD

   // import conversions to enhance RDDs with split sampling
   import io.radanalytics.silex.sample.split.implicits._
   // obtain a sequence of 5 RDDs randomly split from RDD 'data', where each element
   // has probability 1/5 of being assigned to each output.
   val splits = data.splitSample(5)
   // randomly split data so that the second output has twice the probability of receiving
   // a data element as the first, and the third output has three times the probability.
   val splitsW = data.weightedSplitSample(Seq(1.0, 2.0, 3.0))