Class

io.radanalytics.silex.histogram.rdd

HistogramMethodsRDD

Related Doc: package rdd

Permalink

class HistogramMethodsRDD[T] extends HistogramMethods[T]

Enriched RDD methods for histogramming and counting from HistogramMethods

import io.radanalytics.silex.histogram.implicits._
rdd.histBy(f)  // or other methods from HistogramMethods interface
Linear Supertypes
HistogramMethods[T], Serializable, Serializable, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. HistogramMethodsRDD
  2. HistogramMethods
  3. Serializable
  4. Serializable
  5. AnyRef
  6. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new HistogramMethodsRDD(data: RDD[T])(implicit arg0: ClassTag[T])

    Permalink

Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any

  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any

  3. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any

  4. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any

  5. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  6. def countBy[U](f: (T) ⇒ U): Map[U, Long]

    Permalink

    Count the occurrences of values returned by a function applied to RDD rows

    Count the occurrences of values returned by a function applied to RDD rows

    U

    The return type of the function

    f

    The function to apply to each RDD row

    returns

    A Map from occurring values to their counts

    Definition Classes
    HistogramMethodsRDD → HistogramMethods

  7. def countByFlat[U](f: (T) ⇒ TraversableOnce[U]): Map[U, Long]

    Permalink

    Count the occurrences of values in a sequence returned by a function applied to RDD rows

    Count the occurrences of values in a sequence returned by a function applied to RDD rows

    U

    The element type of the sequence returned by the function

    f

    The function to apply to each RDD row: returns a sequence of values

    returns

    A Map from occurring values to their counts

    Definition Classes
    HistogramMethodsRDD → HistogramMethods

  8. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef

  9. def equals(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any

  10. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )

  11. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any

  12. def hashCode(): Int

    Permalink
    Definition Classes
    AnyRef → Any

  13. def histBy[U](f: (T) ⇒ U, normalized: Boolean = false, cumulative: Boolean = false): Seq[(U, Double)]

    Permalink

    Histogram the occurrences of values returned by a function applied to RDD rows

    Histogram the occurrences of values returned by a function applied to RDD rows

    U

    The return type of the function

    f

    The function to apply to each RDD row

    normalized

    When true, histogram counts are normalized to sum to 1

    cumulative

    When true, histogram counts are cumulative

    returns

    A sequence ((u0, n0), (u1, n1), ...), sorted in decreasing order of counts nj

    Definition Classes
    HistogramMethodsRDD → HistogramMethods
    Note

    When both cumulative and normalized are true, "counts" are analoglous to a sampled CDF

  14. def histByFlat[U](f: (T) ⇒ TraversableOnce[U], normalized: Boolean = false, cumulative: Boolean = false): Seq[(U, Double)]

    Permalink

    Histogram the occurrences of values in a sequence returned by a function applied to RDD rows

    Histogram the occurrences of values in a sequence returned by a function applied to RDD rows

    U

    The element type of the sequence returned by the function

    f

    The function to apply to each RDD row: returns a sequence of values

    normalized

    When true, histogram counts are normalized to sum to 1

    cumulative

    When true, histogram counts are cumulative

    returns

    A sequence ((u0, n0), (u1, n1), ...), sorted in decreasing order of counts nj

    Definition Classes
    HistogramMethodsRDD → HistogramMethods
    Note

    When both cumulative and normalized are true, "counts" are analoglous to a sampled CDF

  15. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any

  16. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef

  17. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef

  18. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef

  19. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef

  20. def toString(): String

    Permalink
    Definition Classes
    AnyRef → Any

  21. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  22. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

  23. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from HistogramMethods[T]

Inherited from Serializable

Inherited from Serializable

Inherited from AnyRef

Inherited from Any

Ungrouped