New in Silex v0.0.5

29 April 2015

We’ve just released Silex version 0.0.5. Here are the main changes:

  • Added support for creating histograms from RDDs. If the implicit conversions from com.redhat.et.silex.histogram.implicits are in scope, then the countBy, countByFlat, histBy, and histByFlat methods will be available on every RDD.
  • Factored ReplApp functionality to a trait, to allow REPLs running with custom Spark configurations. This is useful if you need to interact with something like ElasticSearch that depends on a particular Spark configuration. (See here for more on why you might care about ReplApp.)
  • Silex apps should now play more nicely with spark-submit.
  • Silex now is built and tested against Spark 1.3.1, although it assumes Spark is a provided dependency (that is, that your app will depend on Spark separately).

To use Silex 0.0.5 in your projects, add the following resolver to your build.sbt:

resolvers += "Will's bintray" at "https://dl.bintray.com/willb/maven/"

and then add Silex as a dependency:

libraryDependencies += "com.redhat.et" %% "silex" % "0.0.5"