Adds Spark configuration (in the form of a function that takes a SparkConf
and returns a new SparkConf
.)
Adds Spark configuration (in the form of a function that takes a SparkConf
and returns a new SparkConf
.)
These are executed in the order that they are added.
Adds a thunk to be run when your application exits.
Adds a thunk to be run when your application exits.
These are executed in the order that they are added.
The main method for your application.
The main method for your application. Do not override this; override AppCommon.appMain instead
The Spark master URL.
The Spark master URL.
This defaults to the value set in SPARK_MASTER
in the environment or local[*]
. The spark.master
property will take precedence over this.
Registers a function with the given name.
Registers a function with the given name.
Subsequent attempts to register a function with the same name will have no effect.
Base trait for data-processing applications.
Contains references to Spark and SQL contexts, a basic configuration, and callback interfaces for app configuration and cleanup.