squito / cdh-spark.g8 Goto Github PK

Make it easy to (or at least add an example of):
(a) run things locally and write history files
(b) run the history server to look at things

The sbt build does some classpath magic to make running locally work, despite spark being "provided". That doesn't work in mvn yet. You could still do

mvn exec:java -Dexec.classpathScope="compile" -Dexec.mainClass="<your class>" -Dexec.args="<your args>"

but it would be nice if there was an easier way. At least just doc this if nothing else.

Leftover stuff from Spark build left in there:

• scaladoc stuff
• spark properties
• remove spark-local project, just move those settings to the "core" project