Researching running spark on a slurm cluster
I downloaded spark-1.6.1-bin-hadoop2.6. Do not download the version 'without' hadoop as that will not work, even though I am not using haddoop.
Change all the paths in sparktest.sh to point to your location.
sbatch sparktest.sh