A New Web UI for Spark
- by Hue Team
- January 03, 2014
- no comments
The team behind Hue, the open source Web UI that makes Apache Hadoop easier to use, strikes again with a new Spark app.
Editor’s note: This post was recently published on the Hue blog. We republish it here for your convenience.
Hi Spark Makers!
We previously released the app with an Apache Oozie submission backend but switched to the Spark Job Server (SPARK-818) contributed by Ooyala and Evan’s team at the last Spark Summit. This new server will enable a real interactivity with Spark and is closer to the community.
We hope to work with the community and have support for Python, Java, direct script submission without compiling/uploading and other improvements in the future!
We assume you have Scala installed on your system.
Get Spark Job Server
Currently on github on this branch:
git clone https://github.com/ooyala/incubator-spark.git spark-server cd spark-server git checkout -b jobserver-preview-2013-12 origin/jobserver-preview-2013-12
sbt/sbt project jobserver re-start
Currently only on github (will be in CDH 5 Beta 2):
If Hue and Spark Job Server are not on the same machine, update the hue.ini property in desktop/conf/pseudo-distributed.ini:
[spark] # URL of the Spark Job Server. server_url=http://localhost:8090/
Get a Spark Example to Run
Then follow this walkthrough and create the example jar that is used in the video demo.