spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From joshuata <>
Subject Re: how to setup the development environment of spark with IntelliJ on ubuntu
Date Tue, 19 Jul 2016 18:25:08 GMT
I have found the easiest way to set up a development platform is to use the 
databricks sbt-spark-package plugin
<>  (assuming you are using
scala+sbt). You simply add the plugin to your <project>/project/plugins.sbt
file and add the sparkVersion to your build.sbt file. It automatically loads
the necessary packages to build your applications.

It also provides the sbt console command that sets up a local spark repl to
prototype code against. 

View this message in context:
Sent from the Apache Spark User List mailing list archive at

To unsubscribe e-mail:

View raw message