spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From jamborta <>
Subject Re: No module named pyspark - latest built
Date Thu, 13 Nov 2014 00:48:52 GMT
I have figured out that building the fat jar with sbt does not seem to
included the pyspark scripts using the following command:

sbt/sbt -Pdeb -Pyarn -Phadoop-2.3 -Dhadoop.version=2.3.0 -Phive clean
publish-local assembly

however the maven command works OK:

mvn -Pdeb -Pyarn -Phadoop-2.3 -Dhadoop.version=2.3.0 -Phive -DskipTests
clean package

am I running the correct sbt command?

View this message in context:
Sent from the Apache Spark User List mailing list archive at

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message