spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Tamas Jambor <jambo...@gmail.com>
Subject Re: No module named pyspark - latest built
Date Thu, 13 Nov 2014 01:13:24 GMT
Thanks. Will it work with sbt at some point?

On Thu, 13 Nov 2014 01:03 Xiangrui Meng <mengxr@gmail.com> wrote:

> You need to use maven to include python files. See
> https://github.com/apache/spark/pull/1223 . -Xiangrui
>
> On Wed, Nov 12, 2014 at 4:48 PM, jamborta <jamborta@gmail.com> wrote:
> > I have figured out that building the fat jar with sbt does not seem to
> > included the pyspark scripts using the following command:
> >
> > sbt/sbt -Pdeb -Pyarn -Phadoop-2.3 -Dhadoop.version=2.3.0 -Phive clean
> > publish-local assembly
> >
> > however the maven command works OK:
> >
> > mvn -Pdeb -Pyarn -Phadoop-2.3 -Dhadoop.version=2.3.0 -Phive -DskipTests
> > clean package
> >
> > am I running the correct sbt command?
> >
> >
> >
> > --
> > View this message in context: http://apache-spark-user-list.
> 1001560.n3.nabble.com/No-module-named-pyspark-latest-
> built-tp18740p18787.html
> > Sent from the Apache Spark User List mailing list archive at Nabble.com.
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
> > For additional commands, e-mail: user-help@spark.apache.org
> >
>

Mime
View raw message