spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Stephen Boesch <java...@gmail.com>
Subject sbt assembly with hive
Date Sat, 13 Dec 2014 02:40:48 GMT
What is the proper way to build with hive from sbt?  The SPARK_HIVE is
deprecated. However after running the following:

   sbt -Pyarn -Phadoop-2.3 -Phive  assembly/assembly

And then
  bin/pyspark

   hivectx = HiveContext(sc)

   hivectx.hiveql("select * from my_table")

Exception: ("You must build Spark with Hive. Export 'SPARK_HIVE=true' and
run sbt/sbt assembly", Py4JError(u'Trying to call a package.',))

Mime
View raw message