spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Oleg Ruchovets <oruchov...@gmail.com>
Subject pyspark on yarn hdp hortonworks
Date Wed, 03 Sep 2014 12:03:07 GMT
Hi all.
   I am trying to run pyspark on yarn already couple of days:

http://hortonworks.com/kb/spark-1-0-1-technical-preview-hdp-2-1-3/

I posted exception on previous posts. It looks that I didn't do correct
configuration.
  I googled quite a lot and I can't find the steps should be done to
configure PySpark running on Yarn.

Can you please share the steps (critical points) should be configured to
use PaSpark on Yarn ( hortonworks distribution) :
  Environment variables.
  Classpath
  copy jars to all machine
  other configuration.

Thanks
Oleg.

Mime
View raw message