spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From ÐΞ€ρ@Ҝ (๏̯͡๏) <>
Subject Unable to start Pi (hello world) application on Spark 1.4
Date Fri, 26 Jun 2015 21:27:03 GMT
It used to work with 1.3.1, however with 1.4.0 i get the following exception

export SPARK_HOME=/home/dvasthimal/spark1.4/spark-1.4.0-bin-hadoop2.4
export HADOOP_CONF_DIR=/apache/hadoop/conf
./bin/spark-submit -v --master yarn-cluster --driver-class-path
--num-executors 1 --driver-memory 4g --driver-java-options
"-XX:MaxPermSize=2G" --executor-memory 2g --executor-cores 1 --queue
hdmi-express --class org.apache.spark.examples.SparkPi
./lib/spark-examples*.jar 10


15/06/26 14:24:42 INFO client.ConfiguredRMFailoverProxyProvider: Failing
over to rm2

15/06/26 14:24:42 WARN ipc.Client: Exception encountered while connecting
to the server : java.lang.IllegalArgumentException: Server has invalid
Kerberos principal: hadoop/

I remember getting this error when working Spark 1.2.x where in the way i
used to get


this library into cp. With 1.3.1 using --driver-class-path gets it running
but with 1.4 it does not work

Please suggest.


View raw message