spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ouruia@cnsuning.com" <our...@cnsuning.com>
Subject Re: Re: --jars option using hdfs jars cannot effect when spark standlone deploymode with cluster
Date Wed, 04 Nov 2015 05:59:34 GMT
Akhil,
    
     In locally ,all nodes will has the same  jar   because  the driver will be assgined to
random node ;otherwise the driver log wiil report :no jar was founded .












Ricky  Ou(欧   锐)


 
From: Akhil Das
Date: 2015-11-02 17:59
To: ouruia@cnsuning.com
CC: user; 494165115
Subject: Re: --jars option using hdfs jars cannot effect when spark standlone deploymode with
cluster
Can you give a try putting the jar locally without hdfs?

Thanks
Best Regards

On Wed, Oct 28, 2015 at 8:40 AM, ouruia@cnsuning.com <ouruia@cnsuning.com> wrote:
hi all,
   when using command:
        spark-submit --deploy-mode cluster --jars hdfs:///user/spark/cypher.jar --class com.suning.spark.jdbc.MysqlJdbcTest
hdfs:///user/spark/MysqlJdbcTest.jar
the program throw exception that  cannot find class in cypher.jar, the driver log show no
--jars download with  cluster mode.  Isn't it  only use fatjar?
  



 



   











Ricky  Ou(欧   锐)



Mime
View raw message