spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Chirag Aggarwal <Chirag.Aggar...@guavus.com>
Subject Re: Spark Configurations
Date Tue, 30 Dec 2014 04:45:56 GMT
Is there a way to get these set by default in spark-sql shell

Thanks,
Chirag

From: Akhil Das <akhil@sigmoidanalytics.com<mailto:akhil@sigmoidanalytics.com>>
Date: Monday, 29 December 2014 5:53 PM
To: Chirag Aggarwal <chirag.aggarwal@guavus.com<mailto:chirag.aggarwal@guavus.com>>
Cc: "user@spark.apache.org<mailto:user@spark.apache.org>" <user@spark.apache.org<mailto:user@spark.apache.org>>
Subject: Re: Spark Configurations

I believe If you use spark-shell or spark-submit, then it will pick up the conf from spark-defaults.conf,
If you are running independent application then you can set all those confs while creating
the SparkContext.

Thanks
Best Regards

On Mon, Dec 29, 2014 at 5:40 PM, Chirag Aggarwal <Chirag.Aggarwal@guavus.com<mailto:Chirag.Aggarwal@guavus.com>>
wrote:
Hi,

It seems that spark-defaults.conf is not read by spark-sql. Is it used only by spark-shell?

Thanks,
Chirag


Mime
View raw message