spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jacek Laskowski <ja...@japila.pl>
Subject SPARK_YARN_MODE, yarn-client master URL and SparkILoop
Date Thu, 02 Jun 2016 09:35:14 GMT
Hi,

While reviewing where SPARK_YARN_MODE is used and how, I found one
"weird" place where the "yarn-client" is checked against - see
https://github.com/apache/spark/blob/master/repl/scala-2.10/src/main/scala/org/apache/spark/repl/SparkILoop.scala#L946.

Since yarn-client (and yarn-cluster) are no longer in use, I'm pretty
sure it's of no use and could be safely removed. If not, we should do
something with it anyway.

Please guide before I file a JIRA issue. Thanks.

p.s. On to hunting SPARK_YARN_MODE...

Pozdrawiam,
Jacek Laskowski
----
https://medium.com/@jaceklaskowski/
Mastering Apache Spark http://bit.ly/mastering-apache-spark
Follow me at https://twitter.com/jaceklaskowski

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
For additional commands, e-mail: dev-help@spark.apache.org


Mime
View raw message