spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sean Owen <>
Subject Re: SPARK_WORKER_MEMORY in Spark Standalone - conf.getenv vs System.getenv?
Date Sat, 13 Feb 2016 07:38:21 GMT
Yes you said it is only set in a props file, but why do you say that?
because the resolution of your first question is that this is not
differently handled.

On Fri, Feb 12, 2016 at 11:11 PM, Jacek Laskowski <> wrote:
> On Fri, Feb 12, 2016 at 11:08 PM, Sean Owen <> wrote:
>> I think that difference in the code is just an oversight. They
>> actually do the same thing.
> Correct. Just meant to know the reason if there was any.
>> Why do you say this property can only be set in a file?
> I said that conf/spark-defaults.conf can *not* be used to set
> spark.worker.ui.port property and wondered why is so? It'd be nice to
> have it for settings (not use workarounds like
> SPARK_WORKER_OPTS=-Dspark.worker.ui.port=21212). Just spot it and
> thought I'd ask if it needs to be cleaned up or improved.
> Jacek

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message