spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Marcelo Vanzin <van...@cloudera.com>
Subject Re: Hadoop configuration for checkpointing
Date Tue, 04 Nov 2014 17:48:01 GMT
On Tue, Nov 4, 2014 at 9:34 AM, Cody Koeninger <cody@koeninger.org> wrote:
> 2.  Is there a reason StreamingContext.getOrCreate defaults to a blank
> hadoop configuration rather than
> org.apache.spark.deploy.SparkHadoopUtil.get.conf,
> which would pull values from spark config?

This is probably something I overlooked when I changed the rest of the
code to use SparkHadoopUtil.get.conf. Feel free to send a PR for it,
we should get it into 1.2 so that all code creates configuration
objects in a consistent way.

-- 
Marcelo

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
For additional commands, e-mail: dev-help@spark.apache.org


Mime
View raw message