spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Andrew Ash <and...@andrewash.com>
Subject Re: spark.default.parallelism
Date Tue, 21 Jan 2014 22:49:48 GMT
https://github.com/apache/incubator-spark/pull/489


On Tue, Jan 21, 2014 at 3:41 PM, Ognen Duzlevski <
ognen@plainvanillagames.com> wrote:

> On Tue, Jan 21, 2014 at 10:37 PM, Andrew Ash <andrew@andrewash.com> wrote:
>
>> Documentation suggestion:
>>
>> Default number of tasks to use *across the cluster* for distributed
>> shuffle operations (<code>groupByKey</code>, <code>reduceByKey</code>,
>> etc) when not set by user.
>>
>> Ognen would that have clarified for you?
>>
>
> Of course :)
>
> Thanks!
> Ognen
>

Mime
View raw message