spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Paweł Szulc <paul.sz...@gmail.com>
Subject Re: How Does aggregate work
Date Mon, 23 Mar 2015 10:31:35 GMT
It is actually number of cores. If your processor has hyperthreading then
it will be more (number of processors your OS sees)

niedz., 22 mar 2015, 4:51 PM Ted Yu użytkownik <yuzhihong@gmail.com>
napisał:

> I assume spark.default.parallelism is 4 in the VM Ashish was using.
>
> Cheers
>

Mime
View raw message