spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "deenar.toraskar" <>
Subject Re: Equally weighted partitions in Spark
Date Fri, 02 May 2014 06:14:33 GMT

On a job I am currently running, 99% of the partitions finish within seconds
and a couple of partitions take around and hour to finish. I am pricing some
instruments and complex instruments take far longer to price than plain
vanilla ones. If I could distribute these complex instruments evenly, the
overall job times would greatly reduce.


View this message in context:
Sent from the Apache Spark User List mailing list archive at

View raw message