spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Rishi Yadav <ri...@infoobjects.com>
Subject Re: sparkContext.textFile does not honour the minPartitions argument
Date Fri, 02 Jan 2015 01:43:41 GMT
Hi Ankit,

Optional number of partitions value is to increase number of partitions not
reduce it from default value.

On Thu, Jan 1, 2015 at 10:43 AM, Aniket Bhatnagar <
aniket.bhatnagar@gmail.com> wrote:

> I am trying to read a file into a single partition but it seems like
> sparkContext.textFile ignores the passed minPartitions value. I know I can
> repartition the RDD but I was curious to know if this is expected or if
> this is a bug that needs to be further investigated?

Mime
View raw message