spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ilya Ganelin <ilgan...@gmail.com>
Subject Re: input split size
Date Sat, 18 Oct 2014 13:09:33 GMT
Also - if you're doing a text file read you can pass the number of
resulting partitions as the second argument.
On Oct 17, 2014 9:05 PM, "Larry Liu" <larryliu05@gmail.com> wrote:

> Thanks, Andrew. What about reading out of local?
>
> On Fri, Oct 17, 2014 at 5:38 PM, Andrew Ash <andrew@andrewash.com> wrote:
>
>> When reading out of HDFS it's the HDFS block size.
>>
>> On Fri, Oct 17, 2014 at 5:27 PM, Larry Liu <larryliu05@gmail.com> wrote:
>>
>>> What is the default input split size? How to change it?
>>>
>>
>>
>

Mime
View raw message