spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Renu Yadav <yren...@gmail.com>
Subject Rdd Partitions issue
Date Thu, 15 Oct 2015 10:37:26 GMT
I am reading parquet file from a dir which has 400 file of max 180M size
so while reading my partition should be 400 as split size is 256 M in my
case

But it is taking 787 partiition .Why is it so?

Please help.

Thanks,
Renu

Mime
View raw message