spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Chanh Le <giaosu...@gmail.com>
Subject Why so many parquet file part when I store data in Alluxio or File?
Date Fri, 01 Jul 2016 02:29:28 GMT
Hi everyone,
I am using Alluxio for storage. But I am little bit confuse why I am do set block size of
alluxio is 512MB and my file part only few KB and too many part.
Is that normal? Because I want to read it fast? Is that many part effect the read operation?
How to set the size of file part?

Thanks.
Chanh



 


Mime
View raw message