spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Masf <masfwo...@gmail.com>
Subject Parquet and repartition
Date Mon, 16 Mar 2015 11:11:04 GMT
Hi all.

When I specify the number of partitions and save this RDD in parquet
format, my app fail. For example

selectTest.coalesce(28).saveAsParquetFile("hdfs://vm-clusterOutput")

However, it works well if I store data in text

selectTest.coalesce(28).saveAsTextFile("hdfs://vm-clusterOutput")


My spark version is 1.2.1

Is this bug registered?


-- 


Saludos.
Miguel Ángel

Mime
View raw message