spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Vikash Pareek <vikaspareek1...@gmail.com>
Subject How to avoid creating meta files (.crc files)
Date Mon, 09 Oct 2017 07:50:03 GMT
Hi Users,

Is there any way to avoid creation of .crc files when writing an RDD with
saveAsTextFile method?

My use case is, I have mounted S3 on the local file system using S3FS and
saving an RDD to mounting point. by looking at S3, I found one .crc file for
each part file and even _SUCCESS file.

Thanks in advance.
 



-----

__Vikash Pareek
--
Sent from: http://apache-spark-user-list.1001560.n3.nabble.com/

---------------------------------------------------------------------
To unsubscribe e-mail: user-unsubscribe@spark.apache.org


Mime
View raw message