spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Vikash Pareek <>
Subject How to avoid creating meta files (.crc files)
Date Mon, 09 Oct 2017 07:50:03 GMT
Hi Users,

Is there any way to avoid creation of .crc files when writing an RDD with
saveAsTextFile method?

My use case is, I have mounted S3 on the local file system using S3FS and
saving an RDD to mounting point. by looking at S3, I found one .crc file for
each part file and even _SUCCESS file.

Thanks in advance.


__Vikash Pareek
Sent from:

To unsubscribe e-mail:

View raw message