flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Malte Schwarzer ...@mieo.de>
Subject How to make Flink to write less temporary files?
Date Sun, 09 Nov 2014 21:54:18 GMT

 I¹m having the problem that my tmp dir is running out of hard drive space
when running a map reduce job on a 1TB file. The job fails with "no space
left on device³ exception.

Probably the intermediate result set is getting too big. Is there a way to
avoid this? Or make flink to write less temporary files?


View raw message