spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jean-Georges Perrin <>
Subject Checkpointing and accessing the checkpoint data
Date Thu, 27 Jun 2019 12:54:00 GMT
Hi Sparkians,

Few questions around checkpointing.

1. Checkpointing “dump” file / persisting to disk
Is the file encrypted or is it a standard parquet file? 

2. If the file is not encrypted, can I use it with another app (I know it’s kind of of a
weird stretch case)

3. Have you/do you know of any performance comparison between the two? On small datasets,
caching seems more performant, but I can imagine that there is a sweet spot…



Jean -Georges Perrin

View raw message