spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Yuval.Itzchakov" <>
Subject Re: How to reduce the amount of data that is getting written to the checkpoint from Spark Streaming
Date Mon, 03 Jul 2017 20:07:37 GMT
Using a long period betweem checkpoints may cause a long linage of the graphs
computations to be created, since Spark uses checkpointing to cut it, which
can also cause a delay in the streaming job.

View this message in context:
Sent from the Apache Spark User List mailing list archive at

To unsubscribe e-mail:

View raw message