spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sourabh Chandak <>
Subject Checkpointing is super slow
Date Fri, 02 Oct 2015 06:17:09 GMT

I have a receiverless kafka streaming job which was started yesterday
evening and was running fine till 4 PM today. Suddenly post that writing of
checkpoint has slowed down and it is now not able to catch up with the
incoming data. We are using the DSE stack with Spark 1.2 and Cassandra for
checkpointing. Spark streaming is done using a backported code.

Running nodetool shows that the Read latency of the cfs keyspace is ~8.5 ms.

Can someone please help me resolve this?


View raw message