spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From licl <>
Subject Re: Apache Spark Structured Streaming - Kafka Streaming - Option to ignore checkpoint
Date Thu, 07 Jun 2018 01:09:58 GMT
I met the same issue and I have try to delete the checkpoint dir before the
job ,

But spark seems can read the correct offset  even though after the
checkpoint dir is deleted ,

I don't know how spark do this without checkpoint's metadata.

Sent from:

To unsubscribe e-mail:

View raw message