spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From kant kodali <kanth...@gmail.com>
Subject can I use cassandra for checkpointing during a spark streaming job
Date Mon, 29 Aug 2016 07:14:47 GMT
I understand that I cannot use spark streaming window operation without
checkpointing to HDFS but Without window operation I don't think we can do much
with spark streaming. so since it is very essential can I use Cassandra as a
distributed storage? If so, can I see an example on how I can tell spark cluster
to use Cassandra for checkpointing?
Mime
View raw message