spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From st553 <>
Subject Re: how can I make the sliding window in Spark Streaming driven by data timestamp instead of absolute time
Date Fri, 17 Oct 2014 17:51:46 GMT
I believe I have a similar question to this. I would like to process an
offline event stream for testing/debugging. The stream is stored in a CSV
file where each row in the file has a timestamp. I would like to feed this
file into Spark Streaming and have the concept of time be driven by the
timestamp column. Has anyone does this before? I haven't seen anything in
the docs. Would like to know if this is possible in Spark Streaming. Thanks!

View this message in context:
Sent from the Apache Spark User List mailing list archive at

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message