spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Vadim Chekan <kot.bege...@gmail.com>
Subject Window slide duration
Date Tue, 03 Jun 2014 00:22:37 GMT
Hi all,

I am getting an error:
================
14/06/02 17:06:32 INFO WindowedDStream: Time 1401753992000 ms is invalid as
zeroTime is 1401753986000 ms and slideDuration is 4000 ms and difference is
6000 ms
14/06/02 17:06:32 ERROR OneForOneStrategy: key not found: 1401753992000 ms
================

My relevant code is:
===================
ssc =  new StreamingContext(conf, Seconds(1))
val messageEvents = events.
      flatMap(e => evaluatorCached.value.find(e)).
      window(Seconds(8), Seconds(4))
messageEvents.print()
===================

Seems all right to me, window slide duration (4) is streaming context batch
duration (1) *2. So, what's the problem?

Spark-v1.0.0

-- 
>From RFC 2631: In ASN.1, EXPLICIT tagging is implicit unless IMPLICIT is
explicitly specified

Mime
View raw message