spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From 王贺(Gabriel) <gabriel.wang...@gmail.com>
Subject Re: Microbatches length
Date Thu, 20 Oct 2016 11:24:03 GMT
The interval is for time, so you won't get micro-batches in same data size
but same time length.

Yours sincerely,
Gabriel (王贺)
Mobile: +86 18621263813


On Thu, Oct 20, 2016 at 6:38 PM, pcandido <pcandido.m@gmail.com> wrote:

> Hello folks,
>
> I'm using Spark Streaming. My question is simple:
> The documentation says that microbatches arrive in intervals. The intervals
> are in real time (minutes, seconds). I want to get microbatches with same
> length, so, I can configure SS to return microbatches when it reach a
> determined length?
>
> Thanks.
>
>
>
> --
> View this message in context: http://apache-spark-user-list.
> 1001560.n3.nabble.com/Microbatches-length-tp27927.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>
> ---------------------------------------------------------------------
> To unsubscribe e-mail: user-unsubscribe@spark.apache.org
>
>

Mime
View raw message