spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Renjie Liu <liurenjie2...@gmail.com>
Subject Re: Guaranteed processing orders of each batch in Spark Streaming
Date Tue, 03 Nov 2015 07:06:29 GMT
Hi, all:
I have given a detailed description of my proposal in this jira
<https://issues.apache.org/jira/browse/SPARK-11308>.

On Mon, Oct 19, 2015 at 2:58 PM Renjie Liu <liurenjie2008@gmail.com> wrote:

> Hi, all:
> I've read source code and it seems that there is no guarantee that the
> order of processing of each RDD is guaranteed since jobs are just submitted
> to a thread pool. I  believe that this is quite important in streaming
> since updates should be ordered.
>
> --
Liu, Renjie
Software Engineer, MVAD

Mime
View raw message