spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From 张万新 <kevinzwx1...@gmail.com>
Subject Re: What's the root cause of not supporting multiple aggregations in structured streaming?
Date Wed, 22 May 2019 01:38:08 GMT
Thanks, I'll check it out.

Arun Mahadevan <arunm@apache.org> 于 2019年5月21日周二 01:31写道:

> Heres the proposal for supporting it in "append" mode -
> https://github.com/apache/spark/pull/23576. You could see if it addresses
> your requirement and post your feedback in the PR.
> For "update" mode its going to be much harder to support this without
> first adding support for "retractions", otherwise we would end up with
> wrong results.
>
> - Arun
>
>
> On Mon, 20 May 2019 at 01:34, Gabor Somogyi <gabor.g.somogyi@gmail.com>
> wrote:
>
>> There is PR for this but not yet merged.
>>
>> On Mon, May 20, 2019 at 10:13 AM 张万新 <kevinzwx1992@gmail.com> wrote:
>>
>>> Hi there,
>>>
>>> I'd like to know what's the root reason why multiple aggregations on
>>> streaming dataframe is not allowed since it's a very useful feature, and
>>> flink has supported it for a long time.
>>>
>>> Thanks.
>>>
>>

Mime
View raw message