spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Burak Yavuz <brk...@gmail.com>
Subject Re: queryable state & streaming
Date Fri, 08 Dec 2017 18:40:54 GMT
Hi Stavros,

Queryable state is definitely on the roadmap! We will revamp the StateStore
API a bit, and a queryable StateStore is definitely one of the things we
are thinking about during that revamp.

Best,
Burak

On Dec 8, 2017 9:57 AM, "Stavros Kontopoulos" <st.kontopoulos@gmail.com>
wrote:

> Just to re-phrase my question: Would query-able state make a viable SPIP?
>
> Regards,
> Stavros
>
> On Thu, Dec 7, 2017 at 1:34 PM, Stavros Kontopoulos <
> st.kontopoulos@gmail.com> wrote:
>
>> Hi,
>>
>> Maybe this has been discussed before. Given the fact that many streaming
>> apps out there use state extensively, could be a good idea to make Spark
>> expose streaming state with an external API like other systems do (Kafka
>> streams, Flink etc), in order to facilitate interactive queries?
>>
>> Regards,
>> Stavros
>>
>
>

Mime
View raw message