spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Gabor Somogyi <gabor.g.somo...@gmail.com>
Subject Re: SPIP: Support Kafka delegation token in Structured Streaming
Date Mon, 01 Oct 2018 09:33:09 GMT
Hi Saisai,

The reasons why I've originally set the goal only structured streaming is
the following:
 * Haven't seen big interest in the DStream area for new features
 * Separate the concerns even if there is a need

All in all happy to port the feature to DStream if you think it worth and
you can help me, because no major differences are there (at least
considering this area).

BR,
G


On Sun, Sep 30, 2018 at 4:06 AM Saisai Shao <sai.sai.shao@gmail.com> wrote:

> I like this proposal. Since Kafka already provides delegation token
> mechanism, we can also leverage Spark's delegation token framework to add
> Kafka as a built-in support.
>
> BTW I think there's no much difference in support structured streaming and
> DStream, maybe we can set both as goal.
>
> Thanks
> Saisai
>
> Gabor Somogyi <gabor.g.somogyi@gmail.com> 于2018年9月27日周四 下午7:58写道:
>
>> Hi all,
>>
>> I am writing this e-mail in order to discuss the delegation token support
>> for kafka feature which is reported in SPARK-25501
>> <https://issues.apache.org/jira/browse/SPARK-25501>. I've prepared a SPIP
>> <https://docs.google.com/document/d/1ouRayzaJf_N5VQtGhVq9FURXVmRpXzEEWYHob0ne3NY/edit?usp=sharing>
for
>> it. PR is on the way...
>>
>> Looking forward to hear your feedback.
>>
>> BR,
>> G
>>
>>

Mime
View raw message