spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Gabor Somogyi (Jira)" <j...@apache.org>
Subject [jira] [Commented] (SPARK-28928) Take over delegation token protocol on sources/sinks
Date Fri, 30 Aug 2019 11:42:00 GMT

    [ https://issues.apache.org/jira/browse/SPARK-28928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16919463#comment-16919463
] 

Gabor Somogyi commented on SPARK-28928:
---------------------------------------

I'm working on this.

> Take over delegation token protocol on sources/sinks
> ----------------------------------------------------
>
>                 Key: SPARK-28928
>                 URL: https://issues.apache.org/jira/browse/SPARK-28928
>             Project: Spark
>          Issue Type: Improvement
>          Components: Structured Streaming
>    Affects Versions: 3.0.0
>            Reporter: Gabor Somogyi
>            Priority: Major
>
> At the moment there are 3 places where communication protocol with Kafka cluster has
to be configured:
>  * On delegation token
>  * On source
>  * On sink
> Most of the time users are using the same protocol on all these places (within one Kafka
cluster). It would be better to declare it in one place (delegation token side) and Kafka
sources/sinks can take this config over.
>  



--
This message was sent by Atlassian Jira
(v8.3.2#803003)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message