spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Gabor Somogyi (Jira)" <j...@apache.org>
Subject [jira] [Created] (SPARK-28928) Take over delegation token protocol on sources/sinks
Date Fri, 30 Aug 2019 11:42:00 GMT
Gabor Somogyi created SPARK-28928:
-------------------------------------

             Summary: Take over delegation token protocol on sources/sinks
                 Key: SPARK-28928
                 URL: https://issues.apache.org/jira/browse/SPARK-28928
             Project: Spark
          Issue Type: Improvement
          Components: Structured Streaming
    Affects Versions: 3.0.0
            Reporter: Gabor Somogyi


At the moment there are 3 places where communication protocol with Kafka cluster has to be
configured:
 * On delegation token
 * On source
 * On sink

Most of the time users are using the same protocol on all these places (within one Kafka cluster).
It would be better to declare it in one place (delegation token side) and Kafka sources/sinks
can take this config over.

 



--
This message was sent by Atlassian Jira
(v8.3.2#803003)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message