spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Gabor Somogyi (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SPARK-26783) Kafka parameter documentation doesn't match with the reality (upper/lowercase)
Date Wed, 27 Feb 2019 14:57:00 GMT

    [ https://issues.apache.org/jira/browse/SPARK-26783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16779408#comment-16779408
] 

Gabor Somogyi commented on SPARK-26783:
---------------------------------------

I've gone through the whole chain on v2.4.0 and it looks good (the batch part only because
the original issue was there).
 The only thing what I can assume [~sindiri] has seen is [this line|https://github.com/apache/spark/blob/b0450d07bd5a77a519a662351ca5b5d562e61a58/external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/KafkaSourceProvider.scala#L460]
when mentioned the following:
{quote}the variable that needs to be used is "failondataloss" (all in lower case)
{quote}
I'm closing this issue. Please come back and correct me if you have further info or my assumption
is wrong.


> Kafka parameter documentation doesn't match with the reality (upper/lowercase)
> ------------------------------------------------------------------------------
>
>                 Key: SPARK-26783
>                 URL: https://issues.apache.org/jira/browse/SPARK-26783
>             Project: Spark
>          Issue Type: Bug
>          Components: Structured Streaming
>    Affects Versions: 3.0.0
>            Reporter: Gabor Somogyi
>            Priority: Minor
>
> A good example for this is "failOnDataLoss" which is reported in SPARK-23685. I've just
checked and there are several other parameters which suffer from the same issue.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message