spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Martin Schade (JIRA)" <j...@apache.org>
Subject [jira] [Created] (SPARK-12453) Spark Streaming Kinesis Example broken due to wrong AWS Java SDK version
Date Mon, 21 Dec 2015 18:03:46 GMT
Martin Schade created SPARK-12453:
-------------------------------------

             Summary: Spark Streaming Kinesis Example broken due to wrong AWS Java SDK version
                 Key: SPARK-12453
                 URL: https://issues.apache.org/jira/browse/SPARK-12453
             Project: Spark
          Issue Type: Bug
          Components: Streaming
    Affects Versions: 1.5.2
            Reporter: Martin Schade
            Priority: Critical


The Spark Streaming Kinesis Example (kinesis-asl) is broken due to wrong AWS Java SDK version
(1.9.16) referenced with the AWS KCL version (1.3.0).

AWS KCL 1.3.0 references AWS Java SDK version 1.9.37.
Using 1.9.16 in combination with 1.3.0 does fail to get data out of the stream.
I tested Spark Streaming with 1.9.37 and it works fine. 
Testing a simple KCL client outside of Spark with 1.3.0 and 1.9.16 also fails, so it is due
to the specific versions used in 1.5.2 and not a Spark related implementation.




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message