spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sean Owen (JIRA)" <>
Subject [jira] [Updated] (SPARK-12269) Update aws-java-sdk version
Date Tue, 05 Jan 2016 23:21:40 GMT


Sean Owen updated SPARK-12269:
    Assignee: Brian London  (was: Apache Spark)

This can proceed now after a rebase, since SPARK-12453 is merged

> Update aws-java-sdk version
> ---------------------------
>                 Key: SPARK-12269
>                 URL:
>             Project: Spark
>          Issue Type: Improvement
>          Components: Streaming
>            Reporter: Brian London
>            Assignee: Brian London
>            Priority: Minor
> The current Spark Streaming kinesis connector references a quite old version 1.9.40 of
the AWS Java SDK (1.10.40 is current).  Numerous AWS features including Kinesis Firehose are
unavailable in 1.9.  Those two versions of  the AWS SDK in turn require conflicting versions
of Jackson (2.4.4 and 2.5.3 respectively) such that one cannot include the current AWS SDK
in a project that also uses the Spark Streaming Kinesis ASL.
> Bumping the version of Jackson and the AWS library solves this problem and will allow
Firehose integrations.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message