spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sean Owen (JIRA)" <>
Subject [jira] [Commented] (SPARK-4807) Add support for hadoop-2.5 + bump jets3t version
Date Wed, 10 Dec 2014 06:28:12 GMT


Sean Owen commented on SPARK-4807:

This has been discussed a few times - the hadoop-2.4 profile covers 2.4+. You don't need a
new profile. I think the goal is to match jets3t distributed with Hadoop. It might be fine
to update from 0.9.0 to 0.9.2 but if it's not actually a problem, might not be worth touching
it just now.

> Add support for hadoop-2.5 + bump jets3t version
> ------------------------------------------------
>                 Key: SPARK-4807
>                 URL:
>             Project: Spark
>          Issue Type: Improvement
>          Components: Build
>    Affects Versions: 1.2.0
>            Reporter: Andy Zhang
>            Priority: Minor
>              Labels: build, maven
>             Fix For: 1.2.0
>   Original Estimate: 0.5h
>  Remaining Estimate: 0.5h
> Spark's top level POM currently has no profile support for hadoop-2.5. I've tested this
a bit on my own, and it seems to work well. I also discovered that you had to bump to the
newest version of jets3t in order to avoid a dependency conflict when using the java aws-sdk.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message