gora-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Mikhail Bernadsky (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (GORA-346) Create shim layer to support multiple hadoop versions
Date Mon, 07 Jul 2014 19:17:34 GMT

    [ https://issues.apache.org/jira/browse/GORA-346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14054049#comment-14054049
] 

Mikhail Bernadsky commented on GORA-346:
----------------------------------------

The shim solution looks great! 

There is one thing I'd like to mention regarding Hadoop 2.4.0. When I was running Nutch on
that version of Hadoop in local mode, I was not able to make it work until I patched this
bug: [HADOOP-10669|https://issues.apache.org/jira/browse/HADOOP-10669]. I am pretty sure that
this a bug in Hadoop, but not sure how it managed to lurk around for so long without anybody
noticing. For me it looked as if it was affecting a very common code path. Would be great
if someone can verify and upvote it if it's a real issue for Gora/Nutch moving to Hadoop2.


I also worked on the Gora/Hadoop2 patch, my patch uses profiles and the munge maven plugin.
I'll add it here in 1-2 days. Shims are better than munge, but my patch also contains HBase
upgrade to 0.96.1.1. So it may be useful as a reference. 


> Create shim layer to support multiple hadoop versions
> -----------------------------------------------------
>
>                 Key: GORA-346
>                 URL: https://issues.apache.org/jira/browse/GORA-346
>             Project: Apache Gora
>          Issue Type: Improvement
>    Affects Versions: 0.5
>            Reporter: Renato Javier MarroquĂ­n Mogrovejo
>            Assignee: Moritz Hoffmann
>              Labels: patch
>         Attachments: GORA-346_v1.patch, GORA-346_v2.patch, GORA-346_v3.patch, GORA-346_v4_profiles.patch,
GORA-346_v5.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.2#6252)

Mime
View raw message