hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chris Nauroth (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (HADOOP-9008) Building hadoop tarball fails on Windows
Date Thu, 08 Nov 2012 00:14:12 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-9008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Chris Nauroth updated HADOOP-9008:

    Attachment: HADOOP-9008-branch-trunk-win.patch

The attached patch ports the sh scripting in the distribution build to Python.  It wasn't
possible to use only Maven plugins (like maven-antrun-plugin with a <tar> task), because
they mishandled permissions and symlinks in the built tarballs.

I tested all of the following build variations:

Windows: mvn -Pnative-win -Pdist -Dtar -DskipTests clean package
Mac: mvn -Pdist -Dtar -DskipTests clean package
Ubuntu: mvn -Pnative -Pdist -Dtar -DskipTests clean package
Ubuntu: mvn -Pnative -Pdist -Dtar -Drequire.snappy -Dbundle.snappy -Dsnappy.lib=/usr/local/lib
-DskipTests clean package

This works on Windows.  Additionally, on Mac and Ubuntu, I compared the built tarballs from
before and after my changes.  I confirmed that the resulting tarballs have exactly the same
contents, including permissions and symlinks.

> Building hadoop tarball fails on Windows
> ----------------------------------------
>                 Key: HADOOP-9008
>                 URL: https://issues.apache.org/jira/browse/HADOOP-9008
>             Project: Hadoop Common
>          Issue Type: Bug
>    Affects Versions: trunk-win
>            Reporter: Ivan Mitic
>            Assignee: Chris Nauroth
>         Attachments: HADOOP-9008-branch-trunk-win.patch
> Trying to build Hadoop trunk tarball via {{mvn package -Pdist -DskipTests -Dtar}} fails
on Windows.
> Build system generates sh scripts that execute build tasks what does not work on Windows
without Cygwin. It might make sense to apply the same pattern as in HADOOP-8924, and use python
instead of sh.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

View raw message