hadoop-mapreduce-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Thomas Graves <tgra...@yahoo-inc.com>
Subject Re: Mavenizing the HDFS build
Date Mon, 22 Aug 2011 20:16:45 GMT
What is the expected way to run from the tarballs?

It seems if I just untar them so they are in their separate directories (
hadoop-common-0.23.0-SNAPSHOT/, hadoop-hdfs-0.23.0-SNAPSHOT/,
hadoop-mapreduce-1.0-SNAPSHOT/), setup the ENV vars for HADOOP_COMMON_HOME,
HADOOP_HDFS_HOME, etc.. It won't run like I would expect it to.  Certain
things like hadoop-config.sh are in libexec and it expects them in bin,
things in hdfs bin it looks for in common bin, things are in sbin but it
wants them in bin, it now can't seem to find the hdfs jars, etc..  Hopefully
I'm missing something simple to make this work?

Tom Graves

On 8/19/11 12:55 PM, "Tom White" <tom@cloudera.com> wrote:

> HDFS-2096 is now committed to trunk. The instructions for building
> HDFS can be found in the top-level BUILDING.txt file.
> I added a script to https://issues.apache.org/jira/browse/HADOOP-7500
> to help with migrating HDFS patches to the new layout.
> There are a few follow-up patches that need doing soon (e.g.
> HADOOP-7498, HADOOP-7496, MAPREDUCE-2856), but these shouldn't stop
> folks from doing development as usual.
> Thanks to everyone who helped with this!
> Cheers,
> Tom
> On Thu, Aug 18, 2011 at 11:30 AM, Tom White <tom@cloudera.com> wrote:
>> Now that MR-279 has been merged into trunk, I plan to commit the HDFS
>> mavenization changes tomorrow (Friday) at 9am PDT.
>> Cheers,
>> Tom
>> On Mon, Aug 15, 2011 at 1:24 PM, Arun C Murthy <acm@hortonworks.com> wrote:
>>> Thanks Tom.
>>> I'm running the final set of tests with the 'MR-279 rebased on trunk' and
>>> should be done by tmrw.
>>> Also, can you guys please ensure that secure HDFS works after mvn'ization?
>>> thanks,
>>> Arun
>>> On Aug 13, 2011, at 9:39 PM, Tom White wrote:
>>>> Hi Arun,
>>>> I'm fine with that. When do you expect to start the vote?
>>>> Cheers,
>>>> Tom
>>>> On Fri, Aug 12, 2011 at 11:41 PM, Arun C Murthy <acm@hortonworks.com>
>>>> wrote:
>>>>> Hi Tom,
>>>>>  Can I request you to wait on this commit until we merge MR-279? As
>>>>> pointed out in his mail to mapreduce-dev@ we are very close to getting
>>>>> merge done. We should call a vote asap. By holding off it the mvn patch
>>>>> will save us a bit of time - we spent at more than a couple of days on
>>>>> resolving after the common mvn'ization.
>>>>>  Thanks for understanding.
>>>>> Arun
>>>>> On Aug 12, 2011, at 4:18 PM, Tom White wrote:
>>>>>> The work in https://issues.apache.org/jira/browse/HDFS-2096 is ready
>>>>>> to be committed, so unless there are any objections I will do so
>>>>>> Monday at 5pm UTC (that's 10am PDT, http://s.apache.org/o6F).
>>>>>> I'll also create a script to convert patches to the new layout, and
>>>>>> switch over the Jenkins jobs that test and build HDFS.
>>>>>> Cheers,
>>>>>> Tom

View raw message