whirr-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Andrei Savu <savu.and...@gmail.com>
Subject Re: Best way to add customize scripts on Hadoop Nodes
Date Fri, 30 Aug 2013 21:52:55 GMT
No handler will guarantee that Hadoop is ready to accept jobs. You need
custom code to query the jobtracker (check the integration tests).

I think you should write a thin layer on top of Whirr that will maker this
happen.
On Aug 31, 2013 12:46 AM, "Ken Masters" <kenmasters.cloud@gmail.com> wrote:

> Hi Andrei,
>
> Suppose I have a Hadoop Job need to be run automatically right after I
> launch the cluster (I add a script function). The cluster has three nodes,
> one master and two slaves.
> Should I call this function in @afterStart? or @afterConfigure (on master
> Handler)? (in which phase we can guarantee that all the nodes have been
> fully created and the cluster ready to accept jobs?)
>
> Thanks and Regards,
> Ken
>
>
> On Fri, Aug 30, 2013 at 2:36 AM, Andrei Savu <savu.andrei@gmail.com>wrote:
>
>> Hi Ken -
>>
>> You can either define your own service that does customization or
>> override and extend the existing Hadoop scripts.
>>
>> See "How can I modify the instance installation and configuration
>> scripts?"
>> http://whirr.apache.org/faq.html
>>
>> Regards,
>>
>> -- Andrei Savu / axemblr.com
>>
>>
>> On Fri, Aug 30, 2013 at 9:57 AM, Ken Masters <kenmasters.cloud@gmail.com>wrote:
>>
>>> Hi,
>>>
>>> May I know what's the bast way to add some customize scripts on hadoop
>>> nodes during the launch time?
>>>
>>> Thanks,
>>> Ken
>>>
>>
>>
>

Mime
View raw message