hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Phil Whelan <phil...@gmail.com>
Subject Re: Hbase/Hadoop cluster setup on AWS
Date Tue, 04 Jan 2011 22:26:20 GMT
Hi guys,

My recent blog post goes through in detail the steps I took to use
Whirr to start-up a CDH based Hadoop cluster on AWS. I'd really
appreciate any feedback you have on it. I'm planning to write a
similar on HBase.

http://www.philwhln.com/map-reduce-with-ruby-using-hadoop

Thanks,
Phil

On Tue, Jan 4, 2011 at 12:23 AM, Lars George <lars.george@gmail.com> wrote:
> Hi Otis,
>
> It also supports CDH although it does only start Hadoop
> (HDFS/MapReduce). I am going to open a JIRA to facilitate the start up
> of other services on top of that.
>
> Lars
>
> On Tue, Jan 4, 2011 at 4:31 AM, Otis Gospodnetic
> <otis_gospodnetic@yahoo.com> wrote:
>> Ah, Whirr and Hadoop/HBase on AWS.   Is this only applicable to using "raw"
>> HBase/Hadoop from ASF or can one use Whirr support for HBase/Hadoop deployment
>> to AWS with CDH?
>>
>> Thanks,
>> Otis
>> ----
>> Sematext :: http://sematext.com/ :: Solr - Lucene - Hadoop - HBase
>> Hadoop ecosystem search :: http://search-hadoop.com/
>>
>>
>>
>> ----- Original Message ----
>>> From: Lars George <lars.george@gmail.com>
>>> To: user@hbase.apache.org
>>> Sent: Mon, January 3, 2011 12:32:11 PM
>>> Subject: Re: Hbase/Hadoop cluster setup on AWS
>>>
>>> Hi H,
>>>
>>> While you can do that by hand I strongly recommend using Apache  Whirr
>>> (http://incubator.apache.org/projects/whirr.html) which has  Hadoop and
>>> (in trunk now) also HBase support, straight from the Apache  tarballs.
>>>
>>> If you want to set them up manually then you simply spin up N  machines
>>> and follow the normal guides for either project to set them  up
>>> appropriately, so extra magic needed.
>>>
>>> Lars
>>>
>>> On Mon, Jan 3,  2011 at 3:26 PM, h <helwyr@gmail.com> wrote:
>>> > Are there  any good tutorials on cluster setup on AWS
>>> > I'd prefer not to use  third-party scripts/frameworks, just a simple
>> sequence
>>> > of  steps/one-liner commands, using the original hadoop/hbase tarballs
>>> >
>>>
>>
>



-- 
Cell : +1 (778) 233-4935
Twitter : http://www.twitter.com/philwhln
LinkedIn : http://ca.linkedin.com/in/philwhln
Blog : http://www.philwhln.com
Skype : philwhelan76

Mime
View raw message