cloudstack-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Chiradeep Vittal <>
Subject Re: How to integrate Hadoop to CloudStack
Date Mon, 10 Sep 2012 05:21:46 GMT
You can read a little more about this here:

The code is actually fairly well tested but needs a couple of tweaks to
integrate with the current Apache master. It was on my to-do for 4.0 but
it slipped through the cracks.

If there is interest, I can fix the code for current Apache master and
supply the patch in a branch.

On 9/9/12 6:22 PM, "Nguyen Anh Tu" <> wrote:

>Hello Shanker,
>I mean that with CS, I want to replace NFS to HDFS. You know NFS is not a
>suitable solution for storage, because it has not fault-tolerant feature.
>So I want to use HDFS for Secondary Storage in CS. I see this
> I think
>in near future, Hadoop will be used as a storage solution in CS.
>2012/9/7 Shanker Balan <>
>> (Moving to cloudstack-users@ with Bcc to
>> Hello Nguyen,
>> Nguyen Anh Tu wrote,
>> > Hi guy,
>> >
>> > Anyone can help me to integrate Hadoop to CloudStack. I read the
>> > "CloudStack and Hadoop: a match made in the cloud" but can not find a
>> > to do this.
>> Could you explain a bit more on what you mean by "Integrating Hadoop To
>> Cloudstack"? I am not using CS yet, but I have a bunch of use cases I
>> been thinking about lately.
>> You can use Cloudstack to provision Hadoop instances very easily.
>> Cloudstack's
>> bare metal provisioning capabilities allows you to build high
>> clusters.
>> Cloudstack also provides an S3 compatible interface over supported
>> stores like Swift and Caringo. So instead of using HDFS, you can choose
>> store your data on CS backed by object store+s3 bridge.
>> On the other hand, if you are expecting a hosted Hadoop solution (like
>> EMR), I dont think that's quite ready yet (or if its even on the roadmap
>> anytime soon).
>> --
>> PS: cloudstack-users@ might be a more appropriate list to discuss this
>> further.

View raw message