spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Guillaume Guy <guillaume.c....@gmail.com>
Subject Re: Speed Benchmark
Date Wed, 04 Mar 2015 13:36:04 GMT
Sorry for the confusion.

All are running Hadoop services. Node 1 is the namenode whereas Nodes 2 and
3 are datanodes.



Best,

Guillaume Guy

* +1 919 - 972 - 8750*

On Sat, Feb 28, 2015 at 1:09 AM, Sean Owen <sowen@cloudera.com> wrote:

> Is machine 1 the only one running an HDFS data node? You describe it as
> one running Hadoop services.
> On Feb 27, 2015 9:44 PM, "Guillaume Guy" <guillaume.c.guy@gmail.com>
> wrote:
>
>> Hi Jason:
>>
>> Thanks for your feedback.
>>
>> Beside the information above I mentioned, there are 3 machines in the
>> cluster.
>>
>> *1st one*: Driver + has a bunch of Hadoop services. 32GB of RAM, 8 cores
>> (2 used)
>> *2nd + 3rd: *16B of RAM, 4 cores (2 used each)
>>
>>  I hope this helps clarify.
>>
>> Thx.
>>
>> GG
>>
>>
>>
>> Best,
>>
>> Guillaume Guy
>>
>> * +1 919 - 972 - 8750 <%2B1%20919%20-%20972%20-%208750>*
>>
>> On Fri, Feb 27, 2015 at 9:06 AM, Jason Bell <jasebell@gmail.com> wrote:
>>
>>> How many machines are on the cluster?
>>> And what is the configuration of those machines (Cores/RAM)?
>>>
>>> "Small cluster" is very subjective statement.
>>>
>>>
>>>
>>> Guillaume Guy wrote:
>>>
>>>> Dear Spark users:
>>>>
>>>> I want to see if anyone has an idea of the performance for a small
>>>> cluster.
>>>>
>>>>
>>

Mime
View raw message