kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From David Arthur <mum...@gmail.com>
Subject Re: Hardware profile
Date Fri, 29 Mar 2013 18:47:41 GMT
How many brokers are you (LinkedIn) running? What kind of network topology?

On 3/29/13 2:45 PM, Neha Narkhede wrote:
> 1. We never share zookeeper and broker on the same hardware. Both need
> significant memory to operate efficiently.
> 2. 14 drive setup is just for Kafka. We have a separate disk for the OS, AFAIK.
>
> Thanks,
> Neha
>
> On Fri, Mar 29, 2013 at 11:37 AM, Ian Friedman <ian@flurry.com> wrote:
>> Thanks Jun. Couple more questions:
>> 1. Do you guys have dedicated hardware for Zookeeper or do you have a few machines
run both a ZK and a broker? If so, do you keep the ZK and Kafka data on separate volumes?
>> 2. You use the 14 drive raid setup is just for Kafka data and a separate drive for
the OS?
>>
>> Thanks again,
>> Ian
>>
>>
>> On Friday, March 29, 2013 at 12:43 PM, Jun Rao wrote:
>>
>>> It's more or less the same. Our new server has 14 sata disks, each of 1 TB.
>>> The disk also has better write latency due to larger write cache.
>>>
>>> Thanks,
>>>
>>> Jun
>>>
>>> On Fri, Mar 29, 2013 at 8:32 AM, Ian Friedman <ian@flurry.com (mailto:ian@flurry.com)>
wrote:
>>>
>>>> Hi all,
>>>>
>>>> I'm wondering how up to date the hardware specs listed on this page are:
>>>> https://cwiki.apache.org/confluence/display/KAFKA/Operations
>>>>
>>>> We're evaluating hardware for a Kafka broker/ZK quorum buildout and
>>>> looking for some tips and/or sample configurations if anyone can help us
>>>> out with some recommendations.
>>>>
>>>> Thanks in advance,
>>>> Ian
>>>>
>>>
>>>
>>


Mime
View raw message