kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Srinivasa Balaji <srinivasa_bal...@trimble.com>
Subject Re: Kafka - Move topics to different Partition in same hardware
Date Wed, 10 May 2017 10:20:48 GMT
Abhimanyu,
                     Thanks for the advice. We have already done this, the
max size of EBS volume is 15TB and we have reached it. At this point we are
looking to distributing topics across different HW partitions, we are
looking at a issues like this
http://stackoverflow.com/questions/36061426/how-to-spread-existing-kafka-topic-partitions-into-more-directories/43883584#43883584


I am more looking at approach #3 in this topic.


———————————————-
<http://www.trimble.com/>
Srinivasa Balaji L
Principal Architect Cloud & DevOPS - TPaaS
C-North 503 & 504, 5th Floor | Tidel Park, Chennai 600 113, India
+919790804422 Mobile
lsbalaji@trimble.com

On Wed, May 10, 2017 at 3:45 PM, Abhimanyu Nagrath <
abhimanyunagrath@gmail.com> wrote:

> Hi Srinivasa,
>
> If you are using ebs disk then you can increase the size of your disk at
> runtime. else stop your Kafka node, attach a bigger disk then manually copy
> data to the newly attached disk specify the new path in
> Kafka server.properties and restart kafka.
>
> Regards,
> Abhimanyu
>
> On Wed, May 10, 2017 at 9:34 AM, Srinivasa Balaji <
> srinivasa_balaji@trimble.com> wrote:
>
>> Hello All,
>>               We are running Brokers in AWS. The brokers have drives of
>> 15TB attached, We have outgrown the single partitions and are running out
>> of space.
>>
>> I need some help on
>>
>> - How to add a new log dir
>> - How to move topics to a new log dir
>> - what will work well is moving partitions to the new log dir
>>
>> Thanks in advance.
>>
>>
>> Srinivasa Balaji L
>> Architect - Trimble
>> lsbalaji@trimble.com
>>
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message