kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Steve Morin <st...@stevemorin.com>
Subject Re: migrating log data to new locations
Date Tue, 07 Oct 2014 14:02:00 GMT
Neha,
 I log volume or can it be volumes plural?
-Steve

On Tue, Oct 7, 2014 at 6:41 AM, Neha Narkhede <neha.narkhede@gmail.com>
wrote:

> Is it possible to perform this migration without losing the data currently
> stored in the kafka cluster?
>
> Though I haven't tested this, the way this is designed should allow you to
> shut down a broker, move some partition directories over to the new log
> volume and restart the broker. You will have to do this manually per broker
> though.
>
> Thanks,
> Neha
>
> On Tue, Oct 7, 2014 at 3:31 AM, Javier Alba <me@fjavieralba.com> wrote:
>
> > Hi,
> >
> > I have a Kafka 0.8.1.1 cluster consisting in 4 servers with several
> topics
> > on it.
> >
> > The cluster was initially configured to store kafka log data in a single
> > directory on each server (log.dirs = /tmp/kafka-logs)
> >
> > Now, I have assigned 3 new disks to each server and I would like to use
> > them to store log data, instead the old directory. (logs.dirs =
> > /srv/data/1,/srv/data/2,/srv/data/3)
> >
> > What would be the recommended way of doing such a migration?
> >
> > Is it possible to perform this migration without losing the data
> currently
> > stored in the kafka cluster?
> >
> > Would it be possible to achieve that kind of change without having to
> stop
> > the cluster and losing service?
> >
> >
> > Thanks,
> >
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message