samza-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Edi Bice <edi.b...@gmail.com>
Subject Re: RocksDB LOG file rotation
Date Thu, 21 Jan 2016 14:52:32 GMT
Thanks Yi - found the issue and commented there about my pull request
implementing these and a few other RocksDB options.

On Tue, Jan 19, 2016 at 2:59 PM, Yi Pan <nickpan47@gmail.com> wrote:

> Hi, Edi,
>
> Thanks for the request. I have created SAMZA-860 to track this issue.
>
> -Yi
>
> On Mon, Jan 4, 2016 at 7:20 AM, Edi Bice <edi.bice@gmail.com> wrote:
>
> > I noticed that the LOG files in each RocksDB kv store grow indefinitely.
> I
> > could set them up via logrotate but it would be cumbersome and against
> the
> > grain. Tried to figure out if RocksDB has a configuration file and I
> don't
> > have a definite answer yet (the one mention is for version 4.3).
> >
> > RocksDB does expose methods for this very purpose:
> >
> > setMaxLogFileSize
> > setMaxManifestFileSize
> > setKeepLogFileNum
> >
> > Samza should use these to provide a sensible default out-of-the-box.
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message