samza-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Edi Bice <edi.b...@gmail.com>
Subject RocksDB LOG file rotation
Date Mon, 04 Jan 2016 15:20:45 GMT
I noticed that the LOG files in each RocksDB kv store grow indefinitely. I
could set them up via logrotate but it would be cumbersome and against the
grain. Tried to figure out if RocksDB has a configuration file and I don't
have a definite answer yet (the one mention is for version 4.3).

RocksDB does expose methods for this very purpose:

setMaxLogFileSize
setMaxManifestFileSize
setKeepLogFileNum

Samza should use these to provide a sensible default out-of-the-box.

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message