samza-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Lukáš Havrlant <lu...@havrlant.cz>
Subject How to set up RocksDB
Date Mon, 09 Nov 2015 13:50:58 GMT
Hello,
we have a problem with configuring RocksDB as a key-value store with our
Samza 0.9.0 project. We added this line to our config:

stores.my-store.factory=org.apache.samza.storage.kv.RocksDbKeyValueStorageEngineFactory

But then our Samza job couldn't locate the
RocksDbKeyValueStorageEngineFactory class. So we added compile
"org.apache.samza:samza-kv-rocksdb_2.10:$samzaVersion" to our gradle build
script. It helped but now Samza failed to start because it couldn't
find librocksdbjni-linux64.so library. We added export
ROCKSDB_SHAREDLIB_DIR=/opt/samza/lib to our init script and it didn't help.
Then we manually copied the librocksdbjni-linux64.so from
the rocksdbjni-3.5.1.jar to the /opt/samza/lib folder and Samza still
couldn't start, now because of

2015-11-09T14:35:06,209 INFO [main]
org.apache.samza.container.SamzaContainer$ - Got store consumers:
Map(tracking-info ->
org.apache.samza.system.kafka.KafkaSystemConsumer@78461bc4)
# A fatal error has been detected by the Java Runtime Environment:
#
#  SIGSEGV (0xb) at pc=0x0000003c4de092ab, pid=4410, tid=139728971949824

And we're out of ideas at the moment. Can you please help me set up RocksDB
correctly? I suppose we are doing something completely wrong.

Is it possibble to use another key-value store at least?

Lukáš Havrlant

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message