kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Siva Ram <sivaraman...@gmail.com>
Subject Error persisting into KeyValueStore
Date Tue, 07 Aug 2018 06:07:29 GMT
Hi,

We switched to a virtual machine (from physical node) and we are observing
the following exception occurs and all our the stream application instances
fails.  Can you please advise what causes this exception?


2018-08-07 01:31:14 ERROR MetaStream380 - Unknown Exception occurred
org.apache.kafka.streams.errors.ProcessorStateException: task [2_3] Failed
to flush state store kvshourly1
        at
org.apache.kafka.streams.processor.internals.ProcessorStateManager.flush(ProcessorStateManager.java:245)
        at
org.apache.kafka.streams.processor.internals.AbstractTask.flushState(AbstractTask.java:196)
        at
org.apache.kafka.streams.processor.internals.StreamTask.flushState(StreamTask.java:324)
        at
org.apache.kafka.streams.processor.internals.StreamTask$1.run(StreamTask.java:304)
        at
org.apache.kafka.streams.processor.internals.StreamsMetricsImpl.measureLatencyNs(StreamsMetricsImpl.java:208)
        at
org.apache.kafka.streams.processor.internals.StreamTask.commit(StreamTask.java:299)
        at
org.apache.kafka.streams.processor.internals.StreamTask.commit(StreamTask.java:289)
        at
org.apache.kafka.streams.processor.internals.AssignedTasks$2.apply(AssignedTasks.java:87)
        at
org.apache.kafka.streams.processor.internals.AssignedTasks.applyToRunningTasks(AssignedTasks.java:451)
        at
org.apache.kafka.streams.processor.internals.AssignedTasks.commit(AssignedTasks.java:380)
        at
org.apache.kafka.streams.processor.internals.TaskManager.commitAll(TaskManager.java:309)
        at
org.apache.kafka.streams.processor.internals.StreamThread.maybeCommit(StreamThread.java:1018)
        at
org.apache.kafka.streams.processor.internals.StreamThread.runOnce(StreamThread.java:835)
        at
org.apache.kafka.streams.processor.internals.StreamThread.runLoop(StreamThread.java:774)
        at
org.apache.kafka.streams.processor.internals.StreamThread.run(StreamThread.java:744)
Caused by: java.lang.IllegalArgumentException: Illegal value provided for
SubCode.
        at org.rocksdb.Status$SubCode.getSubCode(Status.java:109)
        at org.rocksdb.Status.<init>(Status.java:30)
        at org.rocksdb.RocksDB.put(Native Method)
        at org.rocksdb.RocksDB.put(RocksDB.java:488)
        at
org.apache.kafka.streams.state.internals.RocksDBStore.putInternal(RocksDBStore.java:330)
        at
org.apache.kafka.streams.state.internals.RocksDBStore.put(RocksDBStore.java:292)
        at
org.apache.kafka.streams.state.internals.ChangeLoggingKeyValueBytesStore.put(ChangeLoggingKeyValueBytesStore.java:57)
        at
org.apache.kafka.streams.state.internals.ChangeLoggingKeyValueBytesStore.put(ChangeLoggingKeyValueBytesStore.java:29)
        at
org.apache.kafka.streams.state.internals.CachingKeyValueStore.putAndMaybeForward(CachingKeyValueStore.java:97)
        at
org.apache.kafka.streams.state.internals.CachingKeyValueStore.access$000(CachingKeyValueStore.java:35)
        at
org.apache.kafka.streams.state.internals.CachingKeyValueStore$1.apply(CachingKeyValueStore.java:79)
        at
org.apache.kafka.streams.state.internals.NamedCache.flush(NamedCache.java:141)
        at
org.apache.kafka.streams.state.internals.NamedCache.flush(NamedCache.java:99)
        at
org.apache.kafka.streams.state.internals.ThreadCache.flush(ThreadCache.java:127)
        at
org.apache.kafka.streams.state.internals.CachingKeyValueStore.flush(CachingKeyValueStore.java:112)
        at
org.apache.kafka.streams.state.internals.InnerMeteredKeyValueStore.flush(InnerMeteredKeyValueStore.java:268)
        at
org.apache.kafka.streams.state.internals.MeteredKeyValueBytesStore.flush(MeteredKeyValueBytesStore.java:153)
        at
org.apache.kafka.streams.processor.internals.ProcessorStateManager.flush(ProcessorStateManager.java:242)

Thanks,
Siva

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message