storm-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Vineet Mishra <clearmido...@gmail.com>
Subject Failed to Load Native Library Snappy - org.xerial.snappy.SnappyError
Date Fri, 06 Feb 2015 08:32:26 GMT
Hi Al,

I have recently got stuck into a issue, I was trying to run a Storm
Topology with Kafka-Storm as Spout, recently I moved the Storm Cluster on
different machines(earlier 3 nodes were sharing both the Kafka and Storm).

While I am running the topology again I am ending up in error saying,

org.xerial.snappy.SnappyError: [FAILED_TO_LOAD_NATIVE_LIBRARY] null at
org.xerial.snappy.SnappyLoader.load(SnappyLoader.java:229) at
org.xerial.snappy.Snappy.<clinit>(Snappy.java:44) at
org.xerial.snappy.SnappyInputStream.hasNextChunk(SnappyInputStream.java:350)
at org.xerial.snappy.SnappyInputStream.rawRead(SnappyInputStream.java:158)
at org.xerial.snappy.SnappyInputStream.read(SnappyInputStream.java:142) at
java.io.InputStream.read(InputStream.java:101) at
kafka.message.ByteBufferMessageSet$$anonfun$decompress$1.apply$mcI$sp(ByteBufferMessageSet.scala:68)
at
kafka.message.ByteBufferMessageSet$$anonfun$decompress$1.apply(ByteBufferMessageSet.scala:68)
at
kafka.message.ByteBufferMessageSet$$anonfun$decompress$1.apply(ByteBufferMessageSet.scala:68)
at scala.collection.immutable.Stream$.continually(Stream.scala:1104) at
kafka.message.ByteBufferMessageSet$.decompress(ByteBufferMessageSet.scala:68)
at
kafka.message.ByteBufferMessageSet$$anon$1.makeNextOuter(ByteBufferMessageSet.scala:178)
at
kafka.message.ByteBufferMessageSet$$anon$1.makeNext(ByteBufferMessageSet.scala:191)
at
kafka.message.ByteBufferMessageSet$$anon$1.makeNext(ByteBufferMessageSet.scala:145)
at kafka.utils.IteratorTemplate.maybeComputeNext(IteratorTemplate.scala:66)
at kafka.utils.IteratorTemplate.hasNext(IteratorTemplate.scala:58) at
kafka.javaapi.message.ByteBufferMessageSet$$anon$1.hasNext(ByteBufferMessageSet.scala:42)
at storm.kafka.PartitionManager.fill(PartitionManager.java:177) at
storm.kafka.PartitionManager.next(PartitionManager.java:124) at
storm.kafka.KafkaSpout.nextTuple(KafkaSpout.java:141) at
backtype.storm.daemon.executor$fn__3373$fn__3388$fn__3417.invoke(executor.clj:565)
at backtype.storm.util$async_loop$fn__464.invoke(util.clj:463) at
clojure.lang.AFn.run(AFn.java:24) at java.lang.Thread.run(Thread.java:745)

Even though I could validate the Snappy library to be present in my Storm
Topology Jar and I even tried keeping the Snappy Jar in Storm lib folder
but still no luck.

Looking out for a quick solution.

Thanks!

Mime
View raw message