storm-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Øystein Larsen <oyste...@ifi.uio.no>
Subject Storm 1.0.2 - Nimbus reporting Gzip failure in spite of resetting Storm and Zookeeper state
Date Fri, 28 Oct 2016 07:29:56 GMT
Hi! I'm having trouble running Nimbus following a systems upgrade of my
Ubuntu 14.04 server yesterday. I've tried using Java 8 from Oracle with
no luck, so I've reverted back to OpenJDK 7. The error that keeps
showing up is quoted below.

We've tried re-installing the Storm distribution but are set on using
1.0.2 unless it proves broken.

Zookeeper has had its state under /var/lib/zookeeper/ deleted, as well
as the storm-local state on all supervisor nodes and the Nimbus node.

I observe that the problem occurs as the Nimbus server connects to
Zookeeper - the supervisor nodes may be running or shut down, and the
exception will still occur.

As I understand it, some kind of data object about to be serialized and
expected to be in ZIP format either isn't zipped or isn't there at all.
Could this be a fault in the JAR files? Or have we forgotten some state
to zero out? We've emptied our /tmp directories as well.


Exception in Nimbus log:

2016-10-28 09:04:55.615 o.a.s.zookeeper [INFO] active-topology-ids []
local-topology-ids [] diff-topology []
2016-10-28 09:04:55.616 o.a.s.zookeeper [INFO] Accepting leadership, all
active topology found localy.
2016-10-28 09:05:01.367 o.a.s.d.nimbus [ERROR] Error when processing event
java.lang.RuntimeException: java.lang.RuntimeException:
java.util.zip.ZipException: Not in GZIP format
        at
org.apache.storm.serialization.GzipThriftSerializationDelegate.deserialize(GzipThriftSerializationDelegate.java:53)
        at org.apache.storm.utils.Utils.deserialize(Utils.java:145)
        at
org.apache.storm.cluster$maybe_deserialize.invoke(cluster.clj:224)
        at
org.apache.storm.cluster$mk_storm_cluster_state$reify__3761.supervisor_info(cluster.clj:407)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:606)
        at clojure.lang.Reflector.invokeMatchingMethod(Reflector.java:93)
        at clojure.lang.Reflector.invokeInstanceMethod(Reflector.java:28)
        at
org.apache.storm.daemon.nimbus$all_supervisor_info$fn__6483.invoke(nimbus.clj:426)
        at clojure.core$map$fn__4553.invoke(core.clj:2624)
        at clojure.lang.LazySeq.sval(LazySeq.java:40)
        at clojure.lang.LazySeq.seq(LazySeq.java:49)
        at clojure.lang.RT.seq(RT.java:507)
        at clojure.core$seq__4128.invoke(core.clj:137)
        at clojure.core$apply.invoke(core.clj:630)
        at clojure.core$mapcat.doInvoke(core.clj:2660)
        at clojure.lang.RestFn.invoke(RestFn.java:423)
        at
org.apache.storm.daemon.nimbus$all_supervisor_info.invoke(nimbus.clj:424)
        at
org.apache.storm.daemon.nimbus$all_scheduling_slots.invoke(nimbus.clj:437)
        at
org.apache.storm.daemon.nimbus$compute_new_scheduler_assignments.invoke(nimbus.clj:841)
        at
org.apache.storm.daemon.nimbus$mk_assignments.doInvoke(nimbus.clj:912)
        at clojure.lang.RestFn.invoke(RestFn.java:410)
        at
org.apache.storm.daemon.nimbus$fn__7166$exec_fn__2466__auto____7167$fn__7180$fn__7181.invoke(nimbus.clj:1414)
        at
org.apache.storm.daemon.nimbus$fn__7166$exec_fn__2466__auto____7167$fn__7180.invoke(nimbus.clj:1413)
        at
org.apache.storm.timer$schedule_recurring$this__6306.invoke(timer.clj:105)
        at
org.apache.storm.timer$mk_timer$fn__6289$fn__6290.invoke(timer.clj:50)
        at org.apache.storm.timer$mk_timer$fn__6289.invoke(timer.clj:42)
        at clojure.lang.AFn.run(AFn.java:22)
        at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.RuntimeException: java.util.zip.ZipException: Not
in GZIP format
        at org.apache.storm.utils.Utils.gunzip(Utils.java:217)
        at
org.apache.storm.serialization.GzipThriftSerializationDelegate.deserialize(GzipThriftSerializationDelegate.java:50)
        ... 30 more
Caused by: java.util.zip.ZipException: Not in GZIP format
        at
java.util.zip.GZIPInputStream.readHeader(GZIPInputStream.java:164)
        at java.util.zip.GZIPInputStream.<init>(GZIPInputStream.java:78)
        at java.util.zip.GZIPInputStream.<init>(GZIPInputStream.java:90)
        at org.apache.storm.utils.Utils.gunzip(Utils.java:207)
        ... 31 more
2016-10-28 09:05:01.398 o.a.s.util [ERROR] Halting process: ("Error when
processing an event")
java.lang.RuntimeException: ("Error when processing an event")
        at org.apache.storm.util$exit_process_BANG_.doInvoke(util.clj:341)
        at clojure.lang.RestFn.invoke(RestFn.java:423)
        at
org.apache.storm.daemon.nimbus$nimbus_data$fn__6397.invoke(nimbus.clj:195)
        at
org.apache.storm.timer$mk_timer$fn__6289$fn__6290.invoke(timer.clj:71)
        at org.apache.storm.timer$mk_timer$fn__6289.invoke(timer.clj:42)
        at clojure.lang.AFn.run(AFn.java:22)
        at java.lang.Thread.run(Thread.java:745)

Mime
View raw message