storm-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Abhishek Raj <abhishek....@saavn.com>
Subject Re: Storm 1.0.2 - Nimbus reporting Gzip failure in spite of resetting Storm and Zookeeper state
Date Fri, 28 Oct 2016 07:54:09 GMT
Try changing "storm.zookeeper.root" in your storm.yaml and restarting storm
daemons.

Thanks,
Abhishek

On Oct 28, 2016 1:06 PM, "Øystein Larsen" <oysteila@ifi.uio.no> wrote:

> Hi! I'm having trouble running Nimbus following a systems upgrade of my
> Ubuntu 14.04 server yesterday. I've tried using Java 8 from Oracle with
> no luck, so I've reverted back to OpenJDK 7. The error that keeps
> showing up is quoted below.
>
> We've tried re-installing the Storm distribution but are set on using
> 1.0.2 unless it proves broken.
>
> Zookeeper has had its state under /var/lib/zookeeper/ deleted, as well
> as the storm-local state on all supervisor nodes and the Nimbus node.
>
> I observe that the problem occurs as the Nimbus server connects to
> Zookeeper - the supervisor nodes may be running or shut down, and the
> exception will still occur.
>
> As I understand it, some kind of data object about to be serialized and
> expected to be in ZIP format either isn't zipped or isn't there at all.
> Could this be a fault in the JAR files? Or have we forgotten some state
> to zero out? We've emptied our /tmp directories as well.
>
>
> Exception in Nimbus log:
>
> 2016-10-28 09:04:55.615 o.a.s.zookeeper [INFO] active-topology-ids []
> local-topology-ids [] diff-topology []
> 2016-10-28 09:04:55.616 o.a.s.zookeeper [INFO] Accepting leadership, all
> active topology found localy.
> 2016-10-28 09:05:01.367 o.a.s.d.nimbus [ERROR] Error when processing event
> java.lang.RuntimeException: java.lang.RuntimeException:
> java.util.zip.ZipException: Not in GZIP format
>         at
> org.apache.storm.serialization.GzipThriftSerializationDelegat
> e.deserialize(GzipThriftSerializationDelegate.java:53)
>         at org.apache.storm.utils.Utils.deserialize(Utils.java:145)
>         at
> org.apache.storm.cluster$maybe_deserialize.invoke(cluster.clj:224)
>         at
> org.apache.storm.cluster$mk_storm_cluster_state$reify__
> 3761.supervisor_info(cluster.clj:407)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:
> 57)
>         at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(
> DelegatingMethodAccessorImpl.java:43)
>         at java.lang.reflect.Method.invoke(Method.java:606)
>         at clojure.lang.Reflector.invokeMatchingMethod(Reflector.java:93)
>         at clojure.lang.Reflector.invokeInstanceMethod(Reflector.java:28)
>         at
> org.apache.storm.daemon.nimbus$all_supervisor_info$fn_
> _6483.invoke(nimbus.clj:426)
>         at clojure.core$map$fn__4553.invoke(core.clj:2624)
>         at clojure.lang.LazySeq.sval(LazySeq.java:40)
>         at clojure.lang.LazySeq.seq(LazySeq.java:49)
>         at clojure.lang.RT.seq(RT.java:507)
>         at clojure.core$seq__4128.invoke(core.clj:137)
>         at clojure.core$apply.invoke(core.clj:630)
>         at clojure.core$mapcat.doInvoke(core.clj:2660)
>         at clojure.lang.RestFn.invoke(RestFn.java:423)
>         at
> org.apache.storm.daemon.nimbus$all_supervisor_info.invoke(nimbus.clj:424)
>         at
> org.apache.storm.daemon.nimbus$all_scheduling_slots.invoke(nimbus.clj:437)
>         at
> org.apache.storm.daemon.nimbus$compute_new_scheduler_
> assignments.invoke(nimbus.clj:841)
>         at
> org.apache.storm.daemon.nimbus$mk_assignments.doInvoke(nimbus.clj:912)
>         at clojure.lang.RestFn.invoke(RestFn.java:410)
>         at
> org.apache.storm.daemon.nimbus$fn__7166$exec_fn__2466_
> _auto____7167$fn__7180$fn__7181.invoke(nimbus.clj:1414)
>         at
> org.apache.storm.daemon.nimbus$fn__7166$exec_fn__2466_
> _auto____7167$fn__7180.invoke(nimbus.clj:1413)
>         at
> org.apache.storm.timer$schedule_recurring$this__6306.invoke(timer.clj:105)
>         at
> org.apache.storm.timer$mk_timer$fn__6289$fn__6290.invoke(timer.clj:50)
>         at org.apache.storm.timer$mk_timer$fn__6289.invoke(timer.clj:42)
>         at clojure.lang.AFn.run(AFn.java:22)
>         at java.lang.Thread.run(Thread.java:745)
> Caused by: java.lang.RuntimeException: java.util.zip.ZipException: Not
> in GZIP format
>         at org.apache.storm.utils.Utils.gunzip(Utils.java:217)
>         at
> org.apache.storm.serialization.GzipThriftSerializationDelegat
> e.deserialize(GzipThriftSerializationDelegate.java:50)
>         ... 30 more
> Caused by: java.util.zip.ZipException: Not in GZIP format
>         at
> java.util.zip.GZIPInputStream.readHeader(GZIPInputStream.java:164)
>         at java.util.zip.GZIPInputStream.<init>(GZIPInputStream.java:78)
>         at java.util.zip.GZIPInputStream.<init>(GZIPInputStream.java:90)
>         at org.apache.storm.utils.Utils.gunzip(Utils.java:207)
>         ... 31 more
> 2016-10-28 09:05:01.398 o.a.s.util [ERROR] Halting process: ("Error when
> processing an event")
> java.lang.RuntimeException: ("Error when processing an event")
>         at org.apache.storm.util$exit_process_BANG_.doInvoke(util.clj:341)
>         at clojure.lang.RestFn.invoke(RestFn.java:423)
>         at
> org.apache.storm.daemon.nimbus$nimbus_data$fn__6397.invoke(nimbus.clj:195)
>         at
> org.apache.storm.timer$mk_timer$fn__6289$fn__6290.invoke(timer.clj:71)
>         at org.apache.storm.timer$mk_timer$fn__6289.invoke(timer.clj:42)
>         at clojure.lang.AFn.run(AFn.java:22)
>         at java.lang.Thread.run(Thread.java:745)
>

Mime
View raw message