From user-return-12541-apmail-storm-user-archive=storm.apache.org@storm.apache.org Thu Feb 9 17:24:51 2017 Return-Path: X-Original-To: apmail-storm-user-archive@minotaur.apache.org Delivered-To: apmail-storm-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 3775819364 for ; Thu, 9 Feb 2017 17:24:51 +0000 (UTC) Received: (qmail 93684 invoked by uid 500); 9 Feb 2017 17:24:50 -0000 Delivered-To: apmail-storm-user-archive@storm.apache.org Received: (qmail 93640 invoked by uid 500); 9 Feb 2017 17:24:50 -0000 Mailing-List: contact user-help@storm.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@storm.apache.org Delivered-To: mailing list user@storm.apache.org Received: (qmail 93630 invoked by uid 99); 9 Feb 2017 17:24:50 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 09 Feb 2017 17:24:50 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id C85291A04A4 for ; Thu, 9 Feb 2017 17:24:49 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.38 X-Spam-Level: ** X-Spam-Status: No, score=2.38 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, RCVD_IN_SORBS_SPAM=0.5, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=disabled Authentication-Results: spamd2-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id 4H-XuoBa2D8A for ; Thu, 9 Feb 2017 17:24:46 +0000 (UTC) Received: from mail-lf0-f52.google.com (mail-lf0-f52.google.com [209.85.215.52]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTPS id C6FAA5F4ED for ; Thu, 9 Feb 2017 17:24:45 +0000 (UTC) Received: by mail-lf0-f52.google.com with SMTP id x1so6575249lff.0 for ; Thu, 09 Feb 2017 09:24:45 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:from:date:message-id:subject:to; bh=LvXebc/04Ua17JOR9qQX3s+l41e3304wWZWmt8x/yGA=; b=OSOHS7Gd6IOOoBMBUff7iDDWXeUeBTWL6NSLF+7V1nle2rGMdrWOCKXqHorcga1jQS +NAtn2ZiMlYXRvbBB58kwdrAfNys18IFjfbKiMNh2yGVmJJk0Hs/Nk8OKMVIBOwTvKJs Va1fyGLt4B4z6RvAC2FalsTBm4Fddt6B7y9MZNVC0wabUoLZOMy4xseOYbCmedHMwIES BvFwwLfPGgYgMH7iKPb1NaVVXdoudFrdCD51Rg0FwpTLRXcNIDqFr0UA41wHCo1/4d7l JiUuIySpEel5tAZMVO2vUXFpNxWyAH1O7eXyK7OLaZ3dSL+1IIwJ6VUEU+1sNBtA5Dlk mQlA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=LvXebc/04Ua17JOR9qQX3s+l41e3304wWZWmt8x/yGA=; b=Z6l9f2fvYziS9gjqBQqP1utaVOc861jgYIgxep2PFolL0molPhsIpFoeYU8F6zeH1p RJYwPz9TlGdUN6+Ns0TAczdC5lWSrJ5lghXpO3wM/yA+II03mRWqwMwYwDvKk4E3H9mY rOy0A5toHfa7rzxQvdfUpYdX4+FWTrk4yLqw87eCskKGd2QgoKlHEsvdFImfei5vIW3+ 8Kq629/wLoiWoN/0i3XrpHqaAOGLg9BD6H1bxrxc0iC5BpJaiv4RGnRES6utEeImVw70 3v3JpovgLgt+Fy22dTWWeCMGeWxdPmOIgWm0TgKUmIhQYA/pLnE1G2/Rly0Kvx7Hnqc2 m41w== X-Gm-Message-State: AMke39njGQOZDkw1u5nZ/u3TMVP23vsveX1OScl8xF7MyVP24BuP8tJpSrE2uIRoI1P6A3zUrOE/TnhXqj9dIw== X-Received: by 10.25.162.146 with SMTP id l140mr1526401lfe.50.1486661084437; Thu, 09 Feb 2017 09:24:44 -0800 (PST) MIME-Version: 1.0 Received: by 10.25.28.10 with HTTP; Thu, 9 Feb 2017 09:24:24 -0800 (PST) From: Victor Godoy Poluceno Date: Thu, 9 Feb 2017 15:24:24 -0200 Message-ID: Subject: Can't embed object in code ..." run time error during worker creation To: user@storm.apache.org Content-Type: multipart/alternative; boundary=001a11410c02d6e36a05481c4191 --001a11410c02d6e36a05481c4191 Content-Type: text/plain; charset=UTF-8 I've build a very simple topology that uses a Kafka Spout, very much like this Streamparse's example [1], with just a few minor changes. This topology works great on local mode (development) but fails on a real Storm cluster. After the topology is submitted, Storm start to create its workers but fails with the following stack trace, full stack trace here [2]: [cut] 2017-02-09 12:46:28.776 b.s.d.worker [ERROR] Error on initialization of server mk-worker clojure.lang.Compiler$CompilerException: java.lang.RuntimeException: Can't embed object in code, maybe print-dup not defined: java.nio.HeapByteBuffer[pos=0 lim=14 cap=14], compiling:(NO_SOURCE_PATH:0:0) at clojure.lang.Compiler.analyzeSeq(Compiler.java:6651) ~[clojure-1.6.0.jar:?] at clojure.lang.Compiler.analyze(Compiler.java:6445) ~[clojure-1.6.0.jar:?] at clojure.lang.Compiler.eval(Compiler.java:6700) ~[clojure-1.6.0.jar:?] at clojure.lang.Compiler.eval(Compiler.java:6666) ~[clojure-1.6.0.jar:?] at clojure.core$eval.invoke(core.clj:2927) ~[clojure-1.6.0.jar:?] at backtype.storm.thrift$instantiate_java_object.invoke(thrift.clj:38) ~[storm-core-0.10.2.jar:0.10.2] at backtype.storm.daemon.task$get_task_object.invoke(task.clj:85) ~[storm-core-0.10.2.jar:0.10.2] at backtype.storm.daemon.task$mk_task_data$fn__5375.invoke(task.clj:185) ~[storm-core-0.10.2.jar:0.10.2] at backtype.storm.util$assoc_apply_self.invoke(util.clj:912) ~[storm-core-0.10.2.jar:0.10.2] at backtype.storm.daemon.task$mk_task_data.invoke(task.clj:178) ~[storm-core-0.10.2.jar:0.10.2] at backtype.storm.daemon.task$mk_task.invoke(task.clj:189) ~[storm-core-0.10.2.jar:0.10.2] at backtype.storm.daemon.executor$mk_executor$fn__5575.invoke(executor.clj:352) ~[storm-core-0.10.2.jar:0.10.2] [/cut] I'm not sure if this has something to do with Streamparse or is just a Storm issue. I've done some debug and seems to happen when Clojure runs a eval to evaluate a Java object, probably my Java Spout, but I haven't be able to determine way it fails to evaluate. Anyway, I'm running with: Storm version: 0.10.2 Streamparse 3.4.0 Java JRE 1.8.0_121 Any help is much appreciated. Thanks a lot for great work with Storm! [1] - https://github.com/Parsely/streamparse/tree/master/examples/kafka-jvm [2] - https://gist.github.com/victorpoluceno/9b8ace26a01488ccc8a0184d0bc58383 -- hooray! -- Victor Godoy Poluceno --001a11410c02d6e36a05481c4191 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
I've build a very simple topology that uses = a Kafka Spout,=20 very much like this Streamparse's example [1], with just a few minor ch= anges. This topology works great on local mode (development) but fails on a=20 real Storm cluster. After the topology is submitted, Storm start to create = its workers but fails with the following stack trace, full stack trace here [2= ]:

[cut]
2017-02-09 12:46:28.776 b.s.d.worker [ERROR]= Error on initialization of server mk-worker 
clojure.lang.Compiler$CompilerException: java.lang.Runtim=
eException: Can't embed object in code, maybe print-dup not defined: ja=
va.nio.HeapByteBuffer[pos=3D0 lim=3D14 cap=3D14], compiling:(NO_SOURCE_PATH=
:0:0)
	at clojure.lang.Compiler.analyzeSeq(Compiler.java:6651) ~[clojure-1.6.0.ja=
r:?]
	at clojure.lang.Compiler.analyze(Compiler.java:6445) ~[clojure-1.6.0.jar:?=
]
	at clojure.lang.Compiler.eval(Compiler.java:6700) ~[clojure-1.6.0.jar:?]
	at clojure.lang.Compiler.eval(Compiler.java:6666) ~[clojure-1.6.0.jar:?]
	at clojure.core$eval.invoke(core.clj:2927) ~[clojure-1.6.0.jar:?]
	at backtype.storm.thrift$instantiate_java_object.invoke(thrift.clj:38) ~[s=
torm-core-0.10.2.jar:0.10.2]
	at backtype.storm.daemon.task$get_task_object.invoke(task.clj:85) ~[storm-=
core-0.10.2.jar:0.10.2]
	at backtype.storm.daemon.task$mk_task_data$fn__5375.invoke(task.clj:185) ~=
[storm-core-0.10.2.jar:0.10.2]
	at backtype.storm.util$assoc_apply_self.invoke(util.clj:912) ~[storm-core-=
0.10.2.jar:0.10.2]
	at backtype.storm.daemon.task$mk_task_data.invoke(task.clj:178) ~[storm-co=
re-0.10.2.jar:0.10.2]
	at backtype.storm.daemon.task$mk_task.invoke(task.clj:189) ~[storm-core-0.=
10.2.jar:0.10.2]
	at backtype.storm.daemon.executor$mk_executor$fn__5575.invoke(executor.clj=
:352) ~[storm-core-0.10.2.jar:0.10.2]
[/cut]

I&= #39;m not sure if this has something to do with Streamparse or is just a Storm issue. I've done some debug and seems to happen when Clojure run= s a eval to evaluate a Java object, probably my Java Spout, but I haven'= t be able to determine way it fails to evaluate. Anyway, I'm running=20 with:

Storm version: 0.10.2
Streamparse 3.4.0
Java JRE 1.8.0_121

Any help is much appreciated. Thanks a lot for great work with Storm!

--001a11410c02d6e36a05481c4191--