storm-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "P. Taylor Goetz" <ptgo...@gmail.com>
Subject Re: Nimbus setting java.class.path to include javaagent
Date Wed, 05 Oct 2016 19:33:47 GMT
What your seeing is the ZooKeeper client running within Nimbus/Supervisor just printing out
it’s class path, which it inherits from Storm’s class path. It’s not really sending
that to ZooKeeper.

What’s weird is that the agent jar sneaking onto the class path.

On your supervisor node, can you run `storm classpath` and see what it prints?

-Taylor


> On Oct 5, 2016, at 1:17 PM, Brad Rhodes <bradrhod@hotmail.com> wrote:
> 
> Storm 0.9.6.  We are working on moving to 1.0.2 as we speak.
> 
> nimbus.childopts: "-Xmx1024m -DjmxRegistryPort=1098 -DjmxServerPort=1099 -javaagent:/opt/monitoring_agent/bobbrad.jar
-agentlib:jdwp=transport=dt_socket,server=y,address=8100,suspend=
> y -Dmonitoring.agent.properties=/opt/monitoring_agent/monitoring.properties -Dapplication.name=storm.test.lodgingamenity.nimbus
<http://dapplication.name%3dstorm.test.lodgingamenity.nimbus/>"
> 
> 
> supervisor.childopts: "-Xmx256m -DjmxRegistryPort=1098 -DjmxServerPort=1099 -javaagent:/opt/monitoring_agent/bobbrad2.jar
-Dmonitoring.agent.properties=/opt/monitoring_agent/monitoring
> .properties -Dapplication.name=storm.test.lodgingamenity.supervisor <http://dapplication.name%3dstorm.test.lodgingamenity.supervisor/>"
> 
> 
> worker.childopts: "-Xmx1024m -Dmonitoring.agent.properties=/opt/monitoring_agent/monitoring.properties
-Dapplication.name=storm.test.lodgingamenity.worker.%ID% <http://dapplication.name%3dstorm.test.lodgingamenity.worker.%25id%25/>"
> 
> 
> From: P. Taylor Goetz [mailto:ptgoetz@gmail.com]
> Sent: Tuesday, October 4, 2016 9:46 AM
> To: user@storm.apache.org
> Subject: Re: Nimbus setting java.class.path to include javaagent
> 
> Can you post your values for nimbus.childopts, supervisor.childopts, and worker.childopts?
Also what version of Storm are you on?
> 
> -Taylor
> 
>> On Sep 28, 2016, at 6:06 PM, Brad Rhodes <bradrhod@hotmail.com <mailto:bradrhod@hotmail.com>>
wrote:
>> 
>> I have a situation where we have a javaagent jar file.  Someone has added a number
of classes to the corporate standard javaagent jar file.  Nimbus appears to append -javaagent
jar files to the -cp (claspath) for the supervisor process.
>> 
>> When Nimbus starts up java is started with a command like:
>> 
>> /usr/java/latest/bin/java -server -Dstorm.options= -Dstorm.home=/opt/storm -Dstorm.log.dir=/opt/storm/logs
-Djava.library.path=/usr/local/lib:/opt/local/lib:/usr/lib -Dstorm.conf.file= -cp /opt/storm/lib/hiccup-0.3.6.jar:/opt/storm/lib/clj-stacktrace-0.2.2.jar:/opt/storm/lib/clj-time-0.4.1.jar:/opt/storm/lib/tools.macro-0.1.0.jar:/opt/storm/lib/commons-exec-1.1.jar:/opt/storm/lib/minlog-1.2.jar:/opt/storm/lib/joda-time-2.0.jar:/opt/storm/lib/ring-devel-0.3.11.jar:/opt/storm/lib/tools.cli-0.2.4.jar:/opt/storm/lib/logback-core-1.0.13.jar:/opt/storm/lib/tools.logging-0.2.3.jar:/opt/storm/lib/jline-2.11.jar:/opt/storm/lib/math.numeric-tower-0.0.1.jar:/opt/storm/lib/chill-java-0.3.5.jar:/opt/storm/lib/objenesis-1.2.jar:/opt/storm/lib/compojure-1.1.3.jar:/opt/storm/lib/clojure-1.5.1.jar:/opt/storm/lib/commons-codec-1.6.jar:/opt/storm/lib/commons-io-2.4.jar:/opt/storm/lib/clout-1.0.1.jar:/opt/storm/lib/log4j-over-slf4j-1.6.6.jar:/opt/storm/lib/commons-fileupload-1.2.1.jar:/opt/storm/lib/servlet-api-2.5.jar:/opt/storm/lib/reflectasm-1.07-shaded.jar:/opt/storm/lib/storm-core-0.9.6.jar:/opt/storm/lib/jgrapht-core-0.9.0.jar:/opt/storm/lib/ring-servlet-0.3.11.jar:/opt/storm/lib/core.incubator-0.1.0.jar:/opt/storm/lib/snakeyaml-1.11.jar:/opt/storm/lib/disruptor-2.10.4.jar:/opt/storm/lib/commons-lang-2.5.jar:/opt/storm/lib/carbonite-1.4.0.jar:/opt/storm/lib/ring-jetty-adapter-0.3.11.jar:/opt/storm/lib/asm-4.0.jar:/opt/storm/lib/jetty-6.1.26.jar:/opt/storm/lib/commons-logging-1.1.3.jar:/opt/storm/lib/json-simple-1.1.jar:/opt/storm/lib/slf4j-api-1.7.5.jar:/opt/storm/lib/logback-classic-1.0.13.jar:/opt/storm/lib/jetty-util-6.1.26.jar:/opt/storm/lib/kryo-2.21.jar:/opt/storm/lib/ring-core-1.1.5.jar:/opt/storm/conf
-Xmx1024m -DjmxRegistryPort=1098 -DjmxServerPort=1099 -javaagent:/opt/monitoring_agent/bobbrad.jar
-agentlib:jdwp=transport=dt_socket,server=y,address=8100,suspend=y -Dmonitoring.agent.properties=/opt/monitoring_agent/monitoring.properties
-Dapplication.name=storm.test.lodgingamenity.nimbus -Dlogfile.name=nimbus.log -Dlogback.configurationFile=/opt/storm/logback/cluster.xml
backtype.storm.daemon.nimbus
>> 
>> Nimbus at some point sends the following to Zookeeper:
>> 016-09-28T18:50:45.627+0000 o.a.s.z.ZooKeeper [INFO] Client environment:java.class.path=/opt/storm/lib/hiccup-0.3.6.jar:/opt/storm/lib/clj-stacktrace-0.2.2.jar:/opt/storm/lib/clj-time-0.4.1.jar:/opt/storm/lib/tools.macro-0.1.0.jar:/opt/storm/lib/commons-exec-1.1.jar:/opt/storm/lib/minlog-1.2.jar:/opt/storm/lib/joda-time-2.0.jar:/opt/storm/lib/ring-devel-0.3.11.jar:/opt/storm/lib/tools.cli-0.2.4.jar:/opt/storm/lib/logback-core-1.0.13.jar:/opt/storm/lib/tools.logging-0.2.3.jar:/opt/storm/lib/jline-2.11.jar:/opt/storm/lib/math.numeric-tower-0.0.1.jar:/opt/storm/lib/chill-java-0.3.5.jar:/opt/storm/lib/objenesis-1.2.jar:/opt/storm/lib/compojure-1.1.3.jar:/opt/storm/lib/clojure-1.5.1.jar:/opt/storm/lib/commons-codec-1.6.jar:/opt/storm/lib/commons-io-2.4.jar:/opt/storm/lib/clout-1.0.1.jar:/opt/storm/lib/log4j-over-slf4j-1.6.6.jar:/opt/storm/lib/commons-fileupload-1.2.1.jar:/opt/storm/lib/servlet-api-2.5.jar:/opt/storm/lib/reflectasm-1.07-shaded.jar:/opt/storm/lib/storm-core-0.9.6.jar:/opt/storm/lib/jgrapht-core-0.9.0.jar:/opt/storm/lib/ring-servlet-0.3.11.jar:/opt/storm/lib/core.incubator-0.1.0.jar:/opt/storm/lib/snakeyaml-1.11.jar:/opt/storm/lib/disruptor-2.10.4.jar:/opt/storm/lib/commons-lang-2.5.jar:/opt/storm/lib/carbonite-1.4.0.jar:/opt/storm/lib/ring-jetty-adapter-0.3.11.jar:/opt/storm/lib/asm-4.0.jar:/opt/storm/lib/jetty-6.1.26.jar:/opt/storm/lib/commons-logging-1.1.3.jar:/opt/storm/lib/json-simple-1.1.jar:/opt/storm/lib/slf4j-api-1.7.5.jar:/opt/storm/lib/logback-classic-1.0.13.jar:/opt/storm/lib/jetty-util-6.1.26.jar:/opt/storm/lib/kryo-2.21.jar:/opt/storm/lib/ring-core-1.1.5.jar:/opt/storm/conf:/opt/monitoring_agent/bobbrad.jar
>> 
>> and
>> Server environment:java.class.path=/opt/storm/lib/hiccup-0.3.6.jar:/opt/storm/lib/clj-stacktrace-0.2.2.jar:/opt/storm/lib/clj-time-0.4.1.jar:/opt/storm/lib/tools.macro-0.1.0.jar:/opt/storm/lib/commons-exec-1.1.jar:/opt/storm/lib/minlog-1.2.jar:/opt/storm/lib/joda-time-2.0.jar:/opt/storm/lib/ring-devel-0.3.11.jar:/opt/storm/lib/tools.cli-0.2.4.jar:/opt/storm/lib/logback-core-1.0.13.jar:/opt/storm/lib/tools.logging-0.2.3.jar:/opt/storm/lib/jline-2.11.jar:/opt/storm/lib/math.numeric-tower-0.0.1.jar:/opt/storm/lib/chill-java-0.3.5.jar:/opt/storm/lib/objenesis-1.2.jar:/opt/storm/lib/compojure-1.1.3.jar:/opt/storm/lib/clojure-1.5.1.jar:/opt/storm/lib/commons-codec-1.6.jar:/opt/storm/lib/commons-io-2.4.jar:/opt/storm/lib/clout-1.0.1.jar:/opt/storm/lib/log4j-over-slf4j-1.6.6.jar:/opt/storm/lib/commons-fileupload-1.2.1.jar:/opt/storm/lib/servlet-api-2.5.jar:/opt/storm/lib/reflectasm-1.07-shaded.jar:/opt/storm/lib/storm-core-0.9.6.jar:/opt/storm/lib/jgrapht-core-0.9.0.jar:/opt/storm/lib/ring-servlet-0.3.11.jar:/opt/storm/lib/core.incubator-0.1.0.jar:/opt/storm/lib/snakeyaml-1.11.jar:/opt/storm/lib/disruptor-2.10.4.jar:/opt/storm/lib/commons-lang-2.5.jar:/opt/storm/lib/carbonite-1.4.0.jar:/opt/storm/lib/ring-jetty-adapter-0.3.11.jar:/opt/storm/lib/asm-4.0.jar:/opt/storm/lib/jetty-6.1.26.jar:/opt/storm/lib/commons-logging-1.1.3.jar:/opt/storm/lib/json-simple-1.1.jar:/opt/storm/lib/slf4j-api-1.7.5.jar:/opt/storm/lib/logback-classic-1.0.13.jar:/opt/storm/lib/jetty-util-6.1.26.jar:/opt/storm/lib/kryo-2.21.jar:/opt/storm/lib/ring-core-1.1.5.jar:/opt/storm/conf:/opt/monitoring_agent/bobbrad.jar
>> 
>> When the supervisor starts up you will see bobbrad.jar in the classpath.
>> 
>> I see the code in supervisor.clj
>> (defn resources-jar []
>>   (->> (.split (current-classpath) File/pathSeparator)
>>        (filter #(.endsWith  % ".jar"))
>>        (filter #(zip-contains-dir? % RESOURCES-SUBDIR))
>>        first ))
>> It does not seem this code is the source of this running with zookeeper cluster.
 Suprivisor is applying what comes down from Zookeeper java.classpath.
>> Can someone point me to where that is happening in a cluster environment.?
>> Thanks for any help.
> 
> 


Mime
View raw message