storm-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jacob Johansen <johansenj...@gmail.com>
Subject Re:
Date Wed, 01 Jun 2016 17:50:16 GMT
It's getting submitted correctly,

o.a.s.d.nimbus [INFO] Setting new assignment for topology id
Topology-2-1464802726:
#org.apache.storm.daemon.common.Assignment{:master-code-dir
"/var/storm-local", :node->host
{"d49b977a-af42-4c5b-94b4-0a093260c823" "vagrant-ubuntu-trusty-64"},
:executor->node+port {[8 8] ["d49b977a-af42-4c5b-94b4-0a093260c823"
6700], [12 12] ["d49b977a-af42-4c5b-94b4-0a093260c823" 6700], [2 2]
["d49b977a-af42-4c5b-94b4-0a093260c823" 6700], [7 7]
["d49b977a-af42-4c5b-94b4-0a093260c823" 6700], [22 22]
["d49b977a-af42-4c5b-94b4-0a093260c823" 6700], [3 3]
["d49b977a-af42-4c5b-94b4-0a093260c823" 6700], [24 24]
["d49b977a-af42-4c5b-94b4-0a093260c823" 6700], [1 1]
["d49b977a-af42-4c5b-94b4-0a093260c823" 6700], [18 18]
["d49b977a-af42-4c5b-94b4-0a093260c823" 6700], [6 6]
["d49b977a-af42-4c5b-94b4-0a093260c823" 6700], [20 20]
["d49b977a-af42-4c5b-94b4-0a093260c823" 6700], [9 9]
["d49b977a-af42-4c5b-94b4-0a093260c823" 6700], [23 23]
["d49b977a-af42-4c5b-94b4-0a093260c823" 6700], [11 11]
["d49b977a-af42-4c5b-94b4-0a093260c823" 6700], [16 16]
["d49b977a-af42-4c5b-94b4-0a093260c823" 6700], [13 13]
["d49b977a-af42-4c5b-94b4-0a093260c823" 6700], [19 19]
["d49b977a-af42-4c5b-94b4-0a093260c823" 6700], [21 21]
["d49b977a-af42-4c5b-94b4-0a093260c823" 6700], [5 5]
["d49b977a-af42-4c5b-94b4-0a093260c823" 6700], [26 26]
["d49b977a-af42-4c5b-94b4-0a093260c823" 6700], [10 10]
["d49b977a-af42-4c5b-94b4-0a093260c823" 6700], [14 14]
["d49b977a-af42-4c5b-94b4-0a093260c823" 6700], [4 4]
["d49b977a-af42-4c5b-94b4-0a093260c823" 6700], [15 15]
["d49b977a-af42-4c5b-94b4-0a093260c823" 6700], [25 25]
["d49b977a-af42-4c5b-94b4-0a093260c823" 6700], [17 17]
["d49b977a-af42-4c5b-94b4-0a093260c823" 6700]},
:executor->start-time-secs {[8 8] 1464802727, [12 12] 1464802727, [2
2] 1464802727, [7 7] 1464802727, [22 22] 1464802727, [3 3] 1464802727,
[24 24] 1464802727, [1 1] 1464802727, [18 18] 1464802727, [6 6]
1464802727, [20 20] 1464802727, [9 9] 1464802727, [23 23] 1464802727,
[11 11] 1464802727, [16 16] 1464802727, [13 13] 1464802727, [19 19]
1464802727, [21 21] 1464802727, [5 5] 1464802727, [26 26] 1464802727,
[10 10] 1464802727, [14 14] 1464802727, [4 4] 1464802727, [15 15]
1464802727, [25 25] 1464802727, [17 17] 1464802727},
:worker->resources {["d49b977a-af42-4c5b-94b4-0a093260c823" 6700] [0.0
0.0 0.0]}}

I can ping nimbus from the supervisor, and the port is open on nimbus.

I am running it on vagrant though.
https://github.com/JacobJohansen/ansible-vagrant-storm-cluster


Jacob Johansen


On Wed, Jun 1, 2016 at 10:44 AM, Navin Ipe
<navin.ipe@searchlighthealth.com> wrote:
> Your error is "Missing topology storm code, so can't launch worker with
> assignment".
>
> One possibility:
> http://stackoverflow.com/questions/36654714/error-running-topology-in-production-cluster-with-apache-storm-1-0-0-topology-d
>
> Or maybe you are still running the topology on localCluster instead of
> StormSubmitter?
>
> On Wed, Jun 1, 2016 at 8:34 PM, Jacob Johansen <johansenjuwp@gmail.com>
> wrote:
>>
>> Hello all,
>>
>> I'm receiving the below error on the supervisor and was hoping someone
>> has seen it before.
>>
>> nimbus and zookeeper seem to be functionally correctly.
>>
>> 2016-06-01 13:43:53.180 o.a.s.d.supervisor [WARN] There was a
>> connection problem with nimbus. #error {
>>  :cause Connection refused
>>  :via
>>  [{:type java.lang.RuntimeException
>>    :message org.apache.storm.thrift.transport.TTransportException:
>> java.net.ConnectException: Connection refused
>>    :at [org.apache.storm.security.auth.TBackoffConnect retryNext
>> TBackoffConnect.java 64]}
>>   {:type org.apache.storm.thrift.transport.TTransportException
>>    :message java.net.ConnectException: Connection refused
>>    :at [org.apache.storm.thrift.transport.TSocket open TSocket.java 226]}
>>   {:type java.net.ConnectException
>>    :message Connection refused
>>    :at [java.net.PlainSocketImpl socketConnect PlainSocketImpl.java -2]}]
>>  :trace
>>  [[java.net.PlainSocketImpl socketConnect PlainSocketImpl.java -2]
>>   [java.net.AbstractPlainSocketImpl doConnect AbstractPlainSocketImpl.java
>> 350]
>>   [java.net.AbstractPlainSocketImpl connectToAddress
>> AbstractPlainSocketImpl.java 206]
>>   [java.net.AbstractPlainSocketImpl connect AbstractPlainSocketImpl.java
>> 188]
>>   [java.net.SocksSocketImpl connect SocksSocketImpl.java 392]
>>   [java.net.Socket connect Socket.java 589]
>>   [org.apache.storm.thrift.transport.TSocket open TSocket.java 221]
>>   [org.apache.storm.thrift.transport.TFramedTransport open
>> TFramedTransport.java 81]
>>   [org.apache.storm.security.auth.SimpleTransportPlugin connect
>> SimpleTransportPlugin.java 103]
>>   [org.apache.storm.security.auth.TBackoffConnect doConnectWithRetry
>> TBackoffConnect.java 53]
>>   [org.apache.storm.security.auth.ThriftClient reconnect ThriftClient.java
>> 99]
>>   [org.apache.storm.security.auth.ThriftClient <init> ThriftClient.java
>> 69]
>>   [org.apache.storm.utils.NimbusClient <init> NimbusClient.java 106]
>>   [org.apache.storm.utils.NimbusClient getConfiguredClientAs
>> NimbusClient.java 78]
>>   [org.apache.storm.utils.NimbusClient getConfiguredClient
>> NimbusClient.java 41]
>>   [org.apache.storm.blobstore.NimbusBlobStore prepare NimbusBlobStore.java
>> 268]
>>   [org.apache.storm.utils.Utils getClientBlobStoreForSupervisor Utils.java
>> 462]
>>   [org.apache.storm.daemon.supervisor$fn__9317 invoke supervisor.clj 942]
>>   [clojure.lang.MultiFn invoke MultiFn.java 243]
>>
>> [org.apache.storm.daemon.supervisor$mk_synchronize_supervisor$this__9078$fn__9096
>> invoke supervisor.clj 582]
>>   [org.apache.storm.daemon.supervisor$mk_synchronize_supervisor$this__9078
>> invoke supervisor.clj 581]
>>   [org.apache.storm.event$event_manager$fn__8630 invoke event.clj 40]
>>   [clojure.lang.AFn run AFn.java 22]
>>   [java.lang.Thread run Thread.java 745]]}
>> 2016-06-01 13:43:53.180 o.a.s.d.supervisor [INFO] Finished downloading
>> code for storm id Topology-1-1464756639
>> 2016-06-01 13:43:53.182 o.a.s.d.supervisor [INFO] Missing topology
>> storm code, so can't launch worker with assignment {:storm-id
>> "Topology-1-1464756639", :executors [[8 8] [12 12] [2 2] [7 7] [22 22]
>> [3 3] [24 24] [1 1] [18 18] [6 6] [20 20] [9 9] [23 23] [11 11] [16
>> 16] [13 13] [19 19] [21 21] [5 5] [26 26] [10 10] [14 14] [4 4] [15
>> 15] [25 25] [17 17]], :resources
>> #object[org.apache.storm.generated.WorkerResources 0x3a5fc40f
>> "WorkerResources(mem_on_heap:0.0, mem_off_heap:0.0, cpu:0.0)"]} for
>> this supervisor 6a5859f1-29d3-4b2e-9426-220b6111b242 on port 6700 with
>> id 3895364d-ebee-43d4-b96a-3bb4ed0575b6
>>
>> thanks
>>
>> Jacob Johansen
>
>
>
>
> --
> Regards,
> Navin

Mime
View raw message