storm-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jacob Johansen <johansenj...@gmail.com>
Subject Re:
Date Thu, 02 Jun 2016 05:50:31 GMT
I think I may have gained more insight into the issue from when I
submit remotely instead of on the nimbus server.

Exception in thread "main" java.lang.RuntimeException:
org.apache.storm.thrift.transport.TTransportException:
java.net.UnknownHostException: vagrant-ubuntu-trusty-64

I believe the issue is that thrift is trying to use to box name of the
nimbus server and not the ip listed in the storm.yml file.
Is there DNS settings that need to be configured with storm 1.0.1 that
are not listed in the configuration and deployment?
Jacob Johansen


On Wed, Jun 1, 2016 at 12:50 PM, Jacob Johansen <johansenjuwp@gmail.com> wrote:
> It's getting submitted correctly,
>
> o.a.s.d.nimbus [INFO] Setting new assignment for topology id
> Topology-2-1464802726:
> #org.apache.storm.daemon.common.Assignment{:master-code-dir
> "/var/storm-local", :node->host
> {"d49b977a-af42-4c5b-94b4-0a093260c823" "vagrant-ubuntu-trusty-64"},
> :executor->node+port {[8 8] ["d49b977a-af42-4c5b-94b4-0a093260c823"
> 6700], [12 12] ["d49b977a-af42-4c5b-94b4-0a093260c823" 6700], [2 2]
> ["d49b977a-af42-4c5b-94b4-0a093260c823" 6700], [7 7]
> ["d49b977a-af42-4c5b-94b4-0a093260c823" 6700], [22 22]
> ["d49b977a-af42-4c5b-94b4-0a093260c823" 6700], [3 3]
> ["d49b977a-af42-4c5b-94b4-0a093260c823" 6700], [24 24]
> ["d49b977a-af42-4c5b-94b4-0a093260c823" 6700], [1 1]
> ["d49b977a-af42-4c5b-94b4-0a093260c823" 6700], [18 18]
> ["d49b977a-af42-4c5b-94b4-0a093260c823" 6700], [6 6]
> ["d49b977a-af42-4c5b-94b4-0a093260c823" 6700], [20 20]
> ["d49b977a-af42-4c5b-94b4-0a093260c823" 6700], [9 9]
> ["d49b977a-af42-4c5b-94b4-0a093260c823" 6700], [23 23]
> ["d49b977a-af42-4c5b-94b4-0a093260c823" 6700], [11 11]
> ["d49b977a-af42-4c5b-94b4-0a093260c823" 6700], [16 16]
> ["d49b977a-af42-4c5b-94b4-0a093260c823" 6700], [13 13]
> ["d49b977a-af42-4c5b-94b4-0a093260c823" 6700], [19 19]
> ["d49b977a-af42-4c5b-94b4-0a093260c823" 6700], [21 21]
> ["d49b977a-af42-4c5b-94b4-0a093260c823" 6700], [5 5]
> ["d49b977a-af42-4c5b-94b4-0a093260c823" 6700], [26 26]
> ["d49b977a-af42-4c5b-94b4-0a093260c823" 6700], [10 10]
> ["d49b977a-af42-4c5b-94b4-0a093260c823" 6700], [14 14]
> ["d49b977a-af42-4c5b-94b4-0a093260c823" 6700], [4 4]
> ["d49b977a-af42-4c5b-94b4-0a093260c823" 6700], [15 15]
> ["d49b977a-af42-4c5b-94b4-0a093260c823" 6700], [25 25]
> ["d49b977a-af42-4c5b-94b4-0a093260c823" 6700], [17 17]
> ["d49b977a-af42-4c5b-94b4-0a093260c823" 6700]},
> :executor->start-time-secs {[8 8] 1464802727, [12 12] 1464802727, [2
> 2] 1464802727, [7 7] 1464802727, [22 22] 1464802727, [3 3] 1464802727,
> [24 24] 1464802727, [1 1] 1464802727, [18 18] 1464802727, [6 6]
> 1464802727, [20 20] 1464802727, [9 9] 1464802727, [23 23] 1464802727,
> [11 11] 1464802727, [16 16] 1464802727, [13 13] 1464802727, [19 19]
> 1464802727, [21 21] 1464802727, [5 5] 1464802727, [26 26] 1464802727,
> [10 10] 1464802727, [14 14] 1464802727, [4 4] 1464802727, [15 15]
> 1464802727, [25 25] 1464802727, [17 17] 1464802727},
> :worker->resources {["d49b977a-af42-4c5b-94b4-0a093260c823" 6700] [0.0
> 0.0 0.0]}}
>
> I can ping nimbus from the supervisor, and the port is open on nimbus.
>
> I am running it on vagrant though.
> https://github.com/JacobJohansen/ansible-vagrant-storm-cluster
>
>
> Jacob Johansen
>
>
> On Wed, Jun 1, 2016 at 10:44 AM, Navin Ipe
> <navin.ipe@searchlighthealth.com> wrote:
>> Your error is "Missing topology storm code, so can't launch worker with
>> assignment".
>>
>> One possibility:
>> http://stackoverflow.com/questions/36654714/error-running-topology-in-production-cluster-with-apache-storm-1-0-0-topology-d
>>
>> Or maybe you are still running the topology on localCluster instead of
>> StormSubmitter?
>>
>> On Wed, Jun 1, 2016 at 8:34 PM, Jacob Johansen <johansenjuwp@gmail.com>
>> wrote:
>>>
>>> Hello all,
>>>
>>> I'm receiving the below error on the supervisor and was hoping someone
>>> has seen it before.
>>>
>>> nimbus and zookeeper seem to be functionally correctly.
>>>
>>> 2016-06-01 13:43:53.180 o.a.s.d.supervisor [WARN] There was a
>>> connection problem with nimbus. #error {
>>>  :cause Connection refused
>>>  :via
>>>  [{:type java.lang.RuntimeException
>>>    :message org.apache.storm.thrift.transport.TTransportException:
>>> java.net.ConnectException: Connection refused
>>>    :at [org.apache.storm.security.auth.TBackoffConnect retryNext
>>> TBackoffConnect.java 64]}
>>>   {:type org.apache.storm.thrift.transport.TTransportException
>>>    :message java.net.ConnectException: Connection refused
>>>    :at [org.apache.storm.thrift.transport.TSocket open TSocket.java 226]}
>>>   {:type java.net.ConnectException
>>>    :message Connection refused
>>>    :at [java.net.PlainSocketImpl socketConnect PlainSocketImpl.java -2]}]
>>>  :trace
>>>  [[java.net.PlainSocketImpl socketConnect PlainSocketImpl.java -2]
>>>   [java.net.AbstractPlainSocketImpl doConnect AbstractPlainSocketImpl.java
>>> 350]
>>>   [java.net.AbstractPlainSocketImpl connectToAddress
>>> AbstractPlainSocketImpl.java 206]
>>>   [java.net.AbstractPlainSocketImpl connect AbstractPlainSocketImpl.java
>>> 188]
>>>   [java.net.SocksSocketImpl connect SocksSocketImpl.java 392]
>>>   [java.net.Socket connect Socket.java 589]
>>>   [org.apache.storm.thrift.transport.TSocket open TSocket.java 221]
>>>   [org.apache.storm.thrift.transport.TFramedTransport open
>>> TFramedTransport.java 81]
>>>   [org.apache.storm.security.auth.SimpleTransportPlugin connect
>>> SimpleTransportPlugin.java 103]
>>>   [org.apache.storm.security.auth.TBackoffConnect doConnectWithRetry
>>> TBackoffConnect.java 53]
>>>   [org.apache.storm.security.auth.ThriftClient reconnect ThriftClient.java
>>> 99]
>>>   [org.apache.storm.security.auth.ThriftClient <init> ThriftClient.java
>>> 69]
>>>   [org.apache.storm.utils.NimbusClient <init> NimbusClient.java 106]
>>>   [org.apache.storm.utils.NimbusClient getConfiguredClientAs
>>> NimbusClient.java 78]
>>>   [org.apache.storm.utils.NimbusClient getConfiguredClient
>>> NimbusClient.java 41]
>>>   [org.apache.storm.blobstore.NimbusBlobStore prepare NimbusBlobStore.java
>>> 268]
>>>   [org.apache.storm.utils.Utils getClientBlobStoreForSupervisor Utils.java
>>> 462]
>>>   [org.apache.storm.daemon.supervisor$fn__9317 invoke supervisor.clj 942]
>>>   [clojure.lang.MultiFn invoke MultiFn.java 243]
>>>
>>> [org.apache.storm.daemon.supervisor$mk_synchronize_supervisor$this__9078$fn__9096
>>> invoke supervisor.clj 582]
>>>   [org.apache.storm.daemon.supervisor$mk_synchronize_supervisor$this__9078
>>> invoke supervisor.clj 581]
>>>   [org.apache.storm.event$event_manager$fn__8630 invoke event.clj 40]
>>>   [clojure.lang.AFn run AFn.java 22]
>>>   [java.lang.Thread run Thread.java 745]]}
>>> 2016-06-01 13:43:53.180 o.a.s.d.supervisor [INFO] Finished downloading
>>> code for storm id Topology-1-1464756639
>>> 2016-06-01 13:43:53.182 o.a.s.d.supervisor [INFO] Missing topology
>>> storm code, so can't launch worker with assignment {:storm-id
>>> "Topology-1-1464756639", :executors [[8 8] [12 12] [2 2] [7 7] [22 22]
>>> [3 3] [24 24] [1 1] [18 18] [6 6] [20 20] [9 9] [23 23] [11 11] [16
>>> 16] [13 13] [19 19] [21 21] [5 5] [26 26] [10 10] [14 14] [4 4] [15
>>> 15] [25 25] [17 17]], :resources
>>> #object[org.apache.storm.generated.WorkerResources 0x3a5fc40f
>>> "WorkerResources(mem_on_heap:0.0, mem_off_heap:0.0, cpu:0.0)"]} for
>>> this supervisor 6a5859f1-29d3-4b2e-9426-220b6111b242 on port 6700 with
>>> id 3895364d-ebee-43d4-b96a-3bb4ed0575b6
>>>
>>> thanks
>>>
>>> Jacob Johansen
>>
>>
>>
>>
>> --
>> Regards,
>> Navin

Mime
View raw message