storm-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Navin Ipe <navin....@searchlighthealth.com>
Subject Re:
Date Thu, 02 Jun 2016 11:16:50 GMT
I'm not aware of any other settings in any other file, Jacob. The
storm.yaml file config was sufficient for me.
http://stackoverflow.com/a/37476880
Regarding the issue you are facing, perhaps someone more experienced on
this mailing list could help you.

On Thu, Jun 2, 2016 at 11:20 AM, Jacob Johansen <johansenjuwp@gmail.com>
wrote:

> I think I may have gained more insight into the issue from when I
> submit remotely instead of on the nimbus server.
>
> Exception in thread "main" java.lang.RuntimeException:
> org.apache.storm.thrift.transport.TTransportException:
> java.net.UnknownHostException: vagrant-ubuntu-trusty-64
>
> I believe the issue is that thrift is trying to use to box name of the
> nimbus server and not the ip listed in the storm.yml file.
> Is there DNS settings that need to be configured with storm 1.0.1 that
> are not listed in the configuration and deployment?
> Jacob Johansen
>
>
> On Wed, Jun 1, 2016 at 12:50 PM, Jacob Johansen <johansenjuwp@gmail.com>
> wrote:
> > It's getting submitted correctly,
> >
> > o.a.s.d.nimbus [INFO] Setting new assignment for topology id
> > Topology-2-1464802726:
> > #org.apache.storm.daemon.common.Assignment{:master-code-dir
> > "/var/storm-local", :node->host
> > {"d49b977a-af42-4c5b-94b4-0a093260c823" "vagrant-ubuntu-trusty-64"},
> > :executor->node+port {[8 8] ["d49b977a-af42-4c5b-94b4-0a093260c823"
> > 6700], [12 12] ["d49b977a-af42-4c5b-94b4-0a093260c823" 6700], [2 2]
> > ["d49b977a-af42-4c5b-94b4-0a093260c823" 6700], [7 7]
> > ["d49b977a-af42-4c5b-94b4-0a093260c823" 6700], [22 22]
> > ["d49b977a-af42-4c5b-94b4-0a093260c823" 6700], [3 3]
> > ["d49b977a-af42-4c5b-94b4-0a093260c823" 6700], [24 24]
> > ["d49b977a-af42-4c5b-94b4-0a093260c823" 6700], [1 1]
> > ["d49b977a-af42-4c5b-94b4-0a093260c823" 6700], [18 18]
> > ["d49b977a-af42-4c5b-94b4-0a093260c823" 6700], [6 6]
> > ["d49b977a-af42-4c5b-94b4-0a093260c823" 6700], [20 20]
> > ["d49b977a-af42-4c5b-94b4-0a093260c823" 6700], [9 9]
> > ["d49b977a-af42-4c5b-94b4-0a093260c823" 6700], [23 23]
> > ["d49b977a-af42-4c5b-94b4-0a093260c823" 6700], [11 11]
> > ["d49b977a-af42-4c5b-94b4-0a093260c823" 6700], [16 16]
> > ["d49b977a-af42-4c5b-94b4-0a093260c823" 6700], [13 13]
> > ["d49b977a-af42-4c5b-94b4-0a093260c823" 6700], [19 19]
> > ["d49b977a-af42-4c5b-94b4-0a093260c823" 6700], [21 21]
> > ["d49b977a-af42-4c5b-94b4-0a093260c823" 6700], [5 5]
> > ["d49b977a-af42-4c5b-94b4-0a093260c823" 6700], [26 26]
> > ["d49b977a-af42-4c5b-94b4-0a093260c823" 6700], [10 10]
> > ["d49b977a-af42-4c5b-94b4-0a093260c823" 6700], [14 14]
> > ["d49b977a-af42-4c5b-94b4-0a093260c823" 6700], [4 4]
> > ["d49b977a-af42-4c5b-94b4-0a093260c823" 6700], [15 15]
> > ["d49b977a-af42-4c5b-94b4-0a093260c823" 6700], [25 25]
> > ["d49b977a-af42-4c5b-94b4-0a093260c823" 6700], [17 17]
> > ["d49b977a-af42-4c5b-94b4-0a093260c823" 6700]},
> > :executor->start-time-secs {[8 8] 1464802727, [12 12] 1464802727, [2
> > 2] 1464802727, [7 7] 1464802727, [22 22] 1464802727, [3 3] 1464802727,
> > [24 24] 1464802727, [1 1] 1464802727, [18 18] 1464802727, [6 6]
> > 1464802727, [20 20] 1464802727, [9 9] 1464802727, [23 23] 1464802727,
> > [11 11] 1464802727, [16 16] 1464802727, [13 13] 1464802727, [19 19]
> > 1464802727, [21 21] 1464802727, [5 5] 1464802727, [26 26] 1464802727,
> > [10 10] 1464802727, [14 14] 1464802727, [4 4] 1464802727, [15 15]
> > 1464802727, [25 25] 1464802727, [17 17] 1464802727},
> > :worker->resources {["d49b977a-af42-4c5b-94b4-0a093260c823" 6700] [0.0
> > 0.0 0.0]}}
> >
> > I can ping nimbus from the supervisor, and the port is open on nimbus.
> >
> > I am running it on vagrant though.
> > https://github.com/JacobJohansen/ansible-vagrant-storm-cluster
> >
> >
> > Jacob Johansen
> >
> >
> > On Wed, Jun 1, 2016 at 10:44 AM, Navin Ipe
> > <navin.ipe@searchlighthealth.com> wrote:
> >> Your error is "Missing topology storm code, so can't launch worker with
> >> assignment".
> >>
> >> One possibility:
> >>
> http://stackoverflow.com/questions/36654714/error-running-topology-in-production-cluster-with-apache-storm-1-0-0-topology-d
> >>
> >> Or maybe you are still running the topology on localCluster instead of
> >> StormSubmitter?
> >>
> >> On Wed, Jun 1, 2016 at 8:34 PM, Jacob Johansen <johansenjuwp@gmail.com>
> >> wrote:
> >>>
> >>> Hello all,
> >>>
> >>> I'm receiving the below error on the supervisor and was hoping someone
> >>> has seen it before.
> >>>
> >>> nimbus and zookeeper seem to be functionally correctly.
> >>>
> >>> 2016-06-01 13:43:53.180 o.a.s.d.supervisor [WARN] There was a
> >>> connection problem with nimbus. #error {
> >>>  :cause Connection refused
> >>>  :via
> >>>  [{:type java.lang.RuntimeException
> >>>    :message org.apache.storm.thrift.transport.TTransportException:
> >>> java.net.ConnectException: Connection refused
> >>>    :at [org.apache.storm.security.auth.TBackoffConnect retryNext
> >>> TBackoffConnect.java 64]}
> >>>   {:type org.apache.storm.thrift.transport.TTransportException
> >>>    :message java.net.ConnectException: Connection refused
> >>>    :at [org.apache.storm.thrift.transport.TSocket open TSocket.java
> 226]}
> >>>   {:type java.net.ConnectException
> >>>    :message Connection refused
> >>>    :at [java.net.PlainSocketImpl socketConnect PlainSocketImpl.java
> -2]}]
> >>>  :trace
> >>>  [[java.net.PlainSocketImpl socketConnect PlainSocketImpl.java -2]
> >>>   [java.net.AbstractPlainSocketImpl doConnect
> AbstractPlainSocketImpl.java
> >>> 350]
> >>>   [java.net.AbstractPlainSocketImpl connectToAddress
> >>> AbstractPlainSocketImpl.java 206]
> >>>   [java.net.AbstractPlainSocketImpl connect
> AbstractPlainSocketImpl.java
> >>> 188]
> >>>   [java.net.SocksSocketImpl connect SocksSocketImpl.java 392]
> >>>   [java.net.Socket connect Socket.java 589]
> >>>   [org.apache.storm.thrift.transport.TSocket open TSocket.java 221]
> >>>   [org.apache.storm.thrift.transport.TFramedTransport open
> >>> TFramedTransport.java 81]
> >>>   [org.apache.storm.security.auth.SimpleTransportPlugin connect
> >>> SimpleTransportPlugin.java 103]
> >>>   [org.apache.storm.security.auth.TBackoffConnect doConnectWithRetry
> >>> TBackoffConnect.java 53]
> >>>   [org.apache.storm.security.auth.ThriftClient reconnect
> ThriftClient.java
> >>> 99]
> >>>   [org.apache.storm.security.auth.ThriftClient <init> ThriftClient.java
> >>> 69]
> >>>   [org.apache.storm.utils.NimbusClient <init> NimbusClient.java 106]
> >>>   [org.apache.storm.utils.NimbusClient getConfiguredClientAs
> >>> NimbusClient.java 78]
> >>>   [org.apache.storm.utils.NimbusClient getConfiguredClient
> >>> NimbusClient.java 41]
> >>>   [org.apache.storm.blobstore.NimbusBlobStore prepare
> NimbusBlobStore.java
> >>> 268]
> >>>   [org.apache.storm.utils.Utils getClientBlobStoreForSupervisor
> Utils.java
> >>> 462]
> >>>   [org.apache.storm.daemon.supervisor$fn__9317 invoke supervisor.clj
> 942]
> >>>   [clojure.lang.MultiFn invoke MultiFn.java 243]
> >>>
> >>>
> [org.apache.storm.daemon.supervisor$mk_synchronize_supervisor$this__9078$fn__9096
> >>> invoke supervisor.clj 582]
> >>>
>  [org.apache.storm.daemon.supervisor$mk_synchronize_supervisor$this__9078
> >>> invoke supervisor.clj 581]
> >>>   [org.apache.storm.event$event_manager$fn__8630 invoke event.clj 40]
> >>>   [clojure.lang.AFn run AFn.java 22]
> >>>   [java.lang.Thread run Thread.java 745]]}
> >>> 2016-06-01 13:43:53.180 o.a.s.d.supervisor [INFO] Finished downloading
> >>> code for storm id Topology-1-1464756639
> >>> 2016-06-01 13:43:53.182 o.a.s.d.supervisor [INFO] Missing topology
> >>> storm code, so can't launch worker with assignment {:storm-id
> >>> "Topology-1-1464756639", :executors [[8 8] [12 12] [2 2] [7 7] [22 22]
> >>> [3 3] [24 24] [1 1] [18 18] [6 6] [20 20] [9 9] [23 23] [11 11] [16
> >>> 16] [13 13] [19 19] [21 21] [5 5] [26 26] [10 10] [14 14] [4 4] [15
> >>> 15] [25 25] [17 17]], :resources
> >>> #object[org.apache.storm.generated.WorkerResources 0x3a5fc40f
> >>> "WorkerResources(mem_on_heap:0.0, mem_off_heap:0.0, cpu:0.0)"]} for
> >>> this supervisor 6a5859f1-29d3-4b2e-9426-220b6111b242 on port 6700 with
> >>> id 3895364d-ebee-43d4-b96a-3bb4ed0575b6
> >>>
> >>> thanks
> >>>
> >>> Jacob Johansen
> >>
> >>
> >>
> >>
> >> --
> >> Regards,
> >> Navin
>



-- 
Regards,
Navin

Mime
View raw message