storm-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Stig Rohde Døssing <s...@apache.org>
Subject Re: Regarding Issue with Multi-Lang in Storm While Running Python (WordCountTopology)
Date Tue, 08 Aug 2017 18:51:26 GMT
Hi Sitakant.

You are right, this doesn't work in local mode. I think you are hitting
https://issues.apache.org/jira/browse/STORM-2450, so please try upgrading
to 1.0.4 or one of the other listed fix versions. I tried it out on 1.0.4
and it works for me there.

2017-08-08 19:08 GMT+02:00 Sitakant Mishra <sitakanta.mishra@gmail.com>:

> Hi Mauro,
>
> Thank you very much for replying. I have extracted my jar and checked that
> my "*splitsentence.py*" file is in my "*resources*" directory with the
> same level as the "*org*" directory. Still it does not find the file
> while running. I run the jar from the
> *"apache-storm-1.0.3/examples/storm-starter"* directory using the
> following command in the local mode.
>
> *>>$STORM_HOME/bin/storm jar target/storm-starter-*.jar
> org.apache.storm.starter.WordCountTopology*
>
> Please let me know if that is a problem. I am also starting to doubt the
> version of storm I am using. Can you please tell me whether should I
> download a different version of storm?
>
>
> Thanks and Regards,
> Sitakanta Mishra
>
>
> On Tue, Aug 8, 2017 at 10:51 AM, Mauro Giusti <maurgi@microsoft.com>
> wrote:
>
>> Not sure about the python sample, but in general, the ShellBolt looks for
>> the files in jar, is the splitsentence.py file in the jar you are producing?
>>
>>
>>
>> HTH,
>>
>> Mauro.
>>
>>
>>
>> *From:* Sitakant Mishra [mailto:sitakanta.mishra@gmail.com]
>> *Sent:* Tuesday, August 8, 2017 9:44 AM
>> *To:* user@storm.apache.org
>> *Subject:* Re: Regarding Issue with Multi-Lang in Storm While Running
>> Python (WordCountTopology)
>>
>>
>>
>> Hi,
>>
>>
>>
>> Kindly help me with the above problem. I am new to Storm and I am badly
>> stuck with my project. Any help is greatly appreciated.
>>
>>
>>
>> Thanks and Regards,
>>
>> Sitakanta Mishra
>>
>>
>>
>> On Mon, Aug 7, 2017 at 11:02 AM, Sitakant Mishra <
>> sitakanta.mishra@gmail.com> wrote:
>>
>> Hi,
>>
>>
>>
>> I am trying to run the *WordCountTopology* in storm local mode before
>> running my own application and I am unable to run it. I am continuously
>> getting the following error. I have verified that the splitsentence.py file
>> is kept at the "*multilang/resources"* directory which is in the "
>> *examples/storm-starter"* directory.
>>
>>
>>
>> *5729 [Thread-22-split-executor[7 7]] ERROR o.a.s.util - Async loop died!*
>>
>> *java.lang.RuntimeException:
>> org.apache.storm.multilang.NoOutputException: Pipe to subprocess seems to
>> be broken! No output read.*
>>
>> *Serializer Exception:*
>>
>> *python: can't open file 'splitsentence.py': [Errno 2] No such file or
>> directory*
>>
>>
>>
>> *        at
>> org.apache.storm.utils.ShellProcess.launch(ShellProcess.java:91)
>> ~[storm-core-1.0.3.jar:1.0.3]*
>>
>> *        at org.apache.storm.task.ShellBolt.prepare(ShellBolt.java:131)
>> ~[storm-core-1.0.3.jar:1.0.3]*
>>
>> *        at
>> org.apache.storm.daemon.executor$fn__4973$fn__4986.invoke(executor.clj:791)
>> ~[storm-core-1.0.3.jar:1.0.3]*
>>
>> *        at org.apache.storm.util$async_loop$fn__557.invoke(util.clj:482)
>> [storm-core-1.0.3.jar:1.0.3]*
>>
>> *        at clojure.lang.AFn.run(AFn.java:22) [clojure-1.7.0.jar:?]*
>>
>> *        at java.lang.Thread.run(Thread.java:745) [?:1.8.0_51]*
>>
>> *5734 [Thread-30-spout-executor[9 9]] INFO  o.a.s.d.executor - Opening
>> spout spout:(9)*
>>
>> *5734 [Thread-28-split-executor[6 6]] ERROR o.a.s.util - Async loop died!*
>>
>>
>>
>> I have followed the instructions during installation and built my package
>> successfully with maven. My storm version is 1.0.3 and my python version is
>> 2.7.13. I ran the *ExclamationTopology* and some of my own code which
>> does not need multi-language support and it works like a charm.
>>
>>
>>
>> I tried putting file in different locations and changing the relative
>> path, but still it is not working. I am not able to understand why the
>> multi-lang support in storm is not working. Any help with this is greatly
>> appreciated.
>>
>>
>>
>>
>>
>>
>>
>> Thanks and Regards,
>>
>> Sitakanta Mishra
>>
>>
>>
>
>

Mime
View raw message