spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Sean Owen <so...@cloudera.com>
Subject Re: ZeroMQ Stream -> stack guard problem and no data
Date Wed, 04 Jun 2014 09:40:08 GMT
It's complaining about the native library shipped with ZeroMQ, right?
That message is the JVM complaining about how it was compiled. If so,
I think it's a question for ZeroMQ?

On Wed, Jun 4, 2014 at 7:10 AM, Tobias Pfeiffer <tgp@preferred.jp> wrote:
> Hi,
>
> I am trying to use Spark Streaming (1.0.0) with ZeroMQ, i.e. I say
>
>     def bytesToStringIterator(x: Seq[ByteString]) =
> (x.map(_.utf8String)).iterator
>     val lines: DStream[String] =
>       ZeroMQUtils.createStream(ssc,
>         "tcp://localhost:5556",
>         Subscribe("mytopic"),
>         bytesToStringIterator _)
>     lines.print()
>
> but when I start this program (in local mode), I get
>
> OpenJDK 64-Bit Server VM warning: You have loaded library
> /tmp/jna2713405829859698528.tmp which might have disabled stack guard.
> The VM will try to fix the stack guard now.
> It's highly recommended that you fix the library with 'execstack -c
> <libfile>', or link it with '-z noexecstack'.
>
> and no data is received. The ZeroMQ setup should be ok, though; the Python code
>
>     context = zmq.Context()
>     socket = context.socket(zmq.SUB)
>     socket.setsockopt(zmq.SUBSCRIBE, "mytopic")
>     socket.connect("tcp://localhost:5556")
>     while True:
>         msg = socket.recv()
>         print msg
>         time.sleep(1)
>
> works fine and prints the messages issued by the publisher.
>
> Any suggestions on what is going wrong here?
>
> Thanks
> Tobias

Mime
View raw message