spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Akhil Das <ak...@sigmoidanalytics.com>
Subject Re: About FlumeUtils.createStream
Date Sat, 21 Feb 2015 08:17:07 GMT
Spark won't listen on 9999 mate, It basically means you have a flume source
running at port 9999 of your localhost. And when you submit your
application in standalone mode, workers will consume date from that port.

Thanks
Best Regards

On Sat, Feb 21, 2015 at 9:22 AM, bit1129@163.com <bit1129@163.com> wrote:

>
> Hi,
> In the spark streaming application, I write the code, FlumeUtils.createStream(ssc,"localhost",9999),which
> means spark will listen on the 9999 port, and wait for Flume Sink to write
> to it.
> My question is:  when I submit the application to the Spark Standalone
> cluster, will 9999 be opened only on the Driver Machine or all the workers
> will also open the 9999 port and wait for the Flume data?
>
> ------------------------------
>
>

Mime
View raw message