spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Mohit Anchlia <mohitanch...@gmail.com>
Subject Re: WordCount example
Date Fri, 27 Mar 2015 00:45:46 GMT
What's the best way to troubleshoot inside spark to see why Spark is not
connecting to nc on port 9999? I don't see any errors either.

On Thu, Mar 26, 2015 at 2:38 PM, Mohit Anchlia <mohitanchlia@gmail.com>
wrote:

> I am trying to run the word count example but for some reason it's not
> working as expected. I start "nc" server on port 9999 and then submit the
> spark job to the cluster. Spark job gets successfully submitting but I
> never see any connection from spark getting established. I also tried to
> type words on the console where "nc" is listening and waiting on the
> prompt, however I don't see any output. I also don't see any errors.
>
> Here is the conf:
>
> SparkConf conf = *new* SparkConf().setMaster(masterUrl).setAppName(
> "NetworkWordCount");
>
> JavaStreamingContext *jssc* = *new* JavaStreamingContext(conf, Durations.
> *seconds*(1));
>
> JavaReceiverInputDStream<String> lines = jssc.socketTextStream("localhost",
> 9999);
>

Mime
View raw message