spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Guillermo Ortiz <konstt2...@gmail.com>
Subject Re: Read data from SparkStreaming from Java socket.
Date Fri, 12 Dec 2014 13:51:06 GMT
I dont' understand what spark streaming socketTextStream is waiting...
is it like a server so you just have to send data from a client?? or
what's it excepting?

2014-12-12 14:19 GMT+01:00 Akhil Das <akhil@sigmoidanalytics.com>:
> I have created a Serversocket program which you can find over here
> https://gist.github.com/akhld/4286df9ab0677a555087 It simply listens to the
> given port and when the client connects, it will send the contents of the
> given file. I'm attaching the executable jar also, you can run the jar as:
>
> java -jar SocketBenchmark.jar student 12345 io
>
> Here student is the file which will be sent to the client whoever connects
> on 12345, i have it tested and is working with SparkStreaming
> (socketTextStream).
>
>
> Thanks
> Best Regards
>
> On Fri, Dec 12, 2014 at 6:25 PM, Guillermo Ortiz <konstt2000@gmail.com>
> wrote:
>>
>> Hi,
>>
>> I'm a newbie with Spark,, I'm just trying to use SparkStreaming and
>> filter some data sent with a Java Socket but it's not working... it
>> works when I use ncat
>>
>> Why is it not working??
>>
>> My sparkcode is just this:
>>     val sparkConf = new
>> SparkConf().setMaster("local[2]").setAppName("Test")
>>     val ssc = new StreamingContext(sparkConf, Seconds(5))
>>     val lines = ssc.socketTextStream("localhost", 9999)
>>     val errorLines = lines.filter(_.contains("hello"))
>>     errorLines.print()
>>
>> I created a client socket which sends data to that port, but it could
>> connect any address, I guess that Spark doesn't work like a
>> serverSocket... what's the way to send data from a socket with Java to
>> be able to read from socketTextStream??
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
>> For additional commands, e-mail: user-help@spark.apache.org
>>
>

---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org


Mime
View raw message