spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Akhil Das <ak...@sigmoidanalytics.com>
Subject Re: Read data from SparkStreaming from Java socket.
Date Fri, 12 Dec 2014 13:54:58 GMT
socketTextStream is Socket client which will read from a TCP ServerSocket.

Thanks
Best Regards

On Fri, Dec 12, 2014 at 7:21 PM, Guillermo Ortiz <konstt2000@gmail.com>
wrote:
>
> I dont' understand what spark streaming socketTextStream is waiting...
> is it like a server so you just have to send data from a client?? or
> what's it excepting?
>
> 2014-12-12 14:19 GMT+01:00 Akhil Das <akhil@sigmoidanalytics.com>:
> > I have created a Serversocket program which you can find over here
> > https://gist.github.com/akhld/4286df9ab0677a555087 It simply listens to
> the
> > given port and when the client connects, it will send the contents of the
> > given file. I'm attaching the executable jar also, you can run the jar
> as:
> >
> > java -jar SocketBenchmark.jar student 12345 io
> >
> > Here student is the file which will be sent to the client whoever
> connects
> > on 12345, i have it tested and is working with SparkStreaming
> > (socketTextStream).
> >
> >
> > Thanks
> > Best Regards
> >
> > On Fri, Dec 12, 2014 at 6:25 PM, Guillermo Ortiz <konstt2000@gmail.com>
> > wrote:
> >>
> >> Hi,
> >>
> >> I'm a newbie with Spark,, I'm just trying to use SparkStreaming and
> >> filter some data sent with a Java Socket but it's not working... it
> >> works when I use ncat
> >>
> >> Why is it not working??
> >>
> >> My sparkcode is just this:
> >>     val sparkConf = new
> >> SparkConf().setMaster("local[2]").setAppName("Test")
> >>     val ssc = new StreamingContext(sparkConf, Seconds(5))
> >>     val lines = ssc.socketTextStream("localhost", 9999)
> >>     val errorLines = lines.filter(_.contains("hello"))
> >>     errorLines.print()
> >>
> >> I created a client socket which sends data to that port, but it could
> >> connect any address, I guess that Spark doesn't work like a
> >> serverSocket... what's the way to send data from a socket with Java to
> >> be able to read from socketTextStream??
> >>
> >> ---------------------------------------------------------------------
> >> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
> >> For additional commands, e-mail: user-help@spark.apache.org
> >>
> >
>

Mime
View raw message