spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Holden Karau <hol...@pigscanfly.ca>
Subject Re: Filtering URLs from incoming Internet traffic(Stream data). feasible with spark streaming?
Date Tue, 28 Oct 2014 04:32:56 GMT
On Mon, Oct 27, 2014 at 9:15 PM, Nasir Khan <nasirkhan.online@gmail.com>
wrote:

> According to my knowledge spark streams uses mini batches for processing,
>
> Q: Is it a good idea to use my ML trained Model on a web server for
> filtering purpose to classify URLs as obscene or benin. If spark streaming
> handle data as mini batches for processing, will this increase the network
> latency?
>
If you were to block on Spark Streaming having a response this would
introduce some latency.
Probably more than you want.

>
> Q: Spark Streaming don't have python code examples on www.spark.apache.org
> ,
> Is python not supported by spark streaming?
>
Spark Streaming Python support is coming in 1.2 :)

>
>
>
> --
> View this message in context:
> http://apache-spark-user-list.1001560.n3.nabble.com/Filtering-URLs-from-incoming-Internet-traffic-Stream-data-feasible-with-spark-streaming-tp17427.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
> For additional commands, e-mail: user-help@spark.apache.org
>
>


-- 
Cell : 425-233-8271

Mime
View raw message