spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "anishsneh@yahoo.co.in" <anishs...@yahoo.co.in>
Subject Spark Streaming and Shark | Streaming Taking All CPUs
Date Mon, 19 May 2014 17:43:36 GMT
Hi All

I am new to Spark, I was trying to use Spark Streaming and Shark at the same time.

I was recieiving messages from Kafka and pushing them to HDFS after minor processing.

It was workin fine, but it was taking all the CPUs and at the same time on other terminal
i tried to access shark but it kept on waiting until i stopped listener.

on the web console it was showing all 6 CPUs were taken by Spark Streamin Listener and Shark
had zero CPU.

(I have 3 node test cluster)

Please suggest

Thanks & regards
--
Anish Sneh
http://in.linkedin.com/in/anishsneh


Mime
View raw message