spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From RK <prk...@yahoo.com.INVALID>
Subject Incorrect information in the UI about data received by KafkaReceiver???
Date Thu, 01 Jan 2015 19:26:04 GMT
I have a job running with kafkaReceiverCount set to 1 and numThreads set to 1.
    val kafkaDStreams = (1 to kafkaReceiverCount.toInt).map { _ =>      KafkaUtils.createStream(ssc,
zkQuorum, group, Map(topic -> numThreads.toInt)).map(_._2)    }

In the spark stages page, I see different stages reading and writing data.


However, in the streaming information page it says that the KafkaReceiver is not getting any
records.


Why is this discrepancy happening?
Thanks,RK





Mime
View raw message