spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From nilmish <>
Subject Re: Problem in Spark Streaming
Date Tue, 10 Jun 2014 13:40:35 GMT
How can I measure data rate/node ?

I am feeding the data through kafka API. I only know the total inflow data
rate which almost remains constant . How can I figure out what amount of
data is distributed to the nodes in my cluster ? 

Latency does not keep on increasing infinetly. It goes up for some instant
and then it drops down again to the normal level. I want to get away with
these spikes in between. 

View this message in context:
Sent from the Apache Spark User List mailing list archive at

View raw message