spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From tnegi <>
Subject Number of Spark streams in Yarn cluster
Date Wed, 11 Jun 2014 07:59:05 GMT

I am trying to get a sense of number of streams we can process in parallel
on a Spark streaming cluster(Hadoop Yarn).
Is there any benchmark for the same? 
We need a large number of streams(original + transformed) to be processed in
The number is approximately around= 30,0000.


View this message in context:
Sent from the Apache Spark User List mailing list archive at

View raw message