spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jianneng Li <>
Subject Record-at-a-time model for Spark Streaming
Date Tue, 07 Oct 2014 23:44:58 GMT

I understand that Spark Streaming uses micro-batches to implement
streaming, while traditional streaming systems use the record-at-a-time
processing model. The performance benefit of the former is throughput, and
the latter is latency. I'm wondering what it would take to implement
record-at-a-time for Spark Streaming? Would it be something that is
feasible to prototype in one or two months?



View this message in context:
Sent from the Apache Spark User List mailing list archive at
View raw message