spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Bowden, Chris" <chris.bow...@microfocus.com>
Subject Re: [Structured Streaming] [Kafka] How to repartition the data and distribute the processing among worker nodes
Date Sat, 21 Apr 2018 05:53:30 GMT
The primary role of a sink is storing output tuples. Consider groupByKey and map/flatMapGroupsWithState
instead.

-Chris
________________________________
From: karthikjay <aswin88us@gmail.com>
Sent: Friday, April 20, 2018 4:49:49 PM
To: user@spark.apache.org
Subject: [Structured Streaming] [Kafka] How to repartition the data and distribute the processing
among worker nodes

Any help appreciated. please find the question in the link:

https://stackoverflow.com/questions/49951022/spark-structured-streaming-with-kafka-how-to-repartition-the-data-and-distribu




--
Sent from: http://apache-spark-user-list.1001560.n3.nabble.com/

---------------------------------------------------------------------
To unsubscribe e-mail: user-unsubscribe@spark.apache.org


Mime
View raw message