spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Gaurav Agarwal <>
Subject Re: spark kafka partitioning
Date Fri, 21 Aug 2015 06:41:35 GMT
when i send the message from kafka topic having three partitions.

Spark will listen the message when i say kafkautils.createStream or
createDirectstSream have local[4]
Now i want to see if spark will create partitions when it receive
message from kafka using dstream, how and where ,prwhich method of
spark api i have to see to find out

On 8/21/15, Gaurav Agarwal <> wrote:
> Hello
> Regarding Spark Streaming and Kafka Partitioning
> When i send message on kafka topic with 3 partitions and listens on
> kafkareceiver with local value[4] . how will i come to know in Spark
> Streaming that different Dstreams are created according to partitions of
> kafka messages .
> Thanks

To unsubscribe, e-mail:
For additional commands, e-mail:

View raw message