spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Samya Maiti <samya.maiti2...@gmail.com>
Subject Re: Kafka + Spark streaming
Date Wed, 31 Dec 2014 08:10:47 GMT
Thanks TD.

On Wed, Dec 31, 2014 at 7:19 AM, Tathagata Das <tathagata.das1565@gmail.com>
wrote:

> 1. Of course, a single block / partition has many Kafka messages, and
> from different Kafka topics interleaved together. The message count is
> not related to the block count. Any message received within a
> particular block interval will go in the same block.
>
> 2. Yes, the receiver will be started on another worker.
>
> TD
>
>
> On Tue, Dec 30, 2014 at 2:19 PM, SamyaMaiti <samya.maiti2012@gmail.com>
> wrote:
> > Hi Experts,
> >
> > Few general Queries :
> >
> > 1. Can a single block/partition in a RDD have more than 1 kafka message?
> or
> > there will be one & only one kafka message per block? In a more broader
> way,
> > is the message count related to block in any way or its just that any
> > message received with in a particular block interval will go in the same
> > block.
> >
> > 2. If a worker goes down which runs the Receiver for Kafka, Will the
> > receiver be restarted on some other worker?
> >
> > Regards,
> > Sam
> >
> >
> >
> > --
> > View this message in context:
> http://apache-spark-user-list.1001560.n3.nabble.com/Kafka-Spark-streaming-tp20914.html
> > Sent from the Apache Spark User List mailing list archive at Nabble.com.
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
> > For additional commands, e-mail: user-help@spark.apache.org
> >
>

Mime
View raw message