spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Tathagata Das <tathagata.das1...@gmail.com>
Subject Re: Receiver Fault Tolerance
Date Wed, 06 May 2015 12:12:12 GMT
Incorrect. The receiver runs in an executor just like a any other tasks. In
the cluster mode, the driver runs in a worker, however it launches
executors in OTHER workers in the cluster. Its those executors running in
other workers that run tasks, and also the receivers.

On Wed, May 6, 2015 at 5:09 AM, James King <jakwebinbox@gmail.com> wrote:

> In the O'reilly book Learning Spark Chapter 10 section 24/7 Operation
>
> It talks about 'Receiver Fault Tolerance'
>
> I'm unsure of what a Receiver is here, from reading it sounds like when
> you submit an application to the cluster in cluster mode i.e. *--deploy-mode
> cluster *the driver program will run on a Worker and this case this
> Worker is seen as a Receiver because it is consuming messages from the
> source.
>
>
> Is the above understanding correct? or is there more to it?
>
>
>

Mime
View raw message