spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From James King <jakwebin...@gmail.com>
Subject Re: Receiver Fault Tolerance
Date Wed, 06 May 2015 12:16:37 GMT
Many thanks all, your responses have been very helpful. Cheers

On Wed, May 6, 2015 at 2:14 PM, ayan guha <guha.ayan@gmail.com> wrote:

>
> https://spark.apache.org/docs/latest/streaming-programming-guide.html#fault-tolerance-semantics
>
>
> On Wed, May 6, 2015 at 10:09 PM, James King <jakwebinbox@gmail.com> wrote:
>
>> In the O'reilly book Learning Spark Chapter 10 section 24/7 Operation
>>
>> It talks about 'Receiver Fault Tolerance'
>>
>> I'm unsure of what a Receiver is here, from reading it sounds like when
>> you submit an application to the cluster in cluster mode i.e. *--deploy-mode
>> cluster *the driver program will run on a Worker and this case this
>> Worker is seen as a Receiver because it is consuming messages from the
>> source.
>>
>>
>> Is the above understanding correct? or is there more to it?
>>
>>
>>
>
>
> --
> Best Regards,
> Ayan Guha
>

Mime
View raw message