spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Patrick Wendell <pwend...@gmail.com>
Subject Re: Terminology: "worker" vs "slave"
Date Fri, 03 Jan 2014 06:45:08 GMT
Ya we've been trying to standardize on the terminology here (see glossary):

http://spark.incubator.apache.org/docs/latest/cluster-overview.html

I think "slave" actually isn't mentioned here at all - but references
to slave in the codebase are synonymous with "worker".

- Patrick

On Thu, Jan 2, 2014 at 10:42 PM, Reynold Xin <rxin@databricks.com> wrote:
> It is historic.
>
> I think we are converging towards
>
> worker: the "slave" daemon in the standalone cluster manager
>
> executor: the jvm process that is launched by the worker that executes tasks
>
>
>
> On Thu, Jan 2, 2014 at 10:39 PM, Andrew Ash <andrew@andrewash.com> wrote:
>
>> The terms worker and slave seem to be used interchangeably.  Are they the
>> same?
>>
>> Worker is used more frequently in the codebase:
>>
>> aash@aash-mbp ~/git/spark$ git grep -i worker | wc -l
>>      981
>> aash@aash-mbp ~/git/spark$ git grep -i slave | wc -l
>>      348
>> aash@aash-mbp ~/git/spark$
>>
>> Does it make sense to unify on one or the other?
>>

Mime
View raw message