spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Andrew Ash <and...@andrewash.com>
Subject Re: Terminology: "worker" vs "slave"
Date Fri, 03 Jan 2014 06:46:37 GMT
That matches my mental model -- glad to hear we're converging on one though
for consistency.

Thanks guys!


On Fri, Jan 3, 2014 at 1:45 AM, Patrick Wendell <pwendell@gmail.com> wrote:

> Ya we've been trying to standardize on the terminology here (see glossary):
>
> http://spark.incubator.apache.org/docs/latest/cluster-overview.html
>
> I think "slave" actually isn't mentioned here at all - but references
> to slave in the codebase are synonymous with "worker".
>
> - Patrick
>
> On Thu, Jan 2, 2014 at 10:42 PM, Reynold Xin <rxin@databricks.com> wrote:
> > It is historic.
> >
> > I think we are converging towards
> >
> > worker: the "slave" daemon in the standalone cluster manager
> >
> > executor: the jvm process that is launched by the worker that executes
> tasks
> >
> >
> >
> > On Thu, Jan 2, 2014 at 10:39 PM, Andrew Ash <andrew@andrewash.com>
> wrote:
> >
> >> The terms worker and slave seem to be used interchangeably.  Are they
> the
> >> same?
> >>
> >> Worker is used more frequently in the codebase:
> >>
> >> aash@aash-mbp ~/git/spark$ git grep -i worker | wc -l
> >>      981
> >> aash@aash-mbp ~/git/spark$ git grep -i slave | wc -l
> >>      348
> >> aash@aash-mbp ~/git/spark$
> >>
> >> Does it make sense to unify on one or the other?
> >>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message