spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Tim Chen <...@mesosphere.io>
Subject Re: Spark - Standalone Vs YARN Vs Mesos
Date Thu, 13 Aug 2015 05:28:12 GMT
I'm not sure what you're looking for, since you can't really compare
Standalone with YARN or Mesos, as Standalone is assuming the Spark
workers/master owns the cluster, and YARN/Mesos is trying to share the
cluster among different applications/frameworks.

And when you refer to resource utilization, what exactly does it mean to
you? Is it the ability to maximize the usage of your resources with
multiple applications in mind, or just how much configuration Spark allows
you to in each mode?

Tim

On Wed, Aug 12, 2015 at 2:16 PM, ÐΞ€ρ@Ҝ (๏̯͡๏) <deepujain@gmail.com> wrote:

> Do we have any comparisons in terms of resource utilization, scheduling of
> running Spark in the below three modes
> 1) Standalone
> 2) over YARN
> 3) over Mesos
>
> Can some one share resources (thoughts/URLs) on this area.
>
>
> --
> Deepak
>
>

Mime
View raw message