spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Petr Novak <oss.mli...@gmail.com>
Subject Standalone vs. Mesos for production installation on a smallish cluster
Date Fri, 26 Feb 2016 11:40:45 GMT
Hi all,
I believe that it used to be in documentation that Standalone mode is not
for production. I'm either wrong or it was already removed.

Having a small cluster between 5-10 nodes is Standalone recommended for
production? I would like to go with Mesos but the question is if there is
real add-on value for production, mainly from stability perspective.

Can I expect that adding Mesos will improve stability compared to
Standalone to the extent to justify itself according to somewhat increased
complexity?

I know it is hard to answer because Mesos layer itself is going to add some
bugs as well.

Are there unique features enabled by Mesos specific to Spark? E.g. adaptive
resources for jobs or whatever?

In the future once cluster will grow and more services running on Mesos, we
plan to use Mesos. The question is if it does worth to go with it
immediately even maybe its utility is not directly needed at this point.

Many thanks,
Petr

Mime
View raw message