spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Shixiong(Ryan) Zhu" <shixi...@databricks.com>
Subject Re: Problems during upgrade 2.2.2 -> 2.4.4
Date Fri, 31 Jan 2020 17:08:03 GMT
Unfortunately, Spark standalone mode doesn't support rolling update. All
Spark components (master, worker, driver) must be updated to the same
version. When using HA mode, the states persisted in zookeeper (or files if
not using zookeeper) need to be cleaned because they are not compatible
between versions.

Best Regards,
Ryan


On Wed, Jan 29, 2020 at 2:12 AM bsikander <behroz89@gmail.com> wrote:

> Anyone?
> This question is not regarding my application running on top of Spark.
> The question is about the upgrade of spark itself from 2.2 to 2.4.
>
> I expected atleast that spark would recover from upgrades gracefully and
> recover its own persisted objects.
>
>
>
> --
> Sent from: http://apache-spark-user-list.1001560.n3.nabble.com/
>
> ---------------------------------------------------------------------
> To unsubscribe e-mail: user-unsubscribe@spark.apache.org
>
> --

Best Regards,
Ryan

Mime
View raw message