systemml-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Glenn Weidner" <gweid...@us.ibm.com>
Subject [DISCUSS] Migration to Spark 2.0.0
Date Tue, 02 Aug 2016 18:44:35 GMT


In the "[DISCUSS] SystemML 0.11 release" thread, native frame support and
API updates such as new MLContext were identified as main new features for
the release.  In addition, support for Spark 2.0.0 was targeted.
Note code changes required for Spark 2.0.0 are not backward compatible to
earlier Spark versions (e.g., 1.6.2) so starting separate mail thread for
anyone to raise objections/alternatives for migrating to Spark 2.0.0.

One possible option is to do a release to include the new Apache SystemML
features before migrating to Spark 2.0.0.  However, it seems better to have
the next Apache SystemML release compatible with latest Spark version
2.0.0.  The Apache SystemML 0.10 release from June can be used with earlier
versions of Spark.

Regards,
Glenn

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message