spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Mats Rydberg <m...@neo4j.org>
Subject SparkGraph review process
Date Fri, 04 Oct 2019 08:32:19 GMT
Hello dear Spark community

We are the developers behind the SparkGraph SPIP, which is a project
created out of our work on openCypher Morpheus (
https://github.com/opencypher/morpheus). During this year we have
collaborated with mainly Xiangrui Meng of Databricks to define and develop
a new SparkGraph module based on our experience from working on Morpheus.
Morpheus - formerly known as "Cypher for Apache Spark" - has been in
development for over 3 years and matured in its API and implementation.

The SPIP work has been on hold for a period of time now, as priorities at
Databricks have changed which has occupied Xiangrui's time (as well as
other happenings). As you may know, the latest API PR (
https://github.com/apache/spark/pull/24851) is blocking us from moving
forward with the implementation.

In an attempt to not lose track of this project we now reach out to you to
ask whether there are any Spark committers in the community who would be
prepared to commit to helping us review and merge our code contributions to
Apache Spark? We are not asking for lots of direct development support, as
we believe we have the implementation more or less completed already since
early this year. There is a proof-of-concept PR (
https://github.com/apache/spark/pull/24297) which contains the
functionality.

If you could offer such aid it would be greatly appreciated. None of us are
Spark committers, which is hindering our ability to deliver this project in
time for Spark 3.0.

Sincerely
the Neo4j Graph Analytics team
Mats, Martin, Max, Sören, Jonatan

Mime
View raw message