[ https://issues.apache.org/jira/browse/CRUNCH-618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tom White updated CRUNCH-618:
-----------------------------
Attachment: CRUNCH-618.patch
Here's a patch which switches to Spark 2.0.0 and Scala 2.11 (used by Spark 2 now). Most of
this was written by [~irashid].
Due to SPARK-3369 the change from Spark 1 to Spark 2 is not backwards compatible (for Crunch),
which means we have to be careful when we introduce this change.
> Run on Spark 2
> --------------
>
> Key: CRUNCH-618
> URL: https://issues.apache.org/jira/browse/CRUNCH-618
> Project: Crunch
> Issue Type: Improvement
> Components: Spark
> Affects Versions: 0.14.0
> Reporter: Tom White
> Assignee: Tom White
> Attachments: CRUNCH-618.patch
>
>
> Spark 2 is GA now so it would be good to be able to run Crunch on it.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
|