ignite-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Denis Magda (JIRA)" <j...@apache.org>
Subject [jira] [Created] (IGNITE-4526) Add Spark Shared RDD examples
Date Thu, 05 Jan 2017 17:38:58 GMT
Denis Magda created IGNITE-4526:

             Summary: Add Spark Shared RDD examples
                 Key: IGNITE-4526
                 URL: https://issues.apache.org/jira/browse/IGNITE-4526
             Project: Ignite
          Issue Type: Task
            Reporter: Denis Magda

Spark Shared RDD functionality doesn't have its own examples. We need to add an example that
will do the following:
- First Spark Worker: creation of a shared RDD and filling it in with data.
- First Spark Worker: performing some native spark transformation with the RDD.
- Second Spark Worker: connecting to the same shared RDD.
- Second Spark Worker: execution of SQL query using Spark API and Ignite API. Show that Ignite's
query executes faster.

The reason why the example should consist of two workers is to showcase one of the main benefits
of Ignite's RDDs - ability to share the state (RDD) amid different Spark workers and processes.

This message was sent by Atlassian JIRA

View raw message