phoenix-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (PHOENIX-1815) Use Spark Data Source API in phoenix-spark module
Date Tue, 14 Apr 2015 06:20:13 GMT

    [ https://issues.apache.org/jira/browse/PHOENIX-1815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14493654#comment-14493654
] 

ASF GitHub Bot commented on PHOENIX-1815:
-----------------------------------------

Github user mravi commented on the pull request:

    https://github.com/apache/phoenix/pull/63#issuecomment-92636784
  
    Thanks @jmahonin  for making the necessary changes .  Below are the final set of tasks
that need to be done before we publish documentation.
    
    a) In phoenix/pom.xml , Add the dependency of phoenix-spark module under <dependencyManagement>.
 
    https://github.com/apache/phoenix/blob/master/pom.xml#L427
    b) In phoenix/phoenix-assembly/pom.xml , Add the dependency of phoenix-spark module .
   https://github.com/apache/phoenix/blob/master/phoenix-assembly/pom.xml#L148
    c) In phoenix/phoenx-assembly/build/all-common-jars.xml , register spark artifacts.
       https://github.com/apache/phoenix/blob/master/phoenix-assembly/src/build/components/all-common-jars.xml#L73
    d) Generating HTML  from the README . 
    
    Is it possible for you to create patches for both the master the 4.4.X HBase 0.98 branch
and attach to the JIRA? I can take care of the d) task and push to SVN . 
    
    Thanks!!



> Use Spark Data Source API in phoenix-spark module
> -------------------------------------------------
>
>                 Key: PHOENIX-1815
>                 URL: https://issues.apache.org/jira/browse/PHOENIX-1815
>             Project: Phoenix
>          Issue Type: New Feature
>            Reporter: Josh Mahonin
>
> Spark 1.3.0 introduces a new 'Data Source' API to standardize load and save methods for
different types of data sources.
> The phoenix-spark module should implement the same API for use as a pluggable data store
in Spark.
> ref:
> https://spark.apache.org/docs/latest/sql-programming-guide.html#data-sources
>     
> https://databricks.com/blog/2015/01/09/spark-sql-data-sources-api-unified-data-access-for-the-spark-platform.html



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message