phoenix-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <>
Subject [jira] [Commented] (PHOENIX-1815) Use Spark Data Source API in phoenix-spark module
Date Tue, 14 Apr 2015 15:20:12 GMT


ASF GitHub Bot commented on PHOENIX-1815:

Github user jmahonin commented on the pull request:
    Re: step c, I would lean towards not including either the spark or scala library JARs.
They are provided by the Spark runtime itself, so I'm not sure it makes sense to bundle them
within the phoenix assembly JAR. Does that make sense to you?
    After those, I think the only other runtime dependency not already in the all-common-jars
file is one for snappy-java, which I'm not sure is explicitly needed anymore that we're part
of a multi-module build. I will double-check.

> Use Spark Data Source API in phoenix-spark module
> -------------------------------------------------
>                 Key: PHOENIX-1815
>                 URL:
>             Project: Phoenix
>          Issue Type: New Feature
>            Reporter: Josh Mahonin
> Spark 1.3.0 introduces a new 'Data Source' API to standardize load and save methods for
different types of data sources.
> The phoenix-spark module should implement the same API for use as a pluggable data store
in Spark.
> ref:

This message was sent by Atlassian JIRA

View raw message