spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Reynold Xin <r...@databricks.com>
Subject Re: [VOTE] [SPIP] SPARK-15689: Data Source API V2
Date Thu, 17 Aug 2017 15:55:44 GMT
Yea I don't think it's a good idea to upload a doc and then call for a vote
immediately. People need time to digest ...


On Thu, Aug 17, 2017 at 6:22 AM, Wenchen Fan <cloud0fan@gmail.com> wrote:

> Sorry let's remove the VOTE tag as I just wanna bring this up for
> discussion.
>
> I'll restart the voting process after we have enough discussion on the
> JIRA ticket or here in this email thread.
>
> On Thu, Aug 17, 2017 at 9:12 PM, Russell Spitzer <
> russell.spitzer@gmail.com> wrote:
>
>> -1, I don't think there has really been any discussion of this api change
>> yet or at least it hasn't occurred on the jira ticket
>>
>> On Thu, Aug 17, 2017 at 8:05 AM Wenchen Fan <cloud0fan@gmail.com> wrote:
>>
>>> adding my own +1 (binding)
>>>
>>> On Thu, Aug 17, 2017 at 9:02 PM, Wenchen Fan <cloud0fan@gmail.com>
>>> wrote:
>>>
>>>> Hi all,
>>>>
>>>> Following the SPIP process, I'm putting this SPIP up for a vote.
>>>>
>>>> The current data source API doesn't work well because of some
>>>> limitations like: no partitioning/bucketing support, no columnar read, hard
>>>> to support more operator push down, etc.
>>>>
>>>> I'm proposing a Data Source API V2 to address these problems, please
>>>> read the full document at https://issues.apache.org/jira
>>>> /secure/attachment/12882332/SPIP%20Data%20Source%20API%20V2.pdf
>>>>
>>>> Since this SPIP is mostly about APIs, I also created a prototype and
>>>> put java docs on these interfaces, so that it's easier to review these
>>>> interfaces and discuss: https://github.com/cl
>>>> oud-fan/spark/pull/10/files
>>>>
>>>> The vote will be up for the next 72 hours. Please reply with your vote:
>>>>
>>>> +1: Yeah, let's go forward and implement the SPIP.
>>>> +0: Don't really care.
>>>> -1: I don't think this is a good idea because of the following
>>>> technical reasons.
>>>>
>>>> Thanks!
>>>>
>>>
>>>
>

Mime
View raw message