spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Marcelo Vanzin <van...@cloudera.com>
Subject Re: RFC: Remove "HBaseTest" from examples?
Date Tue, 19 Apr 2016 17:38:46 GMT
Alright, if you prefer, I'll say "it's actually in use right now in
spite of not being in any upstream HBase release", and it's more
useful than a single example file in the Spark repo for those who
really want to integrate with HBase.

Spark's example is really very trivial (just uses one of HBase's input
formats), which makes it not very useful as a blueprint for developing
HBase apps with Spark.

On Tue, Apr 19, 2016 at 10:28 AM, Ted Yu <yuzhihong@gmail.com> wrote:
> bq. I wouldn't call it "incomplete".
>
> I would call it incomplete.
>
> Please see HBASE-15333 'Enhance the filter to handle short, integer, long,
> float and double' which is a bug fix.
>
> Please exclude presence of related of module in vendor distro from this
> discussion.
>
> Thanks
>
> On Tue, Apr 19, 2016 at 10:23 AM, Marcelo Vanzin <vanzin@cloudera.com>
> wrote:
>>
>> On Tue, Apr 19, 2016 at 10:20 AM, Ted Yu <yuzhihong@gmail.com> wrote:
>> > I want to note that the hbase-spark module in HBase is incomplete. Zhan
>> > has
>> > several patches pending review.
>>
>> I wouldn't call it "incomplete". Lots of functionality is there, which
>> doesn't mean new ones, or more efficient implementations of existing
>> ones, can't be added.
>>
>> > hbase-spark module is currently only in master branch which would be
>> > released as 2.0
>>
>> Just as a side note, it's part of CDH 5.7.0, not that it matters much
>> for upstream HBase.
>>
>> --
>> Marcelo
>
>



-- 
Marcelo

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@spark.apache.org
For additional commands, e-mail: dev-help@spark.apache.org


Mime
View raw message