drill-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Rahul Raj <rahul....@option3consulting.com>
Subject Re: Kudu plugin
Date Fri, 27 Jan 2017 09:30:33 GMT
Can someone point me to a storage plugin design document? I guess Kudu
plugin has no design information attached.

On Fri, Jan 27, 2017 at 1:18 PM, Rahul Raj <rahul.raj@option3consulting.com>
wrote:

> Created DRILL-5229. I will work on this.
>
> On Thu, Jan 26, 2017 at 1:01 PM, Chunhui Shi <cshi@mapr.com> wrote:
>
>> Could you file a JIRA and work on this update? Thanks.
>>
>> ________________________________
>> From: Rahul Raj <rahul.raj@option3consulting.com>
>> Sent: Wednesday, January 25, 2017 10:03:37 PM
>> To: user@drill.apache.org
>> Subject: Kudu plugin
>>
>> Any experiences with Kudu storage plugin? I could see that there has been
>> no activity on kudu storage almost for a year.
>>
>> Getting an error -" out-of-order key" for a query select v,count(k) from
>> kudu.test group by v where k is the primary key. This happens only when
>> the
>> aggregation is done on primary key. Should drill move to the latest kudu
>> client to investigate this further?
>>
>> Current drill kudu connector uses org.kududb:kudu-client:0.6.0 from
>> cloudera repository, where the latest released library
>> org.apache.kudu:kudu-client:1.1.0 is hosted on maven central. There are a
>> few breaking changes with the new library:
>>
>>    1. TIMESTAMP renamed to UNIXTIME_MICROS
>>    2. In KuduRecordReader#setup -
>>    KuduScannerBuilder#lowerBoundPartitionKeyRaw renamed to lowerBoundRaw
>>    andKuduScannerBuilder#exclusiveUpperBoundPartitionKeyRaw renamed
>>    exclusiveUpperBoundRaw. Both methods are deprecated.
>>    3. In KuduRecordWriterImpl#updateSchema - client.createTable(name,
>>    kuduSchema) requires CreateTableOperatios as the third argument
>>
>>
>> Any thoughts on this upgrade?
>>
>> Regards,
>> Rahul
>>
>> --
>> **** This email and any files transmitted with it are confidential and
>> intended solely for the use of the individual or entity to whom it is
>> addressed. If you are not the named addressee then you should not
>> disseminate, distribute or copy this e-mail. Please notify the sender
>> immediately and delete this e-mail from your system.****
>>
>
>

-- 
**** This email and any files transmitted with it are confidential and 
intended solely for the use of the individual or entity to whom it is 
addressed. If you are not the named addressee then you should not 
disseminate, distribute or copy this e-mail. Please notify the sender 
immediately and delete this e-mail from your system.****

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message