drill-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jinfeng Ni <jinfengn...@gmail.com>
Subject Re: Avro reader - Possible regression in 1.5-SNAPSHOT
Date Tue, 02 Feb 2016 18:46:57 GMT
Hi Stefán,

Can you post the commit id for your build, by run:

select * from sys.version;

The unit test has similar query (select * from avro_table) [1], and
did not hit this problem. I just want to make sure that we are using
the same commit id.

Thanks


[1] https://github.com/apache/drill/blob/master/exec/java-exec/src/test/java/org/apache/drill/exec/store/avro/AvroFormatTest.java#L73

On Tue, Feb 2, 2016 at 9:07 AM, Abdel Hakim Deneche
<adeneche@maprtech.com> wrote:
> Thanks
>
> On Tue, Feb 2, 2016 at 9:03 AM, Stefán Baxter <stefan@activitystream.com>
> wrote:
>
>> https://issues.apache.org/jira/browse/DRILL-4339
>>
>> On Tue, Feb 2, 2016 at 4:46 PM, Abdel Hakim Deneche <adeneche@maprtech.com
>> >
>> wrote:
>>
>> > Hi Stefán,
>> >
>> > Can you open a JIRA for this, please ?
>> >
>> > Thanks
>> >
>> > On Tue, Feb 2, 2016 at 6:21 AM, Stefán Baxter <stefan@activitystream.com
>> >
>> > wrote:
>> >
>> > > Hi,
>> > >
>> > > I can confirm that this same query+avro-files work in 1.4 so this is
>> > > probably a regression
>> > >
>> > > Regards,
>> > >  -Stefan
>> > >
>> > > On Tue, Feb 2, 2016 at 1:59 PM, Stefán Baxter <
>> stefan@activitystream.com
>> > >
>> > > wrote:
>> > >
>> > > > Hi,
>> > > >
>> > > > I'm getting this error on master/head using the Avro Reader:
>> > > >
>> > > > "what ever the mind of man can conceive and believe, drill can query"
>> > > > 0: jdbc:drill:zk=local> select * from dfs.asa.`/<some>`;
>> > > > Exception in thread "drill-executor-2" java.lang.NoSuchMethodError:
>> > > >
>> > >
>> >
>> org.apache.drill.exec.store.avro.AvroRecordReader.setColumns(Ljava/util/Collection;)V
>> > > > at
>> > > >
>> > >
>> >
>> org.apache.drill.exec.store.avro.AvroRecordReader.<init>(AvroRecordReader.java:99)
>> > > > at
>> > > >
>> > >
>> >
>> org.apache.drill.exec.store.avro.AvroFormatPlugin.getRecordReader(AvroFormatPlugin.java:73)
>> > > > at
>> > > >
>> > >
>> >
>> org.apache.drill.exec.store.dfs.easy.EasyFormatPlugin.getReaderBatch(EasyFormatPlugin.java:172)
>> > > > at
>> > > >
>> > >
>> >
>> org.apache.drill.exec.store.dfs.easy.EasyReaderBatchCreator.getBatch(EasyReaderBatchCreator.java:35)
>> > > > at
>> > > >
>> > >
>> >
>> org.apache.drill.exec.store.dfs.easy.EasyReaderBatchCreator.getBatch(EasyReaderBatchCreator.java:28)
>> > > > at
>> > > >
>> > >
>> >
>> org.apache.drill.exec.physical.impl.ImplCreator.getRecordBatch(ImplCreator.java:147)
>> > > > at
>> > > >
>> > >
>> >
>> org.apache.drill.exec.physical.impl.ImplCreator.getChildren(ImplCreator.java:170)
>> > > > at
>> > > >
>> > >
>> >
>> org.apache.drill.exec.physical.impl.ImplCreator.getRecordBatch(ImplCreator.java:127)
>> > > > at
>> > > >
>> > >
>> >
>> org.apache.drill.exec.physical.impl.ImplCreator.getChildren(ImplCreator.java:170)
>> > > > at
>> > > >
>> > >
>> >
>> org.apache.drill.exec.physical.impl.ImplCreator.getRecordBatch(ImplCreator.java:127)
>> > > > at
>> > > >
>> > >
>> >
>> org.apache.drill.exec.physical.impl.ImplCreator.getChildren(ImplCreator.java:170)
>> > > > at
>> > > >
>> > >
>> >
>> org.apache.drill.exec.physical.impl.ImplCreator.getRootExec(ImplCreator.java:101)
>> > > > at
>> > > >
>> > >
>> >
>> org.apache.drill.exec.physical.impl.ImplCreator.getExec(ImplCreator.java:79)
>> > > > at
>> > > >
>> > >
>> >
>> org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:230)
>> > > > at
>> > > >
>> > >
>> >
>> org.apache.drill.common.SelfCleaningRunnable.run(SelfCleaningRunnable.java:38)
>> > > > at
>> > > >
>> > >
>> >
>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>> > > > at
>> > > >
>> > >
>> >
>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>> > > > at java.lang.Thread.run(Thread.java:745)
>> > > >
>> > > > We have been using the Avro reader for a while and this looks like
a
>> > > > regression.
>> > > >
>> > > > I will verify that this is working in 1.4 and report.
>> > > >
>> > > > Regards,
>> > > >  -Stefan
>> > > >
>> > >
>> >
>> >
>> >
>> > --
>> >
>> > Abdelhakim Deneche
>> >
>> > Software Engineer
>> >
>> >   <http://www.mapr.com/>
>> >
>> >
>> > Now Available - Free Hadoop On-Demand Training
>> > <
>> >
>> http://www.mapr.com/training?utm_source=Email&utm_medium=Signature&utm_campaign=Free%20available
>> > >
>> >
>>
>
>
>
> --
>
> Abdelhakim Deneche
>
> Software Engineer
>
>   <http://www.mapr.com/>
>
>
> Now Available - Free Hadoop On-Demand Training
> <http://www.mapr.com/training?utm_source=Email&utm_medium=Signature&utm_campaign=Free%20available>

Mime
View raw message