drill-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jason Altekruse <altekruseja...@gmail.com>
Subject Re: Avro reader - Possible regression in 1.5-SNAPSHOT
Date Tue, 02 Feb 2016 19:06:18 GMT
I made a comment on the JIRA about a possible explanation for this, it
seems like a configuration/classpath issue. I would recommend moving the
discussion there because it doesn't always forward JIRA updates to the list.

On Tue, Feb 2, 2016 at 10:46 AM, Jinfeng Ni <jinfengni99@gmail.com> wrote:

> Hi Stefán,
>
> Can you post the commit id for your build, by run:
>
> select * from sys.version;
>
> The unit test has similar query (select * from avro_table) [1], and
> did not hit this problem. I just want to make sure that we are using
> the same commit id.
>
> Thanks
>
>
> [1]
> https://github.com/apache/drill/blob/master/exec/java-exec/src/test/java/org/apache/drill/exec/store/avro/AvroFormatTest.java#L73
>
> On Tue, Feb 2, 2016 at 9:07 AM, Abdel Hakim Deneche
> <adeneche@maprtech.com> wrote:
> > Thanks
> >
> > On Tue, Feb 2, 2016 at 9:03 AM, Stefán Baxter <stefan@activitystream.com
> >
> > wrote:
> >
> >> https://issues.apache.org/jira/browse/DRILL-4339
> >>
> >> On Tue, Feb 2, 2016 at 4:46 PM, Abdel Hakim Deneche <
> adeneche@maprtech.com
> >> >
> >> wrote:
> >>
> >> > Hi Stefán,
> >> >
> >> > Can you open a JIRA for this, please ?
> >> >
> >> > Thanks
> >> >
> >> > On Tue, Feb 2, 2016 at 6:21 AM, Stefán Baxter <
> stefan@activitystream.com
> >> >
> >> > wrote:
> >> >
> >> > > Hi,
> >> > >
> >> > > I can confirm that this same query+avro-files work in 1.4 so this
is
> >> > > probably a regression
> >> > >
> >> > > Regards,
> >> > >  -Stefan
> >> > >
> >> > > On Tue, Feb 2, 2016 at 1:59 PM, Stefán Baxter <
> >> stefan@activitystream.com
> >> > >
> >> > > wrote:
> >> > >
> >> > > > Hi,
> >> > > >
> >> > > > I'm getting this error on master/head using the Avro Reader:
> >> > > >
> >> > > > "what ever the mind of man can conceive and believe, drill can
> query"
> >> > > > 0: jdbc:drill:zk=local> select * from dfs.asa.`/<some>`;
> >> > > > Exception in thread "drill-executor-2"
> java.lang.NoSuchMethodError:
> >> > > >
> >> > >
> >> >
> >>
> org.apache.drill.exec.store.avro.AvroRecordReader.setColumns(Ljava/util/Collection;)V
> >> > > > at
> >> > > >
> >> > >
> >> >
> >>
> org.apache.drill.exec.store.avro.AvroRecordReader.<init>(AvroRecordReader.java:99)
> >> > > > at
> >> > > >
> >> > >
> >> >
> >>
> org.apache.drill.exec.store.avro.AvroFormatPlugin.getRecordReader(AvroFormatPlugin.java:73)
> >> > > > at
> >> > > >
> >> > >
> >> >
> >>
> org.apache.drill.exec.store.dfs.easy.EasyFormatPlugin.getReaderBatch(EasyFormatPlugin.java:172)
> >> > > > at
> >> > > >
> >> > >
> >> >
> >>
> org.apache.drill.exec.store.dfs.easy.EasyReaderBatchCreator.getBatch(EasyReaderBatchCreator.java:35)
> >> > > > at
> >> > > >
> >> > >
> >> >
> >>
> org.apache.drill.exec.store.dfs.easy.EasyReaderBatchCreator.getBatch(EasyReaderBatchCreator.java:28)
> >> > > > at
> >> > > >
> >> > >
> >> >
> >>
> org.apache.drill.exec.physical.impl.ImplCreator.getRecordBatch(ImplCreator.java:147)
> >> > > > at
> >> > > >
> >> > >
> >> >
> >>
> org.apache.drill.exec.physical.impl.ImplCreator.getChildren(ImplCreator.java:170)
> >> > > > at
> >> > > >
> >> > >
> >> >
> >>
> org.apache.drill.exec.physical.impl.ImplCreator.getRecordBatch(ImplCreator.java:127)
> >> > > > at
> >> > > >
> >> > >
> >> >
> >>
> org.apache.drill.exec.physical.impl.ImplCreator.getChildren(ImplCreator.java:170)
> >> > > > at
> >> > > >
> >> > >
> >> >
> >>
> org.apache.drill.exec.physical.impl.ImplCreator.getRecordBatch(ImplCreator.java:127)
> >> > > > at
> >> > > >
> >> > >
> >> >
> >>
> org.apache.drill.exec.physical.impl.ImplCreator.getChildren(ImplCreator.java:170)
> >> > > > at
> >> > > >
> >> > >
> >> >
> >>
> org.apache.drill.exec.physical.impl.ImplCreator.getRootExec(ImplCreator.java:101)
> >> > > > at
> >> > > >
> >> > >
> >> >
> >>
> org.apache.drill.exec.physical.impl.ImplCreator.getExec(ImplCreator.java:79)
> >> > > > at
> >> > > >
> >> > >
> >> >
> >>
> org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:230)
> >> > > > at
> >> > > >
> >> > >
> >> >
> >>
> org.apache.drill.common.SelfCleaningRunnable.run(SelfCleaningRunnable.java:38)
> >> > > > at
> >> > > >
> >> > >
> >> >
> >>
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> >> > > > at
> >> > > >
> >> > >
> >> >
> >>
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> >> > > > at java.lang.Thread.run(Thread.java:745)
> >> > > >
> >> > > > We have been using the Avro reader for a while and this looks
> like a
> >> > > > regression.
> >> > > >
> >> > > > I will verify that this is working in 1.4 and report.
> >> > > >
> >> > > > Regards,
> >> > > >  -Stefan
> >> > > >
> >> > >
> >> >
> >> >
> >> >
> >> > --
> >> >
> >> > Abdelhakim Deneche
> >> >
> >> > Software Engineer
> >> >
> >> >   <http://www.mapr.com/>
> >> >
> >> >
> >> > Now Available - Free Hadoop On-Demand Training
> >> > <
> >> >
> >>
> http://www.mapr.com/training?utm_source=Email&utm_medium=Signature&utm_campaign=Free%20available
> >> > >
> >> >
> >>
> >
> >
> >
> > --
> >
> > Abdelhakim Deneche
> >
> > Software Engineer
> >
> >   <http://www.mapr.com/>
> >
> >
> > Now Available - Free Hadoop On-Demand Training
> > <
> http://www.mapr.com/training?utm_source=Email&utm_medium=Signature&utm_campaign=Free%20available
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message