tez-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Chen He <airb...@gmail.com>
Subject Re: Pig on tez errors
Date Sun, 25 May 2014 13:52:31 GMT
Hi Daniel

Thank you for the reply. I compiled Tez and Pig against hadoop 2.2.

Regards!

Chen


On Thu, May 22, 2014 at 5:22 PM, Daniel Dai <daijy@hortonworks.com> wrote:

> Which version of Hadoop are you using? Seem LocalResource changed from
> interface to class in 2.1 (YARN-711). If you are using pre-2.1, this
> might be the case.
>
> Thanks,
> Daniel
>
> On Thu, May 22, 2014 at 3:06 PM, Chen He <airbots@gmail.com> wrote:
> > Hi Daniel
> >
> > Thank you for the reply. I did as you suggested but get following errors:
> >
> > ERROR 2998: Unhandled internal error. Found interface
> > org.apache.hadoop.yarn.api.records.LocalResource, but class was expected
> >
> > java.lang.IncompatibleClassChangeError: Found interface
> > org.apache.hadoop.yarn.api.records.LocalResource, but class was expected
> >     at
> >
> org.apache.pig.backend.hadoop.executionengine.tez.TezResourceManager.getTezResources(TezResourceManager.java:124)
> >     at
> >
> org.apache.pig.backend.hadoop.executionengine.tez.TezResourceManager.addTezResources(TezResourceManager.java:96)
> >     at
> >
> org.apache.pig.backend.hadoop.executionengine.tez.TezPlanContainer.getLocalResources(TezPlanContainer.java:104)
> >     at
> >
> org.apache.pig.backend.hadoop.executionengine.tez.TezJobControlCompiler.getJob(TezJobControlCompiler.java:106)
> >     at
> >
> org.apache.pig.backend.hadoop.executionengine.tez.TezJobControlCompiler.compile(TezJobControlCompiler.java:89)
> >     at
> >
> org.apache.pig.backend.hadoop.executionengine.tez.TezLauncher.launchPig(TezLauncher.java:92)
> >     at
> >
> org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.launchPig(HExecutionEngine.java:277)
> >     at org.apache.pig.PigServer.launchPlan(PigServer.java:1378)
> >     at
> > org.apache.pig.PigServer.executeCompiledLogicalPlan(PigServer.java:1363)
> >     at org.apache.pig.PigServer.execute(PigServer.java:1352)
> >     at org.apache.pig.PigServer.executeBatch(PigServer.java:403)
> >     at org.apache.pig.PigServer.executeBatch(PigServer.java:386)
> >     at
> > org.apache.pig.tools.grunt.GruntParser.executeBatch(GruntParser.java:170)
> >     at
> >
> org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:232)
> >     at
> >
> org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:203)
> >     at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:81)
> >     at org.apache.pig.Main.run(Main.java:608)
> >     at org.apache.pig.Main.main(Main.java:156)
> >     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> >     at
> >
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> >     at
> >
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> >     at java.lang.reflect.Method.invoke(Method.java:606)
> >     at org.apache.hadoop.util.RunJar.main(RunJar.java:208)
> >
> > Is this a problem that caused by hadoop incompatiblilty? Which version of
> > Hadoop is the best?
> >
> > Regards!
> >
> > Chen
> >
> >
> > On Thu, May 22, 2014 at 4:19 PM, Daniel Dai <daijy@hortonworks.com>
> wrote:
> >
> >> Need to set PIG_CLASSPATH:
> >> export PIG_CLASSPATH=$TEZ_HOME/*:$TEZ_HOME/lib/*:$TEZ_HOME/conf
> >>
> >> Thanks,
> >> Daniel
> >>
> >> On Thu, May 22, 2014 at 2:11 PM, Chen He <airbots@gmail.com> wrote:
> >> > Any one met this error before?
> >> >
> >> > [main] ERROR org.apache.pig.Main - ERROR 2998: Unhandled internal
> error.
> >> > org/apache/tez/common/counters/DAGCounter
> >> >
> >> > Any reply will be appreciated!
> >> >
> >> > Regards!
> >> >
> >> > Chen
> >>
> >> --
> >> CONFIDENTIALITY NOTICE
> >> NOTICE: This message is intended for the use of the individual or
> entity to
> >> which it is addressed and may contain information that is confidential,
> >> privileged and exempt from disclosure under applicable law. If the
> reader
> >> of this message is not the intended recipient, you are hereby notified
> that
> >> any printing, copying, dissemination, distribution, disclosure or
> >> forwarding of this communication is strictly prohibited. If you have
> >> received this communication in error, please contact the sender
> immediately
> >> and delete it from your system. Thank You.
> >>
>
> --
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity to
> which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message