tez-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Chen He <airb...@gmail.com>
Subject Fwd: meet a problem when using "pig -x tez_local"
Date Wed, 04 Jun 2014 23:21:38 GMT
I am using pig -x tez_local to test tez local mode and met following
problems (use tutorial.jar)

2014-06-03 11:06:35,964 [pool-1-thread-1] INFO
org.apache.hadoop.mapred.YarnTezDagChild - Running task,
taskAttemptId=attempt_1401811588093_0000_1_05_000000_0
2014-06-03 11:06:35,965 [pool-1-thread-1] ERROR
org.apache.pig.backend.hadoop.executionengine.tez.PigProcessor -
Encountered exception while processing:
java.lang.NullPointerException
        at
org.apache.pig.backend.hadoop.executionengine.tez.ObjectCache.retrieve(ObjectCache.java:47)
        at
org.apache.pig.backend.hadoop.executionengine.tez.PigProcessor.collectSample(PigProcessor.java:307)
        at
org.apache.pig.backend.hadoop.executionengine.tez.PigProcessor.initializeInputs(PigProcessor.java:218)
        at
org.apache.pig.backend.hadoop.executionengine.tez.PigProcessor.run(PigProcessor.java:162)
        at
org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:317)
        at
org.apache.hadoop.mapred.YarnTezDagChild$3.run(YarnTezDagChild.java:602)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:415)
        at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1491)
        at
org.apache.hadoop.mapred.YarnTezDagChild.pollTask(YarnTezDagChild.java:591)
        at
org.apache.hadoop.mapred.YarnTezDagChild.runTask(YarnTezDagChild.java:332)
        at
org.apache.tez.dag.app.launcher.LocalContainerLauncher$1.run(LocalContainerLauncher.java:250)
        at java.lang.Thread.run(Thread.java:744)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:744)

code checking implies that the ObjectCache is trying to get something from
a Map but it is not there.
But what is the purpose of using ObjectCache in PIG on TEZ?
Why pig needs sampleVertex in the PigProcessor?

Any reply will be appreciated.

Regards!

Chen

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message