sqoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Abraham Elmahrek <...@cloudera.com>
Subject Re: ask for help about two testcase failed for sqoop 1.4.6 UT on xlinux
Date Wed, 10 Jun 2015 10:24:12 GMT
Hey man,

Silly question... but do you have accumulo installed?

On Thu, Jun 4, 2015 at 12:59 PM, Shi Ju SJ Xie <xieshiju@cn.ibm.com> wrote:

> Hi All,
> Sorry to bug your guys!
>
> When I run all testcase in my environment using command:  *ant clean
> -Dhadoopversion=200 -Dhbaseprofile=95 test*,
> below two testcases always failed with timeout,
>     ...
>     [junit] Running org.apache.sqoop.accumulo.TestAccumuloImport
>     [junit] Running org.apache.sqoop.accumulo.TestAccumuloImport
>     [junit] Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time
> elapsed: 0 sec
>     [junit] Test org.apache.sqoop.accumulo.*TestAccumuloImport** FAILED
> (timeout)*
>     [junit] Running org.apache.sqoop.accumulo.TestAccumuloQueryImport
>     [junit] Running org.apache.sqoop.accumulo.TestAccumuloQueryImport
>     [junit] Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time
> elapsed: 0 sec
>     [junit] Test org.apache.sqoop.accumulo.*TestAccumuloQueryImport** FAILED
> (timeout*)
> ...
>
> *1) Error log for TEST-org.apache.sqoop.accumulo.TestAccumuloImport.txt:*
>
>    Testsuite: org.apache.sqoop.accumulo.TestAccumuloImport
>    Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 0 sec
>
>    Testcase: testOverwriteSucceeds took 0.002 sec
>     Caused an ERROR
>    Timeout occurred. Please note the time in the report does not reflect
>    the time until the timeout.
>    junit.framework.AssertionFailedError: Timeout occurred. Please note
>    the time in the report does not reflect the time until the timeout.
>
>
> *2) Error log for
> TEST-org.apache.sqoop.accumulo.TestAccumuloQueryImport.txt:*
>
>    Testsuite: org.apache.sqoop.accumulo.TestAccumuloQueryImport
>    Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 0 sec
>
>    Testcase: testImportFromQuery took 0 sec
>     Caused an ERROR
>    Timeout occurred. Please note the time in the report does not reflect
>    the time until the timeout.
>    junit.framework.AssertionFailedError: Timeout occurred. Please note
>    the time in the report does not reflect the time until the timeout.
>
>
>
> If I run these two testcases respective, the error is same to above.
>
> ant -Dhadoopversion=200 -Dhbaseprofile=95  -Dtestcase=TestAccumuloImport
> test
> ant -Dhadoopversion=200 -Dhbaseprofile=95
>  -Dtestcase=TestAccumuloQueryImport   test
>
>
> I have also run it in eclipse environment, the error message like below:
> [image: Inactive hide details for error message:]error message:
> 414183 [main] INFO org.apache.zookeeper.ZooKeeper  - Client
> environment:java.library.path=/usr/java/packages/lib/i386:/lib:/usr/lib
> 414183 [main] INFO org.apache.zookeeper.ZooKeeper  - Client
> environment:java.io.tmpdir=/tmp
> 414183 [main] INFO org.apache.zookeeper.ZooKeeper  - Client
> environment:java.compiler=<NA>
> 414183 [main] INFO org.apache.zookeeper.ZooKeeper  - Client environment:
> os.name=Linux
> 414184 [main] INFO org.apache.zookeeper.ZooKeeper  - Client
> environment:os.arch=i386
> 414184 [main] INFO org.apache.zookeeper.ZooKeeper  - Client
> environment:os.version=2.6.32-504.16.2.el6.x86_64
> 414184 [main] INFO org.apache.zookeeper.ZooKeeper  - Client environment:
> user.name=xieshiju
> 414184 [main] INFO org.apache.zookeeper.ZooKeeper  - Client
> environment:user.home=/home/xieshiju
> 414184 [main] INFO org.apache.zookeeper.ZooKeeper  - Client
> environment:user.dir=/home/xieshiju/sqoop-IBM/sqoop1.4.6/BI/sqoop
> 414189 [main] INFO org.apache.zookeeper.ZooKeeper  - Initiating client
> connection, connectString=localhost:26012 sessionTimeout=30000
> watcher=org.apache.accumulo.fate.zookeeper.ZooSession$ZooWatcher@12f060a
> 414204 [main] DEBUG org.apache.zookeeper.ClientCnxn  -
> zookeeper.disableAutoWatchReset is false
> 414272 [main-SendThread(localhost:26012)] INFO
> org.apache.zookeeper.ClientCnxn  - Opening socket connection to server
> localhost/127.0.0.1:26012. Will not attempt to authenticate using SASL
> (unknown error)
> 414282 [main-SendThread(localhost:26012)] INFO
> org.apache.zookeeper.ClientCnxn  - Socket connection established to
> localhost/127.0.0.1:26012, initiating session
> 414284 [main-SendThread(localhost:26012)] DEBUG
> org.apache.zookeeper.ClientCnxn  - Session establishment request sent on
> localhost/127.0.0.1:26012
> 414309 [main-SendThread(localhost:26012)] INFO
> org.apache.zookeeper.ClientCnxn  - Session establishment complete on server
> localhost/127.0.0.1:26012, sessionid = 0x14dbdef0d8a0004, negotiated
> timeout = 20000
> 414408 [main-SendThread(localhost:26012)] DEBUG
> org.apache.zookeeper.ClientCnxn  - Reading reply
> sessionid:0x14dbdef0d8a0004, packet:: clientPath:null serverPath:null
> finished:false header:: 1,3  replyHeader:: 1,95,0  request::
> '/accumulo/instances/miniInstance,T  response::
> s{4,4,1433410671436,1433410671436,0,0,0,0,36,0,4}
> 414422 [main-SendThread(localhost:26012)] DEBUG
> org.apache.zookeeper.ClientCnxn  - Reading reply
> sessionid:0x14dbdef0d8a0004, packet:: clientPath:null serverPath:null
> finished:false header:: 2,4  replyHeader:: 2,95,0  request::
> '/accumulo/instances/miniInstance,T  response::
> #66346232383838322d366133632d346235392d626239322d643333393564343230633734,s{4,4,1433410671436,1433410671436,0,0,0,0,36,0,4}
>
> 414449 [main-SendThread(localhost:26012)] DEBUG
> org.apache.zookeeper.ClientCnxn  - Reading reply
> sessionid:0x14dbdef0d8a0004, packet:: clientPath:null serverPath:null
> finished:false header:: 3,3  replyHeader:: 3,95,0  request::
> '/accumulo/f4b28882-6a3c-4b59-bb92-d3395d420c74,T  response::
> s{5,5,1433410671446,1433410671446,0,16,0,0,0,16,89}
> 414451 [main-SendThread(localhost:26012)] DEBUG
> org.apache.zookeeper.ClientCnxn  - Reading reply
> sessionid:0x14dbdef0d8a0004, packet:: clientPath:null serverPath:null
> finished:false header:: 4,4  replyHeader:: 4,95,0  request::
> '/accumulo/f4b28882-6a3c-4b59-bb92-d3395d420c74,T  response::
> ,s{5,5,1433410671446,1433410671446,0,16,0,0,0,16,89}
> 414800 [main-SendThread(localhost:26012)] DEBUG
> org.apache.zookeeper.ClientCnxn  - Reading reply
> sessionid:0x14dbdef0d8a0004, packet:: clientPath:null serverPath:null
> finished:false header:: 5,8  replyHeader:: 5,95,0  request::
> '/accumulo/f4b28882-6a3c-4b59-bb92-d3395d420c74/tservers,T  response:: v{'
> 127.0.0.1:14840,'127.0.0.1:14839}
> 414802 [main-SendThread(localhost:26012)] DEBUG
> org.apache.zookeeper.ClientCnxn  - Reading reply
> sessionid:0x14dbdef0d8a0004, packet:: clientPath:null serverPath:null
> finished:false header:: 6,8  replyHeader:: 6,95,0  request::
> '/accumulo/f4b28882-6a3c-4b59-bb92-d3395d420c74/tservers/127.0.0.1:14840,T
>  response:: v{'zlock-0000000000}
> 414804 [main-SendThread(localhost:26012)] DEBUG
> org.apache.zookeeper.ClientCnxn  - Reading reply
> sessionid:0x14dbdef0d8a0004, packet:: clientPath:null serverPath:null
> finished:false header:: 7,3  replyHeader:: 7,95,0  request::
> '/accumulo/f4b28882-6a3c-4b59-bb92-d3395d420c74/tservers/
> 127.0.0.1:14840/zlock-0000000000,T  response::
> s{93,93,1433410678752,1433410678752,0,0,0,93940001666629634,28,0,93}
> 414806 [main-SendThread(localhost:26012)] DEBUG
> org.apache.zookeeper.ClientCnxn  - Reading reply
> sessionid:0x14dbdef0d8a0004, packet:: clientPath:null serverPath:null
> finished:false header:: 8,4  replyHeader:: 8,95,0  request::
> '/accumulo/f4b28882-6a3c-4b59-bb92-d3395d420c74/tservers/
> 127.0.0.1:14840/zlock-0000000000,T  response::
> #54534552565f434c49454e543d3132372e302e302e313a3134383430,s{93,93,1433410678752,1433410678752,0,0,0,93940001666629634,28,0,93}
>
> 414832 [main-SendThread(localhost:26012)] DEBUG
> org.apache.zookeeper.ClientCnxn  - Reading reply
> sessionid:0x14dbdef0d8a0004, packet:: clientPath:null serverPath:null
> finished:false header:: 9,8  replyHeader:: 9,95,0  request::
> '/accumulo/f4b28882-6a3c-4b59-bb92-d3395d420c74/tservers/127.0.0.1:14839,T
>  response:: v{'zlock-0000000000}
> 414834 [main-SendThread(localhost:26012)] DEBUG
> org.apache.zookeeper.ClientCnxn  - Reading reply
> sessionid:0x14dbdef0d8a0004, packet:: clientPath:null serverPath:null
> finished:false header:: 10,3  replyHeader:: 10,95,0  request::
> '/accumulo/f4b28882-6a3c-4b59-bb92-d3395d420c74/tservers/
> 127.0.0.1:14839/zlock-0000000000,T  response::
> s{83,83,1433410677582,1433410677582,0,0,0,93940001666629633,28,0,83}
> 414837 [main-SendThread(localhost:26012)] DEBUG
> org.apache.zookeeper.ClientCnxn  - Reading reply
> sessionid:0x14dbdef0d8a0004, packet:: clientPath:null serverPath:null
> finished:false header:: 11,4  replyHeader:: 11,95,0  request::
> '/accumulo/f4b28882-6a3c-4b59-bb92-d3395d420c74/tservers/
> 127.0.0.1:14839/zlock-0000000000,T  response::
> #54534552565f434c49454e543d3132372e302e302e313a3134383339,s{83,83,1433410677582,1433410677582,0,0,0,93940001666629633,28,0,83}
>
> 421511 [main-SendThread(localhost:26012)] DEBUG
> org.apache.zookeeper.ClientCnxn  - Got ping response for sessionid:
> 0x14dbdef0d8a0004 after 1ms
> 428182 [main-SendThread(localhost:26012)] DEBUG
> org.apache.zookeeper.ClientCnxn  - Got ping response for sessionid:
> 0x14dbdef0d8a0004 after 1ms
> 434856 [main-SendThread(localhost:26012)] DEBUG
> org.apache.zookeeper.ClientCnxn  - Got ping response for sessionid:
> 0x14dbdef0d8a0004 after 1ms
> 441523 [main-SendThread(localhost:26012)] DEBUG
> org.apache.zookeeper.ClientCnxn  - Got ping response for sessionid:
> 0x14dbdef0d8a0004 after 1ms
> 448196 [main-SendThread(localhost:26012)] DEBUG
> org.apache.zookeeper.ClientCnxn  - Got ping response for sessionid:
> 0x14dbdef0d8a0004 after 1ms
> 454866 [main-SendThread(localhost:26012)] DEBUG
> org.apache.zookeeper.ClientCnxn  - Got ping response for sessionid:
> 0x14dbdef0d8a0004 after 1ms
> 461540 [main-SendThread(localhost:26012)] DEBUG
> org.apache.zookeeper.ClientCnxn  - Got ping response for sessionid:
> 0x14dbdef0d8a0004 after 2ms
> 468214 [main-SendThread(localhost:26012)] DEBUG
> org.apache.zookeeper.ClientCnxn  - Got ping response for sessionid:
> 0x14dbdef0d8a0004 after 1ms
> 474886 [main-SendThread(localhost:26012)] DEBUG
> org.apache.zookeeper.ClientCnxn  - Got ping response for sessionid:
> 0x14dbdef0d8a0004 after 0ms
> 481552 [main-SendThread(localhost:26012)] DEBUG
> org.apache.zookeeper.ClientCnxn  - Got ping response for sessionid:
> 0x14dbdef0d8a0004 after 0ms
> 488225 [main-SendThread(localhost:26012)] DEBUG
> org.apache.zookeeper.ClientCnxn  - Got ping response for sessionid:
> 0x14dbdef0d8a0004 after 1ms
> 494897 [main-SendThread(localhost:26012)] DEBUG
> org.apache.zookeeper.ClientCnxn  - Got ping response for sessionid:
> 0x14dbdef0d8a0004 after 0ms
> 501571 [main-SendThread(localhost:26012)] DEBUG
> org.apache.zookeeper.ClientCnxn  - Got ping response for sessionid:
> 0x14dbdef0d8a0004 after 1ms
> 508244 [main-SendThread(localhost:26012)] DEBUG
> org.apache.zookeeper.ClientCnxn  - Got ping response for sessionid:
> 0x14dbdef0d8a0004 after 0ms
> 514911 [main-SendThread(localhost:26012)] DEBUG
> org.apache.zookeeper.ClientCnxn  - Got ping response for sessionid:
> 0x14dbdef0d8a0004 after 1ms
> 521584 [main-SendThread(localhost:26012)] DEBUG
> org.apache.zookeeper.ClientCnxn  - Got ping response for sessionid:
> 0x14dbdef0d8a0004 after 1ms
> 528253 [main-SendThread(localhost:26012)] DEBUG
> org.apache.zookeeper.ClientCnxn  - Got ping response for sessionid:
> 0x14dbdef0d8a0004 after 1ms
> 534927 [main-SendThread(localhost:26012)] DEBUG
> org.apache.zookeeper.ClientCnxn  - Got ping response for sessionid:
> 0x14dbdef0d8a0004 after 1ms
> 535206 [main] DEBUG org.apache.accumulo.core.client.impl.ServerClient  -
> ClientService request failed 127.0.0.1:14840:9997, retrying ...
> org.apache.thrift.transport.TTransportException:
> java.net.SocketTimeoutException: 120000 millis timeout while waiting for
> channel to be ready for read. ch :
> java.nio.channels.SocketChannel[connected local=/127.0.0.1:53044 remote=/
> 127.0.0.1:14840]
>  at
> org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:129)
>  at org.apache.thrift.transport.TTransport.readAll(TTransport.java:86)
>  at
> org.apache.thrift.transport.TFramedTransport.readFrame(TFramedTransport.java:129)
>  at
> org.apache.thrift.transport.TFramedTransport.read(TFramedTransport.java:101)
>  at org.apache.thrift.transport.TTransport.readAll(TTransport.java:86)
>  at
> org.apache.accumulo.core.client.impl.ThriftTransportPool$CachedTTransport.readAll(ThriftTransportPool.java:253)
>  at
> org.apache.thrift.protocol.TCompactProtocol.readByte(TCompactProtocol.java:634)
>  at
> org.apache.thrift.protocol.TCompactProtocol.readMessageBegin(TCompactProtocol.java:501)
>  at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:69)
>  at
> org.apache.accumulo.core.client.impl.thrift.ClientService$Client.recv_authenticate(ClientService.java:444)
>  at
> org.apache.accumulo.core.client.impl.thrift.ClientService$Client.authenticate(ClientService.java:430)
>  at
> org.apache.accumulo.core.client.impl.ConnectorImpl$1.execute(ConnectorImpl.java:67)
>  at
> org.apache.accumulo.core.client.impl.ConnectorImpl$1.execute(ConnectorImpl.java:64)
>  at
> org.apache.accumulo.core.client.impl.ServerClient.executeRaw(ServerClient.java:108)
>  at
> org.apache.accumulo.core.client.impl.ServerClient.execute(ServerClient.java:71)
>  at
> org.apache.accumulo.core.client.impl.ConnectorImpl.<init>(ConnectorImpl.java:64)
>  at
> org.apache.accumulo.core.client.ZooKeeperInstance.getConnector(ZooKeeperInstance.java:227)
>  at
> org.apache.accumulo.core.client.ZooKeeperInstance.getConnector(ZooKeeperInstance.java:222)
>  at
> org.apache.sqoop.mapreduce.AccumuloImportJob.jobSetup(AccumuloImportJob.java:168)
>  at
> org.apache.sqoop.mapreduce.ImportJobBase.runImport(ImportJobBase.java:264)
>  at org.apache.sqoop.manager.SqlManager.importTable(SqlManager.java:676)
>  at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:497)
>  at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:605)
>  at org.apache.sqoop.Sqoop.run(Sqoop.java:143)
>  at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
>  at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:179)
>  at com.cloudera.sqoop.Sqoop.runSqoop(Sqoop.java:45)
>  at
> com.cloudera.sqoop.testutil.ImportJobTestCase.runImport(ImportJobTestCase.java:219)
>  at
> com.cloudera.sqoop.testutil.ImportJobTestCase.runImport(ImportJobTestCase.java:234)
>  at
> org.apache.sqoop.accumulo.TestAccumuloImport.testOverwriteSucceeds(TestAccumuloImport.java:64)
>  at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>  at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>  at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>  at java.lang.reflect.Method.invoke(Method.java:606)
>  at junit.framework.TestCase.runTest(TestCase.java:176)
>  at junit.framework.TestCase.runBare(TestCase.java:141)
>  at junit.framework.TestResult$1.protect(TestResult.java:122)
>  at junit.framework.TestResult.runProtected(TestResult.java:142)
>  at junit.framework.TestResult.run(TestResult.java:125)
>  at junit.framework.TestCase.run(TestCase.java:129)
>  at junit.framework.TestSuite.runTest(TestSuite.java:255)
>  at junit.framework.TestSuite.run(TestSuite.java:250)
>  at
> org.junit.internal.runners.JUnit38ClassRunner.run(JUnit38ClassRunner.java:84)
>  at
> org.eclipse.jdt.internal.junit4.runner.JUnit4TestReference.run(JUnit4TestReference.java:50)
>  at
> org.eclipse.jdt.internal.junit.runner.TestExecution.run(TestExecution.java:38)
>  at
> org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.runTests(RemoteTestRunner.java:459)
>  at
> org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.runTests(RemoteTestRunner.java:675)
>  at
> org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.run(RemoteTestRunner.java:382)
>  at
> org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.main(RemoteTestRunner.java:192)
> Caused by: java.net.SocketTimeoutException: 120000 millis timeout while
> waiting for channel to be ready for read. ch :
> java.nio.channels.SocketChannel[connected local=/127.0.0.1:53044 remote=/
> 127.0.0.1:14840]
>  at
> org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:164)
>  at
> org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161)
>  at
> org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131)
>  at java.io.FilterInputStream.read(FilterInputStream.java:133)
>  at java.io.BufferedInputStream.fill(BufferedInputStream.java:235)
>  at java.io.BufferedInputStream.read1(BufferedInputStream.java:275)
>  at java.io.BufferedInputStream.read(BufferedInputStream.java:334)
>  at
> org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:127)
>  ... 48 more
> 541599 [main-SendThread(localhost:26012)] DEBUG
> org.apache.zookeeper.ClientCnxn  - Got ping response for sessionid:
> 0x14dbdef0d8a0004 after 1ms
> 548270 [main-SendThread(localhost:26012)] DEBUG
> org.apache.zookeeper.ClientCnxn  - Got ping response for sessionid:
> 0x14dbdef0d8a0004 after 1ms
> 554944 [main-SendThread(localhost:26012)] DEBUG
> org.apache.zookeeper.ClientCnxn  - Got ping response for sessionid:
> 0x14dbdef0d8a0004 after 1ms
> 561616 [main-SendThread(localhost:26012)] DEBUG
> org.apache.zookeeper.ClientCnxn  - Got ping response for sessionid:
> 0x14dbdef0d8a0004 after 0ms
> 568289 [main-SendThread(localhost:26012)] DEBUG
> org.apache.zookeeper.ClientCnxn  - Got ping response for sessionid:
> 0x14dbdef0d8a0004 after 1ms
> 574958 [main-SendThread(localhost:26012)] DEBUG
> org.apache.zookeeper.ClientCnxn  - Got ping response for sessionid:
> 0x14dbdef0d8a0004 after 0ms
> 581627 [main-SendThread(localhost:26012)] DEBUG
> org.apache.zookeeper.ClientCnxn  - Got ping response for sessionid:
> 0x14dbdef0d8a0004 after 1ms
>
>
>    Thanks and best regard,
>    Shiju
>    ------------------------------------------------------
>    Shi Ju, Xie
>    InfoSphere BigInsights, IBM China Software Development Laboratory
>    Address: 28,ZhongGuanCun Software Park,No.8 Dong Bei Wang West Road,
>    Haidian District Beijing P.R.China 100193
>
>    Phone: +86 10 82450799
>    e-mail: xieshiju@cn.ibm.com
>    ------------------------------------------------------
>
>

Mime
View raw message