sqoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Shi Ju SJ Xie <xiesh...@cn.ibm.com>
Subject ask for help about two testcase failed for sqoop 1.4.6 UT on xlinux
Date Thu, 04 Jun 2015 09:59:14 GMT


Hi All,
Sorry to bug your guys!

When I run all testcase in my environment using command:  ant clean
-Dhadoopversion=200 -Dhbaseprofile=95 test,
below two testcases always failed with timeout,
    ...
    [junit] Running org.apache.sqoop.accumulo.TestAccumuloImport
    [junit] Running org.apache.sqoop.accumulo.TestAccumuloImport
    [junit] Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed:
0 sec
    [junit] Test org.apache.sqoop.accumulo.TestAccumuloImport FAILED
(timeout)
    [junit] Running org.apache.sqoop.accumulo.TestAccumuloQueryImport
    [junit] Running org.apache.sqoop.accumulo.TestAccumuloQueryImport
    [junit] Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed:
0 sec
    [junit] Test org.apache.sqoop.accumulo.TestAccumuloQueryImport FAILED
(timeout)
...

1) Error log for TEST-org.apache.sqoop.accumulo.TestAccumuloImport.txt:

   Testsuite: org.apache.sqoop.accumulo.TestAccumuloImport
   Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 0 sec

   Testcase: testOverwriteSucceeds took 0.002 sec
   	Caused an ERROR
   Timeout occurred. Please note the time in the report does not reflect
   the time until the timeout.
   junit.framework.AssertionFailedError: Timeout occurred. Please note the
   time in the report does not reflect the time until the timeout.

2) Error log for
TEST-org.apache.sqoop.accumulo.TestAccumuloQueryImport.txt:

   Testsuite: org.apache.sqoop.accumulo.TestAccumuloQueryImport
   Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 0 sec

   Testcase: testImportFromQuery took 0 sec
   	Caused an ERROR
   Timeout occurred. Please note the time in the report does not reflect
   the time until the timeout.
   junit.framework.AssertionFailedError: Timeout occurred. Please note the
   time in the report does not reflect the time until the timeout.


If I run these two testcases respective, the error is same to above.

ant -Dhadoopversion=200 -Dhbaseprofile=95  -Dtestcase=TestAccumuloImport
test
ant -Dhadoopversion=200 -Dhbaseprofile=95
-Dtestcase=TestAccumuloQueryImport   test


I have also run it in eclipse environment, the error message like below:

414183 [main] INFO org.apache.zookeeper.ZooKeeper  - Client
environment:java.library.path=/usr/java/packages/lib/i386:/lib:/usr/lib
414183 [main] INFO org.apache.zookeeper.ZooKeeper  - Client
environment:java.io.tmpdir=/tmp
414183 [main] INFO org.apache.zookeeper.ZooKeeper  - Client
environment:java.compiler=<NA>
414183 [main] INFO org.apache.zookeeper.ZooKeeper  - Client
environment:os.name=Linux
414184 [main] INFO org.apache.zookeeper.ZooKeeper  - Client
environment:os.arch=i386
414184 [main] INFO org.apache.zookeeper.ZooKeeper  - Client
environment:os.version=2.6.32-504.16.2.el6.x86_64
414184 [main] INFO org.apache.zookeeper.ZooKeeper  - Client
environment:user.name=xieshiju
414184 [main] INFO org.apache.zookeeper.ZooKeeper  - Client
environment:user.home=/home/xieshiju
414184 [main] INFO org.apache.zookeeper.ZooKeeper  - Client
environment:user.dir=/home/xieshiju/sqoop-IBM/sqoop1.4.6/BI/sqoop
414189 [main] INFO org.apache.zookeeper.ZooKeeper  - Initiating client
connection, connectString=localhost:26012 sessionTimeout=30000
watcher=org.apache.accumulo.fate.zookeeper.ZooSession$ZooWatcher@12f060a
414204 [main] DEBUG org.apache.zookeeper.ClientCnxn  -
zookeeper.disableAutoWatchReset is false
414272 [main-SendThread(localhost:26012)] INFO
org.apache.zookeeper.ClientCnxn  - Opening socket connection to server
localhost/127.0.0.1:26012. Will not attempt to authenticate using SASL
(unknown error)
414282 [main-SendThread(localhost:26012)] INFO
org.apache.zookeeper.ClientCnxn  - Socket connection established to
localhost/127.0.0.1:26012, initiating session
414284 [main-SendThread(localhost:26012)] DEBUG
org.apache.zookeeper.ClientCnxn  - Session establishment request sent on
localhost/127.0.0.1:26012
414309 [main-SendThread(localhost:26012)] INFO
org.apache.zookeeper.ClientCnxn  - Session establishment complete on server
localhost/127.0.0.1:26012, sessionid = 0x14dbdef0d8a0004, negotiated
timeout = 20000
414408 [main-SendThread(localhost:26012)] DEBUG
org.apache.zookeeper.ClientCnxn  - Reading reply
sessionid:0x14dbdef0d8a0004, packet:: clientPath:null serverPath:null
finished:false header:: 1,3  replyHeader:: 1,95,0  request::
'/accumulo/instances/miniInstance,T  response:: s
{4,4,1433410671436,1433410671436,0,0,0,0,36,0,4}
414422 [main-SendThread(localhost:26012)] DEBUG
org.apache.zookeeper.ClientCnxn  - Reading reply
sessionid:0x14dbdef0d8a0004, packet:: clientPath:null serverPath:null
finished:false header:: 2,4  replyHeader:: 2,95,0  request::
'/accumulo/instances/miniInstance,T  response::
#66346232383838322d366133632d346235392d626239322d643333393564343230633734,s
{4,4,1433410671436,1433410671436,0,0,0,0,36,0,4}
414449 [main-SendThread(localhost:26012)] DEBUG
org.apache.zookeeper.ClientCnxn  - Reading reply
sessionid:0x14dbdef0d8a0004, packet:: clientPath:null serverPath:null
finished:false header:: 3,3  replyHeader:: 3,95,0  request::
'/accumulo/f4b28882-6a3c-4b59-bb92-d3395d420c74,T  response:: s
{5,5,1433410671446,1433410671446,0,16,0,0,0,16,89}
414451 [main-SendThread(localhost:26012)] DEBUG
org.apache.zookeeper.ClientCnxn  - Reading reply
sessionid:0x14dbdef0d8a0004, packet:: clientPath:null serverPath:null
finished:false header:: 4,4  replyHeader:: 4,95,0  request::
'/accumulo/f4b28882-6a3c-4b59-bb92-d3395d420c74,T  response:: ,s
{5,5,1433410671446,1433410671446,0,16,0,0,0,16,89}
414800 [main-SendThread(localhost:26012)] DEBUG
org.apache.zookeeper.ClientCnxn  - Reading reply
sessionid:0x14dbdef0d8a0004, packet:: clientPath:null serverPath:null
finished:false header:: 5,8  replyHeader:: 5,95,0  request::
'/accumulo/f4b28882-6a3c-4b59-bb92-d3395d420c74/tservers,T  response:: v
{'127.0.0.1:14840,'127.0.0.1:14839}
414802 [main-SendThread(localhost:26012)] DEBUG
org.apache.zookeeper.ClientCnxn  - Reading reply
sessionid:0x14dbdef0d8a0004, packet:: clientPath:null serverPath:null
finished:false header:: 6,8  replyHeader:: 6,95,0  request::
'/accumulo/f4b28882-6a3c-4b59-bb92-d3395d420c74/tservers/127.0.0.1:14840,T
response:: v{'zlock-0000000000}
414804 [main-SendThread(localhost:26012)] DEBUG
org.apache.zookeeper.ClientCnxn  - Reading reply
sessionid:0x14dbdef0d8a0004, packet:: clientPath:null serverPath:null
finished:false header:: 7,3  replyHeader:: 7,95,0  request::
'/accumulo/f4b28882-6a3c-4b59-bb92-d3395d420c74/tservers/127.0.0.1:14840/zlock-0000000000,T
  response:: s
{93,93,1433410678752,1433410678752,0,0,0,93940001666629634,28,0,93}
414806 [main-SendThread(localhost:26012)] DEBUG
org.apache.zookeeper.ClientCnxn  - Reading reply
sessionid:0x14dbdef0d8a0004, packet:: clientPath:null serverPath:null
finished:false header:: 8,4  replyHeader:: 8,95,0  request::
'/accumulo/f4b28882-6a3c-4b59-bb92-d3395d420c74/tservers/127.0.0.1:14840/zlock-0000000000,T
  response:: #54534552565f434c49454e543d3132372e302e302e313a3134383430,s
{93,93,1433410678752,1433410678752,0,0,0,93940001666629634,28,0,93}
414832 [main-SendThread(localhost:26012)] DEBUG
org.apache.zookeeper.ClientCnxn  - Reading reply
sessionid:0x14dbdef0d8a0004, packet:: clientPath:null serverPath:null
finished:false header:: 9,8  replyHeader:: 9,95,0  request::
'/accumulo/f4b28882-6a3c-4b59-bb92-d3395d420c74/tservers/127.0.0.1:14839,T
response:: v{'zlock-0000000000}
414834 [main-SendThread(localhost:26012)] DEBUG
org.apache.zookeeper.ClientCnxn  - Reading reply
sessionid:0x14dbdef0d8a0004, packet:: clientPath:null serverPath:null
finished:false header:: 10,3  replyHeader:: 10,95,0  request::
'/accumulo/f4b28882-6a3c-4b59-bb92-d3395d420c74/tservers/127.0.0.1:14839/zlock-0000000000,T
  response:: s
{83,83,1433410677582,1433410677582,0,0,0,93940001666629633,28,0,83}
414837 [main-SendThread(localhost:26012)] DEBUG
org.apache.zookeeper.ClientCnxn  - Reading reply
sessionid:0x14dbdef0d8a0004, packet:: clientPath:null serverPath:null
finished:false header:: 11,4  replyHeader:: 11,95,0  request::
'/accumulo/f4b28882-6a3c-4b59-bb92-d3395d420c74/tservers/127.0.0.1:14839/zlock-0000000000,T
  response:: #54534552565f434c49454e543d3132372e302e302e313a3134383339,s
{83,83,1433410677582,1433410677582,0,0,0,93940001666629633,28,0,83}
421511 [main-SendThread(localhost:26012)] DEBUG
org.apache.zookeeper.ClientCnxn  - Got ping response for sessionid:
0x14dbdef0d8a0004 after 1ms
428182 [main-SendThread(localhost:26012)] DEBUG
org.apache.zookeeper.ClientCnxn  - Got ping response for sessionid:
0x14dbdef0d8a0004 after 1ms
434856 [main-SendThread(localhost:26012)] DEBUG
org.apache.zookeeper.ClientCnxn  - Got ping response for sessionid:
0x14dbdef0d8a0004 after 1ms
441523 [main-SendThread(localhost:26012)] DEBUG
org.apache.zookeeper.ClientCnxn  - Got ping response for sessionid:
0x14dbdef0d8a0004 after 1ms
448196 [main-SendThread(localhost:26012)] DEBUG
org.apache.zookeeper.ClientCnxn  - Got ping response for sessionid:
0x14dbdef0d8a0004 after 1ms
454866 [main-SendThread(localhost:26012)] DEBUG
org.apache.zookeeper.ClientCnxn  - Got ping response for sessionid:
0x14dbdef0d8a0004 after 1ms
461540 [main-SendThread(localhost:26012)] DEBUG
org.apache.zookeeper.ClientCnxn  - Got ping response for sessionid:
0x14dbdef0d8a0004 after 2ms
468214 [main-SendThread(localhost:26012)] DEBUG
org.apache.zookeeper.ClientCnxn  - Got ping response for sessionid:
0x14dbdef0d8a0004 after 1ms
474886 [main-SendThread(localhost:26012)] DEBUG
org.apache.zookeeper.ClientCnxn  - Got ping response for sessionid:
0x14dbdef0d8a0004 after 0ms
481552 [main-SendThread(localhost:26012)] DEBUG
org.apache.zookeeper.ClientCnxn  - Got ping response for sessionid:
0x14dbdef0d8a0004 after 0ms
488225 [main-SendThread(localhost:26012)] DEBUG
org.apache.zookeeper.ClientCnxn  - Got ping response for sessionid:
0x14dbdef0d8a0004 after 1ms
494897 [main-SendThread(localhost:26012)] DEBUG
org.apache.zookeeper.ClientCnxn  - Got ping response for sessionid:
0x14dbdef0d8a0004 after 0ms
501571 [main-SendThread(localhost:26012)] DEBUG
org.apache.zookeeper.ClientCnxn  - Got ping response for sessionid:
0x14dbdef0d8a0004 after 1ms
508244 [main-SendThread(localhost:26012)] DEBUG
org.apache.zookeeper.ClientCnxn  - Got ping response for sessionid:
0x14dbdef0d8a0004 after 0ms
514911 [main-SendThread(localhost:26012)] DEBUG
org.apache.zookeeper.ClientCnxn  - Got ping response for sessionid:
0x14dbdef0d8a0004 after 1ms
521584 [main-SendThread(localhost:26012)] DEBUG
org.apache.zookeeper.ClientCnxn  - Got ping response for sessionid:
0x14dbdef0d8a0004 after 1ms
528253 [main-SendThread(localhost:26012)] DEBUG
org.apache.zookeeper.ClientCnxn  - Got ping response for sessionid:
0x14dbdef0d8a0004 after 1ms
534927 [main-SendThread(localhost:26012)] DEBUG
org.apache.zookeeper.ClientCnxn  - Got ping response for sessionid:
0x14dbdef0d8a0004 after 1ms
535206 [main] DEBUG org.apache.accumulo.core.client.impl.ServerClient  -
ClientService request failed 127.0.0.1:14840:9997, retrying ...
org.apache.thrift.transport.TTransportException:
java.net.SocketTimeoutException: 120000 millis timeout while waiting for
channel to be ready for read. ch : java.nio.channels.SocketChannel
[connected local=/127.0.0.1:53044 remote=/127.0.0.1:14840]
	at org.apache.thrift.transport.TIOStreamTransport.read
(TIOStreamTransport.java:129)
	at org.apache.thrift.transport.TTransport.readAll(TTransport.java:86)
	at org.apache.thrift.transport.TFramedTransport.readFrame
(TFramedTransport.java:129)
	at org.apache.thrift.transport.TFramedTransport.read
(TFramedTransport.java:101)
	at org.apache.thrift.transport.TTransport.readAll(TTransport.java:86)
	at org.apache.accumulo.core.client.impl.ThriftTransportPool
$CachedTTransport.readAll(ThriftTransportPool.java:253)
	at org.apache.thrift.protocol.TCompactProtocol.readByte
(TCompactProtocol.java:634)
	at org.apache.thrift.protocol.TCompactProtocol.readMessageBegin
(TCompactProtocol.java:501)
	at org.apache.thrift.TServiceClient.receiveBase
(TServiceClient.java:69)
	at org.apache.accumulo.core.client.impl.thrift.ClientService
$Client.recv_authenticate(ClientService.java:444)
	at org.apache.accumulo.core.client.impl.thrift.ClientService
$Client.authenticate(ClientService.java:430)
	at org.apache.accumulo.core.client.impl.ConnectorImpl$1.execute
(ConnectorImpl.java:67)
	at org.apache.accumulo.core.client.impl.ConnectorImpl$1.execute
(ConnectorImpl.java:64)
	at org.apache.accumulo.core.client.impl.ServerClient.executeRaw
(ServerClient.java:108)
	at org.apache.accumulo.core.client.impl.ServerClient.execute
(ServerClient.java:71)
	at org.apache.accumulo.core.client.impl.ConnectorImpl.<init>
(ConnectorImpl.java:64)
	at org.apache.accumulo.core.client.ZooKeeperInstance.getConnector
(ZooKeeperInstance.java:227)
	at org.apache.accumulo.core.client.ZooKeeperInstance.getConnector
(ZooKeeperInstance.java:222)
	at org.apache.sqoop.mapreduce.AccumuloImportJob.jobSetup
(AccumuloImportJob.java:168)
	at org.apache.sqoop.mapreduce.ImportJobBase.runImport
(ImportJobBase.java:264)
	at org.apache.sqoop.manager.SqlManager.importTable
(SqlManager.java:676)
	at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:497)
	at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:605)
	at org.apache.sqoop.Sqoop.run(Sqoop.java:143)
	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
	at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:179)
	at com.cloudera.sqoop.Sqoop.runSqoop(Sqoop.java:45)
	at com.cloudera.sqoop.testutil.ImportJobTestCase.runImport
(ImportJobTestCase.java:219)
	at com.cloudera.sqoop.testutil.ImportJobTestCase.runImport
(ImportJobTestCase.java:234)
	at org.apache.sqoop.accumulo.TestAccumuloImport.testOverwriteSucceeds
(TestAccumuloImport.java:64)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke
(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke
(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at junit.framework.TestCase.runTest(TestCase.java:176)
	at junit.framework.TestCase.runBare(TestCase.java:141)
	at junit.framework.TestResult$1.protect(TestResult.java:122)
	at junit.framework.TestResult.runProtected(TestResult.java:142)
	at junit.framework.TestResult.run(TestResult.java:125)
	at junit.framework.TestCase.run(TestCase.java:129)
	at junit.framework.TestSuite.runTest(TestSuite.java:255)
	at junit.framework.TestSuite.run(TestSuite.java:250)
	at org.junit.internal.runners.JUnit38ClassRunner.run
(JUnit38ClassRunner.java:84)
	at org.eclipse.jdt.internal.junit4.runner.JUnit4TestReference.run
(JUnit4TestReference.java:50)
	at org.eclipse.jdt.internal.junit.runner.TestExecution.run
(TestExecution.java:38)
	at org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.runTests
(RemoteTestRunner.java:459)
	at org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.runTests
(RemoteTestRunner.java:675)
	at org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.run
(RemoteTestRunner.java:382)
	at org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.main
(RemoteTestRunner.java:192)
Caused by: java.net.SocketTimeoutException: 120000 millis timeout while
waiting for channel to be ready for read. ch :
java.nio.channels.SocketChannel[connected local=/127.0.0.1:53044
remote=/127.0.0.1:14840]
	at org.apache.hadoop.net.SocketIOWithTimeout.doIO
(SocketIOWithTimeout.java:164)
	at org.apache.hadoop.net.SocketInputStream.read
(SocketInputStream.java:161)
	at org.apache.hadoop.net.SocketInputStream.read
(SocketInputStream.java:131)
	at java.io.FilterInputStream.read(FilterInputStream.java:133)
	at java.io.BufferedInputStream.fill(BufferedInputStream.java:235)
	at java.io.BufferedInputStream.read1(BufferedInputStream.java:275)
	at java.io.BufferedInputStream.read(BufferedInputStream.java:334)
	at org.apache.thrift.transport.TIOStreamTransport.read
(TIOStreamTransport.java:127)
	... 48 more
541599 [main-SendThread(localhost:26012)] DEBUG
org.apache.zookeeper.ClientCnxn  - Got ping response for sessionid:
0x14dbdef0d8a0004 after 1ms
548270 [main-SendThread(localhost:26012)] DEBUG
org.apache.zookeeper.ClientCnxn  - Got ping response for sessionid:
0x14dbdef0d8a0004 after 1ms
554944 [main-SendThread(localhost:26012)] DEBUG
org.apache.zookeeper.ClientCnxn  - Got ping response for sessionid:
0x14dbdef0d8a0004 after 1ms
561616 [main-SendThread(localhost:26012)] DEBUG
org.apache.zookeeper.ClientCnxn  - Got ping response for sessionid:
0x14dbdef0d8a0004 after 0ms
568289 [main-SendThread(localhost:26012)] DEBUG
org.apache.zookeeper.ClientCnxn  - Got ping response for sessionid:
0x14dbdef0d8a0004 after 1ms
574958 [main-SendThread(localhost:26012)] DEBUG
org.apache.zookeeper.ClientCnxn  - Got ping response for sessionid:
0x14dbdef0d8a0004 after 0ms
581627 [main-SendThread(localhost:26012)] DEBUG
org.apache.zookeeper.ClientCnxn  - Got ping response for sessionid:
0x14dbdef0d8a0004 after 1ms


Thanks and best regard,
Shiju
------------------------------------------------------
Shi Ju, Xie
InfoSphere BigInsights, IBM China Software Development Laboratory
Address: 28,ZhongGuanCun Software Park,No.8 Dong Bei Wang West Road,
Haidian District Beijing P.R.China 100193

Phone: +86 10 82450799
e-mail: xieshiju@cn.ibm.com
------------------------------------------------------
Mime
View raw message