sqoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Shi Ju SJ Xie <xiesh...@cn.ibm.com>
Subject Re: ask for help about two testcase failed for sqoop 1.4.6 UT on xlinux
Date Wed, 10 Jun 2015 15:39:14 GMT

Hi abe,

Thanks for you reply.
I have solve it using accumulo 1.6.1.
Maybe no release for 1.5.0... I am not very sure...


Thanks and best regard,
Shiju
------------------------------------------------------
Shi Ju, Xie
InfoSphere BigInsights, IBM China Software Development Laboratory
Address: 28,ZhongGuanCun Software Park,No.8 Dong Bei Wang West Road,
Haidian District Beijing P.R.China 100193

Phone: +86 10 82450799
e-mail: xieshiju@cn.ibm.com
------------------------------------------------------



From:	Abraham Elmahrek <abe@cloudera.com>
To:	"user@sqoop.apache.org" <user@sqoop.apache.org>
Date:	06/10/2015 06:25 PM
Subject:	Re: ask for help about two testcase failed for sqoop 1.4.6 UT
            on xlinux



Hey man,

Silly question... but do you have accumulo installed?

On Thu, Jun 4, 2015 at 12:59 PM, Shi Ju SJ Xie <xieshiju@cn.ibm.com> wrote:
  Hi All,
  Sorry to bug your guys!

  When I run all testcase in my environment using command:  ant clean
  -Dhadoopversion=200 -Dhbaseprofile=95 test,
  below two testcases always failed with timeout,
      ...
      [junit] Running org.apache.sqoop.accumulo.TestAccumuloImport
      [junit] Running org.apache.sqoop.accumulo.TestAccumuloImport
      [junit] Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time
  elapsed: 0 sec
      [junit] Test org.apache.sqoop.accumulo.TestAccumuloImport FAILED
  (timeout)
      [junit] Running org.apache.sqoop.accumulo.TestAccumuloQueryImport
      [junit] Running org.apache.sqoop.accumulo.TestAccumuloQueryImport
      [junit] Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time
  elapsed: 0 sec
      [junit] Test org.apache.sqoop.accumulo.TestAccumuloQueryImport FAILED
  (timeout)
  ...

  1) Error log for TEST-org.apache.sqoop.accumulo.TestAccumuloImport.txt:


        Testsuite: org.apache.sqoop.accumulo.TestAccumuloImport
        Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 0
        sec

        Testcase: testOverwriteSucceeds took 0.002 sec
        Caused an ERROR
        Timeout occurred. Please note the time in the report does not
        reflect the time until the timeout.
        junit.framework.AssertionFailedError: Timeout occurred. Please note
        the time in the report does not reflect the time until the timeout.

  2) Error log for
  TEST-org.apache.sqoop.accumulo.TestAccumuloQueryImport.txt:
        Testsuite: org.apache.sqoop.accumulo.TestAccumuloQueryImport
        Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 0
        sec

        Testcase: testImportFromQuery took 0 sec
        Caused an ERROR
        Timeout occurred. Please note the time in the report does not
        reflect the time until the timeout.
        junit.framework.AssertionFailedError: Timeout occurred. Please note
        the time in the report does not reflect the time until the timeout.


  If I run these two testcases respective, the error is same to above.

  ant -Dhadoopversion=200 -Dhbaseprofile=95  -Dtestcase=TestAccumuloImport
  test
  ant -Dhadoopversion=200 -Dhbaseprofile=95
  -Dtestcase=TestAccumuloQueryImport   test


  I have also run it in eclipse environment, the error message like below:
  Inactive hide details for error message:error message:
  414183 [main] INFO org.apache.zookeeper.ZooKeeper  - Client
  environment:java.library.path=/usr/java/packages/lib/i386:/lib:/usr/lib
  414183 [main] INFO org.apache.zookeeper.ZooKeeper  - Client
  environment:java.io.tmpdir=/tmp
  414183 [main] INFO org.apache.zookeeper.ZooKeeper  - Client
  environment:java.compiler=<NA>
  414183 [main] INFO org.apache.zookeeper.ZooKeeper  - Client environment:
  os.name=Linux
  414184 [main] INFO org.apache.zookeeper.ZooKeeper  - Client
  environment:os.arch=i386
  414184 [main] INFO org.apache.zookeeper.ZooKeeper  - Client
  environment:os.version=2.6.32-504.16.2.el6.x86_64
  414184 [main] INFO org.apache.zookeeper.ZooKeeper  - Client environment:
  user.name=xieshiju
  414184 [main] INFO org.apache.zookeeper.ZooKeeper  - Client
  environment:user.home=/home/xieshiju
  414184 [main] INFO org.apache.zookeeper.ZooKeeper  - Client
  environment:user.dir=/home/xieshiju/sqoop-IBM/sqoop1.4.6/BI/sqoop
  414189 [main] INFO org.apache.zookeeper.ZooKeeper  - Initiating client
  connection, connectString=localhost:26012 sessionTimeout=30000
  watcher=org.apache.accumulo.fate.zookeeper.ZooSession$ZooWatcher@12f060a
  414204 [main] DEBUG org.apache.zookeeper.ClientCnxn  -
  zookeeper.disableAutoWatchReset is false
  414272 [main-SendThread(localhost:26012)] INFO
  org.apache.zookeeper.ClientCnxn  - Opening socket connection to server
  localhost/127.0.0.1:26012. Will not attempt to authenticate using SASL
  (unknown error)
  414282 [main-SendThread(localhost:26012)] INFO
  org.apache.zookeeper.ClientCnxn  - Socket connection established to
  localhost/127.0.0.1:26012, initiating session
  414284 [main-SendThread(localhost:26012)] DEBUG
  org.apache.zookeeper.ClientCnxn  - Session establishment request sent on
  localhost/127.0.0.1:26012
  414309 [main-SendThread(localhost:26012)] INFO
  org.apache.zookeeper.ClientCnxn  - Session establishment complete on
  server localhost/127.0.0.1:26012, sessionid = 0x14dbdef0d8a0004,
  negotiated timeout = 20000
  414408 [main-SendThread(localhost:26012)] DEBUG
  org.apache.zookeeper.ClientCnxn  - Reading reply
  sessionid:0x14dbdef0d8a0004, packet:: clientPath:null serverPath:null
  finished:false header:: 1,3  replyHeader:: 1,95,0  request::
  '/accumulo/instances/miniInstance,T  response:: s
  {4,4,1433410671436,1433410671436,0,0,0,0,36,0,4}
  414422 [main-SendThread(localhost:26012)] DEBUG
  org.apache.zookeeper.ClientCnxn  - Reading reply
  sessionid:0x14dbdef0d8a0004, packet:: clientPath:null serverPath:null
  finished:false header:: 2,4  replyHeader:: 2,95,0  request::
  '/accumulo/instances/miniInstance,T  response::
  #66346232383838322d366133632d346235392d626239322d643333393564343230633734,s
{4,4,1433410671436,1433410671436,0,0,0,0,36,0,4}
  414449 [main-SendThread(localhost:26012)] DEBUG
  org.apache.zookeeper.ClientCnxn  - Reading reply
  sessionid:0x14dbdef0d8a0004, packet:: clientPath:null serverPath:null
  finished:false header:: 3,3  replyHeader:: 3,95,0  request::
  '/accumulo/f4b28882-6a3c-4b59-bb92-d3395d420c74,T  response:: s
  {5,5,1433410671446,1433410671446,0,16,0,0,0,16,89}
  414451 [main-SendThread(localhost:26012)] DEBUG
  org.apache.zookeeper.ClientCnxn  - Reading reply
  sessionid:0x14dbdef0d8a0004, packet:: clientPath:null serverPath:null
  finished:false header:: 4,4  replyHeader:: 4,95,0  request::
  '/accumulo/f4b28882-6a3c-4b59-bb92-d3395d420c74,T  response:: ,s
  {5,5,1433410671446,1433410671446,0,16,0,0,0,16,89}
  414800 [main-SendThread(localhost:26012)] DEBUG
  org.apache.zookeeper.ClientCnxn  - Reading reply
  sessionid:0x14dbdef0d8a0004, packet:: clientPath:null serverPath:null
  finished:false header:: 5,8  replyHeader:: 5,95,0  request::
  '/accumulo/f4b28882-6a3c-4b59-bb92-d3395d420c74/tservers,T  response:: v
  {'127.0.0.1:14840,'127.0.0.1:14839}
  414802 [main-SendThread(localhost:26012)] DEBUG
  org.apache.zookeeper.ClientCnxn  - Reading reply
  sessionid:0x14dbdef0d8a0004, packet:: clientPath:null serverPath:null
  finished:false header:: 6,8  replyHeader:: 6,95,0  request::
  '/accumulo/f4b28882-6a3c-4b59-bb92-d3395d420c74/tservers/127.0.0.1:14840
  ,T  response:: v{'zlock-0000000000}
  414804 [main-SendThread(localhost:26012)] DEBUG
  org.apache.zookeeper.ClientCnxn  - Reading reply
  sessionid:0x14dbdef0d8a0004, packet:: clientPath:null serverPath:null
  finished:false header:: 7,3  replyHeader:: 7,95,0  request::
  '/accumulo/f4b28882-6a3c-4b59-bb92-d3395d420c74/tservers/
  127.0.0.1:14840/zlock-0000000000,T  response:: s
  {93,93,1433410678752,1433410678752,0,0,0,93940001666629634,28,0,93}
  414806 [main-SendThread(localhost:26012)] DEBUG
  org.apache.zookeeper.ClientCnxn  - Reading reply
  sessionid:0x14dbdef0d8a0004, packet:: clientPath:null serverPath:null
  finished:false header:: 8,4  replyHeader:: 8,95,0  request::
  '/accumulo/f4b28882-6a3c-4b59-bb92-d3395d420c74/tservers/
  127.0.0.1:14840/zlock-0000000000,T  response::
  #54534552565f434c49454e543d3132372e302e302e313a3134383430,s
  {93,93,1433410678752,1433410678752,0,0,0,93940001666629634,28,0,93}
  414832 [main-SendThread(localhost:26012)] DEBUG
  org.apache.zookeeper.ClientCnxn  - Reading reply
  sessionid:0x14dbdef0d8a0004, packet:: clientPath:null serverPath:null
  finished:false header:: 9,8  replyHeader:: 9,95,0  request::
  '/accumulo/f4b28882-6a3c-4b59-bb92-d3395d420c74/tservers/127.0.0.1:14839
  ,T  response:: v{'zlock-0000000000}
  414834 [main-SendThread(localhost:26012)] DEBUG
  org.apache.zookeeper.ClientCnxn  - Reading reply
  sessionid:0x14dbdef0d8a0004, packet:: clientPath:null serverPath:null
  finished:false header:: 10,3  replyHeader:: 10,95,0  request::
  '/accumulo/f4b28882-6a3c-4b59-bb92-d3395d420c74/tservers/
  127.0.0.1:14839/zlock-0000000000,T  response:: s
  {83,83,1433410677582,1433410677582,0,0,0,93940001666629633,28,0,83}
  414837 [main-SendThread(localhost:26012)] DEBUG
  org.apache.zookeeper.ClientCnxn  - Reading reply
  sessionid:0x14dbdef0d8a0004, packet:: clientPath:null serverPath:null
  finished:false header:: 11,4  replyHeader:: 11,95,0  request::
  '/accumulo/f4b28882-6a3c-4b59-bb92-d3395d420c74/tservers/
  127.0.0.1:14839/zlock-0000000000,T  response::
  #54534552565f434c49454e543d3132372e302e302e313a3134383339,s
  {83,83,1433410677582,1433410677582,0,0,0,93940001666629633,28,0,83}
  421511 [main-SendThread(localhost:26012)] DEBUG
  org.apache.zookeeper.ClientCnxn  - Got ping response for sessionid:
  0x14dbdef0d8a0004 after 1ms
  428182 [main-SendThread(localhost:26012)] DEBUG
  org.apache.zookeeper.ClientCnxn  - Got ping response for sessionid:
  0x14dbdef0d8a0004 after 1ms
  434856 [main-SendThread(localhost:26012)] DEBUG
  org.apache.zookeeper.ClientCnxn  - Got ping response for sessionid:
  0x14dbdef0d8a0004 after 1ms
  441523 [main-SendThread(localhost:26012)] DEBUG
  org.apache.zookeeper.ClientCnxn  - Got ping response for sessionid:
  0x14dbdef0d8a0004 after 1ms
  448196 [main-SendThread(localhost:26012)] DEBUG
  org.apache.zookeeper.ClientCnxn  - Got ping response for sessionid:
  0x14dbdef0d8a0004 after 1ms
  454866 [main-SendThread(localhost:26012)] DEBUG
  org.apache.zookeeper.ClientCnxn  - Got ping response for sessionid:
  0x14dbdef0d8a0004 after 1ms
  461540 [main-SendThread(localhost:26012)] DEBUG
  org.apache.zookeeper.ClientCnxn  - Got ping response for sessionid:
  0x14dbdef0d8a0004 after 2ms
  468214 [main-SendThread(localhost:26012)] DEBUG
  org.apache.zookeeper.ClientCnxn  - Got ping response for sessionid:
  0x14dbdef0d8a0004 after 1ms
  474886 [main-SendThread(localhost:26012)] DEBUG
  org.apache.zookeeper.ClientCnxn  - Got ping response for sessionid:
  0x14dbdef0d8a0004 after 0ms
  481552 [main-SendThread(localhost:26012)] DEBUG
  org.apache.zookeeper.ClientCnxn  - Got ping response for sessionid:
  0x14dbdef0d8a0004 after 0ms
  488225 [main-SendThread(localhost:26012)] DEBUG
  org.apache.zookeeper.ClientCnxn  - Got ping response for sessionid:
  0x14dbdef0d8a0004 after 1ms
  494897 [main-SendThread(localhost:26012)] DEBUG
  org.apache.zookeeper.ClientCnxn  - Got ping response for sessionid:
  0x14dbdef0d8a0004 after 0ms
  501571 [main-SendThread(localhost:26012)] DEBUG
  org.apache.zookeeper.ClientCnxn  - Got ping response for sessionid:
  0x14dbdef0d8a0004 after 1ms
  508244 [main-SendThread(localhost:26012)] DEBUG
  org.apache.zookeeper.ClientCnxn  - Got ping response for sessionid:
  0x14dbdef0d8a0004 after 0ms
  514911 [main-SendThread(localhost:26012)] DEBUG
  org.apache.zookeeper.ClientCnxn  - Got ping response for sessionid:
  0x14dbdef0d8a0004 after 1ms
  521584 [main-SendThread(localhost:26012)] DEBUG
  org.apache.zookeeper.ClientCnxn  - Got ping response for sessionid:
  0x14dbdef0d8a0004 after 1ms
  528253 [main-SendThread(localhost:26012)] DEBUG
  org.apache.zookeeper.ClientCnxn  - Got ping response for sessionid:
  0x14dbdef0d8a0004 after 1ms
  534927 [main-SendThread(localhost:26012)] DEBUG
  org.apache.zookeeper.ClientCnxn  - Got ping response for sessionid:
  0x14dbdef0d8a0004 after 1ms
  535206 [main] DEBUG org.apache.accumulo.core.client.impl.ServerClient  -
  ClientService request failed 127.0.0.1:14840:9997, retrying ...
  org.apache.thrift.transport.TTransportException:
  java.net.SocketTimeoutException: 120000 millis timeout while waiting for
  channel to be ready for read. ch : java.nio.channels.SocketChannel
  [connected local=/127.0.0.1:53044 remote=/127.0.0.1:14840]
  at org.apache.thrift.transport.TIOStreamTransport.read
  (TIOStreamTransport.java:129)
  at org.apache.thrift.transport.TTransport.readAll(TTransport.java:86)
  at org.apache.thrift.transport.TFramedTransport.readFrame
  (TFramedTransport.java:129)
  at org.apache.thrift.transport.TFramedTransport.read
  (TFramedTransport.java:101)
  at org.apache.thrift.transport.TTransport.readAll(TTransport.java:86)
  at org.apache.accumulo.core.client.impl.ThriftTransportPool
  $CachedTTransport.readAll(ThriftTransportPool.java:253)
  at org.apache.thrift.protocol.TCompactProtocol.readByte
  (TCompactProtocol.java:634)
  at org.apache.thrift.protocol.TCompactProtocol.readMessageBegin
  (TCompactProtocol.java:501)
  at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:69)
  at org.apache.accumulo.core.client.impl.thrift.ClientService
  $Client.recv_authenticate(ClientService.java:444)
  at org.apache.accumulo.core.client.impl.thrift.ClientService
  $Client.authenticate(ClientService.java:430)
  at org.apache.accumulo.core.client.impl.ConnectorImpl$1.execute
  (ConnectorImpl.java:67)
  at org.apache.accumulo.core.client.impl.ConnectorImpl$1.execute
  (ConnectorImpl.java:64)
  at org.apache.accumulo.core.client.impl.ServerClient.executeRaw
  (ServerClient.java:108)
  at org.apache.accumulo.core.client.impl.ServerClient.execute
  (ServerClient.java:71)
  at org.apache.accumulo.core.client.impl.ConnectorImpl.<init>
  (ConnectorImpl.java:64)
  at org.apache.accumulo.core.client.ZooKeeperInstance.getConnector
  (ZooKeeperInstance.java:227)
  at org.apache.accumulo.core.client.ZooKeeperInstance.getConnector
  (ZooKeeperInstance.java:222)
  at org.apache.sqoop.mapreduce.AccumuloImportJob.jobSetup
  (AccumuloImportJob.java:168)
  at org.apache.sqoop.mapreduce.ImportJobBase.runImport
  (ImportJobBase.java:264)
  at org.apache.sqoop.manager.SqlManager.importTable(SqlManager.java:676)
  at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:497)
  at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:605)
  at org.apache.sqoop.Sqoop.run(Sqoop.java:143)
  at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
  at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:179)
  at com.cloudera.sqoop.Sqoop.runSqoop(Sqoop.java:45)
  at com.cloudera.sqoop.testutil.ImportJobTestCase.runImport
  (ImportJobTestCase.java:219)
  at com.cloudera.sqoop.testutil.ImportJobTestCase.runImport
  (ImportJobTestCase.java:234)
  at org.apache.sqoop.accumulo.TestAccumuloImport.testOverwriteSucceeds
  (TestAccumuloImport.java:64)
  at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
  at sun.reflect.NativeMethodAccessorImpl.invoke
  (NativeMethodAccessorImpl.java:57)
  at sun.reflect.DelegatingMethodAccessorImpl.invoke
  (DelegatingMethodAccessorImpl.java:43)
  at java.lang.reflect.Method.invoke(Method.java:606)
  at junit.framework.TestCase.runTest(TestCase.java:176)
  at junit.framework.TestCase.runBare(TestCase.java:141)
  at junit.framework.TestResult$1.protect(TestResult.java:122)
  at junit.framework.TestResult.runProtected(TestResult.java:142)
  at junit.framework.TestResult.run(TestResult.java:125)
  at junit.framework.TestCase.run(TestCase.java:129)
  at junit.framework.TestSuite.runTest(TestSuite.java:255)
  at junit.framework.TestSuite.run(TestSuite.java:250)
  at org.junit.internal.runners.JUnit38ClassRunner.run
  (JUnit38ClassRunner.java:84)
  at org.eclipse.jdt.internal.junit4.runner.JUnit4TestReference.run
  (JUnit4TestReference.java:50)
  at org.eclipse.jdt.internal.junit.runner.TestExecution.run
  (TestExecution.java:38)
  at org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.runTests
  (RemoteTestRunner.java:459)
  at org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.runTests
  (RemoteTestRunner.java:675)
  at org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.run
  (RemoteTestRunner.java:382)
  at org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.main
  (RemoteTestRunner.java:192)
  Caused by: java.net.SocketTimeoutException: 120000 millis timeout while
  waiting for channel to be ready for read. ch :
  java.nio.channels.SocketChannel[connected local=/127.0.0.1:53044 remote=/
  127.0.0.1:14840]
  at org.apache.hadoop.net.SocketIOWithTimeout.doIO
  (SocketIOWithTimeout.java:164)
  at org.apache.hadoop.net.SocketInputStream.read
  (SocketInputStream.java:161)
  at org.apache.hadoop.net.SocketInputStream.read
  (SocketInputStream.java:131)
  at java.io.FilterInputStream.read(FilterInputStream.java:133)
  at java.io.BufferedInputStream.fill(BufferedInputStream.java:235)
  at java.io.BufferedInputStream.read1(BufferedInputStream.java:275)
  at java.io.BufferedInputStream.read(BufferedInputStream.java:334)
  at org.apache.thrift.transport.TIOStreamTransport.read
  (TIOStreamTransport.java:127)
  ... 48 more
  541599 [main-SendThread(localhost:26012)] DEBUG
  org.apache.zookeeper.ClientCnxn  - Got ping response for sessionid:
  0x14dbdef0d8a0004 after 1ms
  548270 [main-SendThread(localhost:26012)] DEBUG
  org.apache.zookeeper.ClientCnxn  - Got ping response for sessionid:
  0x14dbdef0d8a0004 after 1ms
  554944 [main-SendThread(localhost:26012)] DEBUG
  org.apache.zookeeper.ClientCnxn  - Got ping response for sessionid:
  0x14dbdef0d8a0004 after 1ms
  561616 [main-SendThread(localhost:26012)] DEBUG
  org.apache.zookeeper.ClientCnxn  - Got ping response for sessionid:
  0x14dbdef0d8a0004 after 0ms
  568289 [main-SendThread(localhost:26012)] DEBUG
  org.apache.zookeeper.ClientCnxn  - Got ping response for sessionid:
  0x14dbdef0d8a0004 after 1ms
  574958 [main-SendThread(localhost:26012)] DEBUG
  org.apache.zookeeper.ClientCnxn  - Got ping response for sessionid:
  0x14dbdef0d8a0004 after 0ms
  581627 [main-SendThread(localhost:26012)] DEBUG
  org.apache.zookeeper.ClientCnxn  - Got ping response for sessionid:
  0x14dbdef0d8a0004 after 1ms

        Thanks and best regard,
        Shiju
        ------------------------------------------------------
        Shi Ju, Xie
        InfoSphere BigInsights, IBM China Software Development Laboratory
        Address: 28,ZhongGuanCun Software Park,No.8 Dong Bei Wang West
        Road, Haidian District Beijing P.R.China 100193

        Phone: +86 10 82450799
        e-mail: xieshiju@cn.ibm.com
        ------------------------------------------------------





Mime
View raw message