hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From GitBox <...@apache.org>
Subject [GitHub] [hadoop] mehakmeet commented on pull request #2950: HADOOP-17471. ABFS to collect IOStatistics (#2731)
Date Sat, 24 Apr 2021 03:17:08 GMT

mehakmeet commented on pull request #2950:
URL: https://github.com/apache/hadoop/pull/2950#issuecomment-826025696


   Tested using: mvn -T 16 -Dparallel-tests=abfs clean verify
   Region: East US
   
   ```
   [ERROR] Errors:
   [ERROR]   ITestAbfsFileSystemContractDistCp>AbstractContractDistCpTest.testDistCpWithIterator:631
» TestTimedOut
   [INFO]
   [ERROR] Tests run: 260, Failures: 0, Errors: 1, Skipped: 79
   ```
   Got a fairly consistent Timeout error also seen in base.
   
   ```
   [ERROR] Errors:
   [ERROR]   ITestAzureBlobFileSystemCheckAccess.testCheckAccessForNonExistentFile »  Unexp...
   [ERROR]   ITestAzureBlobFileSystemCheckAccess.testFsActionALL:293->checkPrerequisites:306->setTestUserFs:88->checkIfConfigIsSet:319
» IllegalArgument
   [ERROR]   ITestAzureBlobFileSystemCheckAccess.testFsActionEXECUTE:218->checkPrerequisites:306->setTestUserFs:88->checkIfConfigIsSet:319
» IllegalArgument
   [ERROR]   ITestAzureBlobFileSystemCheckAccess.testFsActionNONE:204->checkPrerequisites:306->setTestUserFs:88->checkIfConfigIsSet:319
» IllegalArgument
   [ERROR]   ITestAzureBlobFileSystemCheckAccess.testFsActionREAD:233->checkPrerequisites:306->setTestUserFs:88->checkIfConfigIsSet:319
» IllegalArgument
   [ERROR]   ITestAzureBlobFileSystemCheckAccess.testFsActionREADEXECUTE:263->checkPrerequisites:306->setTestUserFs:88->checkIfConfigIsSet:319
» IllegalArgument
   [ERROR]   ITestAzureBlobFileSystemCheckAccess.testFsActionWRITE:248->checkPrerequisites:306->setTestUserFs:88->checkIfConfigIsSet:319
» IllegalArgument
   [ERROR]   ITestAzureBlobFileSystemCheckAccess.testFsActionWRITEEXECUTE:278->checkPrerequisites:306->setTestUserFs:88->checkIfConfigIsSet:319
» IllegalArgument
   [INFO]
   [ERROR] Tests run: 526, Failures: 0, Errors: 8, Skipped: 67
   ```
   IllegalArgument failures due to no configs for OAuth. 
   
   One more error that I see intermittently on mvn is: 
   ```
   [ERROR] Tests run: 3, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 1.71 s <<<
FAILURE! - in org.apache.hadoop.fs.azurebfs.ITestAbfsRestOperationException
   [ERROR] testCustomTokenFetchRetryCount(org.apache.hadoop.fs.azurebfs.ITestAbfsRestOperationException)
 Time elapsed: 1.22 s  <<< FAILURE!
   java.lang.AssertionError: Number of token fetch retries (4) done, does not match with fs.azure.custom.token.fetch.retry.count
configured (0)
   	at org.junit.Assert.fail(Assert.java:89)
   	at org.junit.Assert.assertTrue(Assert.java:42)
   	at org.apache.hadoop.fs.azurebfs.ITestAbfsRestOperationException.testWithDifferentCustomTokenFetchRetry(ITestAbfsRestOperationException.java:122)
   	at org.apache.hadoop.fs.azurebfs.ITestAbfsRestOperationException.testCustomTokenFetchRetryCount(ITestAbfsRestOperationException.java:93)
   	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
   	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
   	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   	at java.lang.reflect.Method.invoke(Method.java:498)
   	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
   	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
   	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
   	at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
   	at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
   	at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
   	at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:61)
   	at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:288)
   	at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:282)
   	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
   	at java.lang.Thread.run(Thread.java:748)
   ```
   I never see this in IDE so wasn't able to debug. I see this same error in branch-3.3 so
this is not due to my changes. Don't see it in trunk as well. One weird thing to note here
is when I use ```mvn -X``` to see debug logs for this test, it never fails. Don't know if
this is a known issue or not.
   
   CC: @steveloughran 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org


Mime
View raw message