falcon-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Pallavi Rao (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (FALCON-1469) Flaky EntityManagerJerseyIT#testDuplicateSubmitCommands
Date Fri, 18 Sep 2015 16:29:04 GMT

    [ https://issues.apache.org/jira/browse/FALCON-1469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14875892#comment-14875892
] 

Pallavi Rao commented on FALCON-1469:
-------------------------------------

Root cause:
testDuplicateSubmitCommands invokes TestContext.submitToFalcon() method in 2 separate concurrent
threads. The submitToFalcon method not just makes a REST API call to the Falcon server, but
also, deletes staging/working directories and recreates them before making the rest call.

While one of the threads submits to the Falcon Server and the server is uploading libs to
working dir, the second thread deletes the staging and working dir. That is when the error
is seen.

> Flaky EntityManagerJerseyIT#testDuplicateSubmitCommands
> -------------------------------------------------------
>
>                 Key: FALCON-1469
>                 URL: https://issues.apache.org/jira/browse/FALCON-1469
>             Project: Falcon
>          Issue Type: Sub-task
>            Reporter: Ajay Yadava
>
> testDuplicateSubmitCommands(org.apache.falcon.resource.EntityManagerJerseyIT)  Time elapsed:
0.705 sec  <<< FAILURE!
> java.util.concurrent.ExecutionException: java.io.IOException: Unable to setup cluster
info
>         at java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:252)
>         at java.util.concurrent.FutureTask.get(FutureTask.java:111)
>         at org.apache.falcon.resource.EntityManagerJerseyIT.testDuplicateSubmitCommands(EntityManagerJerseyIT.java:596)
> Caused by: java.io.IOException: Unable to setup cluster info
>         at org.apache.falcon.resource.TestContext.submitToFalcon(TestContext.java:358)
>         at org.apache.falcon.resource.TestContext.submitToFalcon(TestContext.java:345)
>         at org.apache.falcon.resource.EntityManagerJerseyIT$SubmitCommand.call(EntityManagerJerseyIT.java:1022)
>         at org.apache.falcon.resource.EntityManagerJerseyIT$SubmitCommand.call(EntityManagerJerseyIT.java:1003)
>         at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
>         at java.util.concurrent.FutureTask.run(FutureTask.java:166)
>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
>         at java.lang.Thread.run(Thread.java:722)
> Caused by: java.lang.RuntimeException: Error while running command to get file permissions
: ExitCodeException exitCode=2: /bin/ls: cannot access <https://builds.apache.org/job/Apache-falcon/ws/webapp/target/tmp-hadoop-jenkins/jail-fs/global/projects/falcon/staging>:
No such file or directory
>         at org.apache.hadoop.util.Shell.runCommand(Shell.java:538)
>         at org.apache.hadoop.util.Shell.run(Shell.java:455)
>         at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:702)
>         at org.apache.hadoop.util.Shell.execCommand(Shell.java:791)
>         at org.apache.hadoop.util.Shell.execCommand(Shell.java:774)
>         at org.apache.hadoop.fs.FileUtil.execCommand(FileUtil.java:1097)
>         at org.apache.hadoop.fs.RawLocalFileSystem$DeprecatedRawLocalFileStatus.loadPermissionInfo(RawLocalFileSystem.java:572)
>         at org.apache.hadoop.fs.RawLocalFileSystem$DeprecatedRawLocalFileStatus.getPermission(RawLocalFileSystem.java:547)
>         at org.apache.falcon.hadoop.JailedFileSystem.getFileStatus(JailedFileSystem.java:185)
>         at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:1398)
>         at org.apache.falcon.resource.TestContext.deleteClusterLocations(TestContext.java:367)
>         at org.apache.falcon.resource.TestContext.submitToFalcon(TestContext.java:355)
>         at org.apache.falcon.resource.TestContext.submitToFalcon(TestContext.java:345)
>         at org.apache.falcon.resource.EntityManagerJerseyIT$SubmitCommand.call(EntityManagerJerseyIT.java:1022)
>         at org.apache.falcon.resource.EntityManagerJerseyIT$SubmitCommand.call(EntityManagerJerseyIT.java:1003)
>         at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
>         at java.util.concurrent.FutureTask.run(FutureTask.java:166)
>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
>         at java.lang.Thread.run(Thread.java:722)
>         at org.apache.hadoop.fs.RawLocalFileSystem$DeprecatedRawLocalFileStatus.loadPermissionInfo(RawLocalFileSystem.java:610)
>         at org.apache.hadoop.fs.RawLocalFileSystem$DeprecatedRawLocalFileStatus.getPermission(RawLocalFileSystem.java:547)
>         at org.apache.falcon.hadoop.JailedFileSystem.getFileStatus(JailedFileSystem.java:185)
>         at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:1398)
>         at org.apache.falcon.resource.TestContext.deleteClusterLocations(TestContext.java:367)
>         at org.apache.falcon.resource.TestContext.submitToFalcon(TestContext.java:355)
>         at org.apache.falcon.resource.TestContext.submitToFalcon(TestContext.java:345)
>         at org.apache.falcon.resource.EntityManagerJerseyIT$SubmitCommand.call(EntityManagerJerseyIT.java:1022)
>         at org.apache.falcon.resource.EntityManagerJerseyIT$SubmitCommand.call(EntityManagerJerseyIT.java:1003)
>         at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
>         at java.util.concurrent.FutureTask.run(FutureTask.java:166)
>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
>         at java.lang.Thread.run(Thread.java:722)
> Running org.apache.falcon.resource.EntityManagerJerseySmokeIT



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message