sqoop-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jarek Jarcec Cecho (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SQOOP-2997) --password-file option triggers FileSystemClosed exception at end of Oozie action
Date Mon, 22 Aug 2016 16:56:25 GMT

    [ https://issues.apache.org/jira/browse/SQOOP-2997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15431185#comment-15431185
] 

Jarek Jarcec Cecho commented on SQOOP-2997:
-------------------------------------------

I've added you to the contributors list [~jordirodri] and you should be able to self-assign
the JIRA to yourself now.

Any PMC member should have privileges to new add contributors in our JIRA project.

> --password-file option triggers FileSystemClosed exception at end of Oozie action
> ---------------------------------------------------------------------------------
>
>                 Key: SQOOP-2997
>                 URL: https://issues.apache.org/jira/browse/SQOOP-2997
>             Project: Sqoop
>          Issue Type: Bug
>    Affects Versions: 1.4.6
>         Environment: Java 1.8 + CDH5.5.1
>            Reporter: Jordi
>
> When using  the --password-file option triggers FileSystemClosed exception at end of
Oozie action.
> This error was fixed for FilePasswordLoader class for sqoop-1.4.3, but it is also happening
at CryptoFileLoader which extends from the fixed one.
> https://issues.apache.org/jira/browse/SQOOP-1226
> In this case we are using --password-file option with an encrypted file so we need to
use CryptoFileLoder.
> Error LOG:
> Job commit failed: java.io.IOException: Filesystem closed 
> at org.apache.hadoop.hdfs.DFSClient.checkOpen(DFSClient.java:837) 
> at org.apache.hadoop.hdfs.DFSClient.create(DFSClient.java:1720) 
> at org.apache.hadoop.hdfs.DFSClient.create(DFSClient.java:1662) 
> at org.apache.hadoop.hdfs.DistributedFileSystem$6.doCall(DistributedFileSystem.java:404)

> at org.apache.hadoop.hdfs.DistributedFileSystem$6.doCall(DistributedFileSystem.java:400)

> at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)

> at org.apache.hadoop.hdfs.DistributedFileSystem.create(DistributedFileSystem.java:400)

> at org.apache.hadoop.hdfs.DistributedFileSystem.create(DistributedFileSystem.java:343)

> at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:917) 
> at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:898) 
> at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:795) 
> at org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler$EventProcessor.touchz(CommitterEventHandler.java:265)

> at org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler$EventProcessor.handleJobCommit(CommitterEventHandler.java:271)

> at org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler$EventProcessor.run(CommitterEventHandler.java:237)

> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) 
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) 
> at java.lang.Thread.run(Thread.java:745) 
> Average Map Time 57sec



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message