sqoop-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jordi (JIRA)" <j...@apache.org>
Subject [jira] [Created] (SQOOP-2997) --password-file option triggers FileSystemClosed exception at end of Oozie action
Date Wed, 10 Aug 2016 14:17:20 GMT
Jordi created SQOOP-2997:
----------------------------

             Summary: --password-file option triggers FileSystemClosed exception at end of
Oozie action
                 Key: SQOOP-2997
                 URL: https://issues.apache.org/jira/browse/SQOOP-2997
             Project: Sqoop
          Issue Type: Bug
    Affects Versions: 1.4.6
         Environment: Java 1.8 + CDH5.5.1
            Reporter: Jordi


When using  the --password-file option triggers FileSystemClosed exception at end of Oozie
action.

This error was fixed for FilePasswordLoader class for sqoop-1.4.3, but it is also happening
at CryptoFileLoader which extends from the fixed one.

https://issues.apache.org/jira/browse/SQOOP-1226

In this case we are using --password-file option with an encrypted file so we need to use
CryptoFileLoder.

Error LOG:

Job commit failed: java.io.IOException: Filesystem closed 
at org.apache.hadoop.hdfs.DFSClient.checkOpen(DFSClient.java:837) 
at org.apache.hadoop.hdfs.DFSClient.create(DFSClient.java:1720) 
at org.apache.hadoop.hdfs.DFSClient.create(DFSClient.java:1662) 
at org.apache.hadoop.hdfs.DistributedFileSystem$6.doCall(DistributedFileSystem.java:404) 
at org.apache.hadoop.hdfs.DistributedFileSystem$6.doCall(DistributedFileSystem.java:400) 
at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) 
at org.apache.hadoop.hdfs.DistributedFileSystem.create(DistributedFileSystem.java:400) 
at org.apache.hadoop.hdfs.DistributedFileSystem.create(DistributedFileSystem.java:343) 
at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:917) 
at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:898) 
at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:795) 
at org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler$EventProcessor.touchz(CommitterEventHandler.java:265)

at org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler$EventProcessor.handleJobCommit(CommitterEventHandler.java:271)

at org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler$EventProcessor.run(CommitterEventHandler.java:237)

at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) 
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) 
at java.lang.Thread.run(Thread.java:745) 
Average Map Time 57sec




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message