hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chu Tong (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-9692) sequencefile reader throws EOFException on zero-length file
Date Wed, 03 Jul 2013 17:36:20 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-9692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13699223#comment-13699223
] 

Chu Tong commented on HADOOP-9692:
----------------------------------

There are two kinds of exception can be thrown here: IOException and EOFException, and both
of them are because of the file can't be read correctly. Depending on how fine grind we want
to go to, we can treat them both as file reading error or only catch EOFException and throws
IOException. 
                
> sequencefile reader throws EOFException on zero-length file
> -----------------------------------------------------------
>
>                 Key: HADOOP-9692
>                 URL: https://issues.apache.org/jira/browse/HADOOP-9692
>             Project: Hadoop Common
>          Issue Type: Bug
>    Affects Versions: 2.0.3-alpha, 2.1.0-beta, 2.0.5-alpha
>            Reporter: Chu Tong
>         Attachments: HADOOP-9692.patch, HADOOP-9692.patch, HADOOP-9692.patch, HADOOP-9692.patch
>
>
> sequencefile reader throws EOFException on zero-length file, stacktrace as shown:
> Caused by: java.io.EOFException
>         at java.io.DataInputStream.readFully(DataInputStream.java:180)
>         at java.io.DataInputStream.readFully(DataInputStream.java:152)
>         at org.apache.hadoop.io.SequenceFile$Reader.init(SequenceFile.java:1845)
>         at org.apache.hadoop.io.SequenceFile$Reader.initialize(SequenceFile.java:1810)
>         at org.apache.hadoop.io.SequenceFile$Reader.<init>(SequenceFile.java:1759)
>         at org.apache.hadoop.io.SequenceFile$Reader.<init>(SequenceFile.java:1773)
>         at org.apache.hadoop.mapred.SequenceFileRecordReader.<init>(SequenceFileRecordReader.java:49)
>         at org.apache.hadoop.mapred.SequenceFileInputFormat.getRecordReader(SequenceFileInputFormat.java:64)
>         at org.apache.hadoop.hive.ql.io.CombineHiveRecordReader.<init>(CombineHiveRecordReader.java:65)
>         ... 16 more

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message