hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Steve Loughran (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-9713) FSDataInputStream.readFully doesn't work on filesystems without seek -even when the offset==getPos
Date Tue, 09 Jul 2013 17:13:51 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-9713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13703513#comment-13703513
] 

Steve Loughran commented on HADOOP-9713:
----------------------------------------

A stack trace
{code}
estNoMkdirOverFile(org.apache.hadoop.fs.contract.ftp.TestFTPDirectoryContract)  Time elapsed:
928 sec  <<< ERROR!
java.io.IOException: Seek not supported
	at org.apache.hadoop.fs.ftp.FTPInputStream.seek(FTPInputStream.java:62)
	at org.apache.hadoop.fs.FSInputStream.read(FSInputStream.java:65)
	at org.apache.hadoop.fs.FSInputStream.readFully(FSInputStream.java:76)
	at org.apache.hadoop.fs.FSDataInputStream.readFully(FSDataInputStream.java:103)
	at org.apache.hadoop.fs.contract.ContractTestUtils.readDataset(ContractTestUtils.java:154)
	at org.apache.hadoop.fs.contract.AbstractDirectoryContractTest.testNoMkdirOverFile(AbstractDirectoryContractTest.java:71)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
	at java.lang.reflect.Method.invoke(Method.java:597)

{code}
                
> FSDataInputStream.readFully doesn't work on filesystems without seek -even when the offset==getPos
> --------------------------------------------------------------------------------------------------
>
>                 Key: HADOOP-9713
>                 URL: https://issues.apache.org/jira/browse/HADOOP-9713
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: fs
>    Affects Versions: 3.0.0, 2.1.0-beta, 1.3.0
>            Reporter: Steve Loughran
>            Priority: Minor
>
> {{FSDataInputStream.readFully(offset,data)}} doesn't work even if the offset==the current
location -because it always seeks to the offset and seeks back. No seek => Exception.
> We could optimise {{FSDataInputStream.readFully(offset,data)}} to eliminate the seeks
on these operations -which would have tangible benefits for those filesystems where seek is
expensive (remote blobstores). It would also let you use readFully against filesystems without
seeks, provided you are only reading from the current location.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message