hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Tsz Wo (Nicholas), SZE (JIRA)" <j...@apache.org>
Subject [jira] Updated: (HADOOP-6564) HarFileSystem cannot handle har:///
Date Sat, 13 Feb 2010 02:36:27 GMT

     [ https://issues.apache.org/jira/browse/HADOOP-6564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Tsz Wo (Nicholas), SZE updated HADOOP-6564:
-------------------------------------------

    Description: 
{noformat}
-bash-3.1$ hadoop jar examples.jar wordcount -Dmapred.job.queue.name=${JOBQ}  har:///user/tsz/t10_4.har/t10_4
t10_4_har_wc
java.io.IOException: No FileSystem for scheme: namenode_hostname
        at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:1375)
        at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:66)
        at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1390)
        at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:196)
        at org.apache.hadoop.fs.HarFileSystem.initialize(HarFileSystem.java:104)
        at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:1378)
        at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:193)
        at org.apache.hadoop.fs.Path.getFileSystem(Path.java:175)
        at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.listStatus(FileInputFormat.java:203)
        ...
{noformat}

  was:
{noformat}
-bash-3.1$ hadoop jar examples.jar wordcount -Dmapred.job.queue.name=${JOBQ}  har:///user/tsz/t10_4.har/t10_4
t10_4_har_wc
java.io.IOException: No FileSystem for scheme: namenode_hostname
        at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:1375)
        at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:66)
        at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1390)
        at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:196)
        at org.apache.hadoop.fs.HarFileSystem.initialize(HarFileSystem.java:104)
        at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:1378)
        at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:193)
        at org.apache.hadoop.fs.Path.getFileSystem(Path.java:175)
        at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.listStatus(FileInputFormat.java:203)
        at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.getSplits(FileInputFormat.java:241)
        at org.apache.hadoop.mapred.JobClient.writeNewSplits(JobClient.java:885)
        at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:779)
        at org.apache.hadoop.mapreduce.Job.submit(Job.java:444)
        at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:459)
        at org.apache.hadoop.examples.WordCount.main(WordCount.java:67)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:68)
        at org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:139)
        at org.apache.hadoop.examples.ExampleDriver.main(ExampleDriver.java:72)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
{noformat}

        Summary: HarFileSystem cannot handle har:///  (was: archive uses namenode hostname
as FileSystem scheme.)

Moved this from MapReduce to Common since this is a fs issue.

> HarFileSystem cannot handle har:///
> -----------------------------------
>
>                 Key: HADOOP-6564
>                 URL: https://issues.apache.org/jira/browse/HADOOP-6564
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: fs
>            Reporter: Tsz Wo (Nicholas), SZE
>            Assignee: Mahadev konar
>             Fix For: 0.22.0
>
>
> {noformat}
> -bash-3.1$ hadoop jar examples.jar wordcount -Dmapred.job.queue.name=${JOBQ}  har:///user/tsz/t10_4.har/t10_4
t10_4_har_wc
> java.io.IOException: No FileSystem for scheme: namenode_hostname
>         at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:1375)
>         at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:66)
>         at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1390)
>         at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:196)
>         at org.apache.hadoop.fs.HarFileSystem.initialize(HarFileSystem.java:104)
>         at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:1378)
>         at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:193)
>         at org.apache.hadoop.fs.Path.getFileSystem(Path.java:175)
>         at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.listStatus(FileInputFormat.java:203)
>         ...
> {noformat}

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


Mime
View raw message