hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Steve Loughran (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-14710) Uber-JIRA: Support AWS Snowball
Date Fri, 01 Mar 2019 14:19:00 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-14710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16781709#comment-16781709

Steve Loughran commented on HADOOP-14710:

1: distcp now has a -direct option which avoids the copy
2. you need to enable path-style access and switch back to the v1 list API (there are options
for those)

bq. .if I use "s3a://xyz" instead (no back slash at the end), then the error is like: ls:
's3a://xyz': No such file or directory.

that's an irritating feature of the FS shell. If you don't have any path in the URL, it says
"your home directory", and so unless there's a /user/$myname path, 404. Create the path or
use trailing / entries. Nothing we can do to fix. I've thought about making the home dir of
a bucket "/", but that might break existing things. Sorry. it annoys us all. repeatedly

> Uber-JIRA: Support AWS Snowball
> -------------------------------
>                 Key: HADOOP-14710
>                 URL: https://issues.apache.org/jira/browse/HADOOP-14710
>             Project: Hadoop Common
>          Issue Type: New Feature
>          Components: fs/s3
>    Affects Versions: 2.8.0
>            Reporter: John Zhuge
>            Assignee: John Zhuge
>            Priority: Major
> Support data transfer between Hadoop and [AWS Snowball|http://docs.aws.amazon.com/snowball/latest/ug/whatissnowball.html].

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org

View raw message