sqoop-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Illya Yalovyy (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SQOOP-3136) Sqoop should work well with not default file systems
Date Fri, 24 Feb 2017 16:38:44 GMT

    [ https://issues.apache.org/jira/browse/SQOOP-3136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15883043#comment-15883043

Illya Yalovyy commented on SQOOP-3136:


Thank you for checking the build.
It is interesting why ANT didn't enforce that limit. I run JDK 8.0 because java 1.7 has been
deprecated quite a long time ago and doesn't receive security updates.

Please let me know how you want to address that issue. Should I submit a new patch that corrects
this one, or just update this patch?

> Sqoop should work well with not default file systems
> ----------------------------------------------------
>                 Key: SQOOP-3136
>                 URL: https://issues.apache.org/jira/browse/SQOOP-3136
>             Project: Sqoop
>          Issue Type: Improvement
>          Components: connectors/hdfs
>    Affects Versions: 1.4.5
>            Reporter: Illya Yalovyy
>            Assignee: Illya Yalovyy
>         Attachments: SQOOP-3136.patch
> Currently Sqoop assumes default file system when it comes to IO operations. It makes
it hard to use other FileSystem implementations as source or destination. Here is an example:
> {code}
> sqoop import --connect <JDBC CONNECTION> --table table1 --driver <JDBC DRIVER>
--username root --password **** --delete-target-dir --target-dir s3a://some-bucket/tmp/sqoop
> ...
> 17/02/15 19:16:59 ERROR tool.ImportTool: Imported Failed: Wrong FS: s3a://some-bucket/tmp/sqoop,
expected: hdfs://<DNS>:8020
> {code}

This message was sent by Atlassian JIRA

View raw message