sqoop-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Anna Szonyi (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SQOOP-3136) Sqoop should work well with not default file systems
Date Mon, 27 Feb 2017 12:58:45 GMT

    [ https://issues.apache.org/jira/browse/SQOOP-3136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15885723#comment-15885723

Anna Szonyi commented on SQOOP-3136:

Hey [~yalovyyi],

Understandable, most of the time so do I, unfortunately Sqoop still supports/uses Java 7 -
we are planning to propose a switch to java 8 in the near future (that will have to be a community
decision), in the mean time we're stuck with 7. We have source and target enforcements in
 ant, though it is to enforce the related syntax more than the compiler/compilation itself

[~maugli] added a small patch to remove the offending method, so there is not much else to
do :).

Thanks again for the contribution!


> Sqoop should work well with not default file systems
> ----------------------------------------------------
>                 Key: SQOOP-3136
>                 URL: https://issues.apache.org/jira/browse/SQOOP-3136
>             Project: Sqoop
>          Issue Type: Improvement
>          Components: connectors/hdfs
>    Affects Versions: 1.4.5
>            Reporter: Illya Yalovyy
>            Assignee: Illya Yalovyy
>         Attachments: SQOOP-3136.patch
> Currently Sqoop assumes default file system when it comes to IO operations. It makes
it hard to use other FileSystem implementations as source or destination. Here is an example:
> {code}
> sqoop import --connect <JDBC CONNECTION> --table table1 --driver <JDBC DRIVER>
--username root --password **** --delete-target-dir --target-dir s3a://some-bucket/tmp/sqoop
> ...
> 17/02/15 19:16:59 ERROR tool.ImportTool: Imported Failed: Wrong FS: s3a://some-bucket/tmp/sqoop,
expected: hdfs://<DNS>:8020
> {code}

This message was sent by Atlassian JIRA

View raw message