sqoop-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jarek Jarcec Cecho (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SQOOP-2282) Add validation check for --hive-import and --append
Date Fri, 31 Jul 2015 15:27:04 GMT

    [ https://issues.apache.org/jira/browse/SQOOP-2282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14649331#comment-14649331
] 

Jarek Jarcec Cecho commented on SQOOP-2282:
-------------------------------------------

Thanks for the feedback  [~p5k6@yahoo.com] and [~aaditya.prodigy].

I've looked into the combination of incremental import and hive import at the same time and
those two features are indeed not designed to work together as well. The variant of incremental
{{append}} mode "happens" to work, but the {{lastmodified}} variant won't work at all. Hence
I think that we were "lucky" before and hence the check do seems to make sense.

I still do not like that we broke the production use cases, so would it make sense to add
a check that will re-enable the combination of {{append}} incremental job and hive import
and effectively promotes this combination as first class (and hence supported) citizen?

> Add validation check for --hive-import and --append
> ---------------------------------------------------
>
>                 Key: SQOOP-2282
>                 URL: https://issues.apache.org/jira/browse/SQOOP-2282
>             Project: Sqoop
>          Issue Type: Bug
>            Reporter: Abraham Elmahrek
>            Assignee: Abraham Elmahrek
>             Fix For: 1.4.6
>
>         Attachments: SQOOP-2282.patch
>
>
> They don't work together currently. Though, it seems easy to add.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message