sqoop-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Venkat Ranganathan (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SQOOP-3158) Columns added to Mysql after initial sqoop import, export back to table with same schema fails
Date Fri, 16 Jun 2017 17:51:00 GMT

    [ https://issues.apache.org/jira/browse/SQOOP-3158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16052185#comment-16052185
] 

Venkat Ranganathan commented on SQOOP-3158:
-------------------------------------------

Let us make sure we add a configuration property to enable this feature.   This is a backward
compatibility issue when we ad nulls silently which might not be expected in workflows

> Columns added to Mysql after initial sqoop import, export back to table with same schema
fails 
> -----------------------------------------------------------------------------------------------
>
>                 Key: SQOOP-3158
>                 URL: https://issues.apache.org/jira/browse/SQOOP-3158
>             Project: Sqoop
>          Issue Type: Improvement
>    Affects Versions: 1.4.6
>            Reporter: viru reddy
>            Assignee: Eric Lin
>              Labels: newbie
>             Fix For: 1.4.7
>
>         Attachments: SQOOP-3158.2.patch, SQOOP-3158.3.patch, SQOOP-3158.4.patch, SQOOP-3158.patch
>
>
> I have table in MySQL with 2 columns until yesterday. The columns are id and name.
> 1,Raj
> 2,Jack
> I have imported this data into HDFS yesterday itself as a file. Today we added a new
column to the table in MySQL called salary. The table looks like below.
> 1,Raj
> 2,Jack
> 3,Jill,2000
> 4,Nick,3000
> Now I have done Incremental import on this table as a file.
> Part-m-00000 file contains
> 1,Raj
> 2,Jack
> Part-m-00001 file contains
> 3,Jill,2000
> 4,Nick,3000
> Now I created a new table in MySQL with same schema as Original MySQL table with columns
id name and salary.
> When I do sqoop export only last 2 rows are getting inserted to the new table in MySQL
 and the sqoop export fails
> How can I reflect all the rows to be inserted to the table.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message