sqoop-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Eric Lin (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (SQOOP-3158) Columns added to Mysql after initial sqoop import, export back to table with same schema fails
Date Sat, 15 Apr 2017 03:17:41 GMT

     [ https://issues.apache.org/jira/browse/SQOOP-3158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Eric Lin updated SQOOP-3158:
----------------------------
    Attachment: SQOOP-3158.patch

Attaching PATCH for this issue. Basically we need to check if there are more data for the
current row, and if nothing, assign "null" value to it, so that NULL value will be entered
into table.

However, if the column itself is defined as NOT NULL in MySQL, the export will still fail.
This should be expected.

> Columns added to Mysql after initial sqoop import, export back to table with same schema
fails 
> -----------------------------------------------------------------------------------------------
>
>                 Key: SQOOP-3158
>                 URL: https://issues.apache.org/jira/browse/SQOOP-3158
>             Project: Sqoop
>          Issue Type: Improvement
>            Reporter: viru reddy
>            Assignee: Eric Lin
>              Labels: newbie
>         Attachments: SQOOP-3158.patch
>
>
> I have table in MySQL with 2 columns until yesterday. The columns are id and name.
> 1,Raj
> 2,Jack
> I have imported this data into HDFS yesterday itself as a file. Today we added a new
column to the table in MySQL called salary. The table looks like below.
> 1,Raj
> 2,Jack
> 3,Jill,2000
> 4,Nick,3000
> Now I have done Incremental import on this table as a file.
> Part-m-00000 file contains
> 1,Raj
> 2,Jack
> Part-m-00001 file contains
> 3,Jill,2000
> 4,Nick,3000
> Now I created a new table in MySQL with same schema as Original MySQL table with columns
id name and salary.
> When I do sqoop export only last 2 rows are getting inserted to the new table in MySQL
 and the sqoop export fails
> How can I reflect all the rows to be inserted to the table.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message