sqoop-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Veena Basavaraj (JIRA)" <j...@apache.org>
Subject [jira] [Created] (SQOOP-1856) Sqoop2: Handling failures ( Row and Field level ) in Sqoop
Date Mon, 08 Dec 2014 17:16:12 GMT
Veena Basavaraj created SQOOP-1856:

             Summary: Sqoop2: Handling failures ( Row and Field level ) in Sqoop
                 Key: SQOOP-1856
                 URL: https://issues.apache.org/jira/browse/SQOOP-1856
             Project: Sqoop
          Issue Type: Improvement
            Reporter: Veena Basavaraj

Skipping corrupted rows in Sqoop 

What is the proposed strategy for handling such scenarios in batch transfer?
Probably one of the below ..
1. Skip/ignore and still continue for good records
2. just bail out once we have a bad record?
3. have a threshold of how many bad rows we can tolerate? that is configurable.

Anand Iyer
1:25 AM (7 hours ago)

Sqoop is the most obvious place for the functionality discussed in this thread. But at some
point, we should start think about adding similar functionality (Policy Driven SLAs and Data
Validation) across all our tools.

This message was sent by Atlassian JIRA

View raw message