sqoop-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chris McConnell (JIRA)" <j...@apache.org>
Subject [jira] [Created] (SQOOP-527) Improve process for collecting metadata from database during job creation
Date Tue, 31 Jul 2012 15:59:34 GMT
Chris McConnell created SQOOP-527:
-------------------------------------

             Summary: Improve process for collecting metadata from database during job creation
                 Key: SQOOP-527
                 URL: https://issues.apache.org/jira/browse/SQOOP-527
             Project: Sqoop
          Issue Type: Improvement
          Components: connectors
            Reporter: Chris McConnell
            Priority: Minor


When executing an import, under certain situations Sqoop will execute metadata look-up queries
twice through the org.apache.sqoop.manager.SQLManager class. 

For example, imports from Teradata through a specified JDBC driver (com.teradata.jdbc.TeraDriver)
will execute the user SQL twice, appending "(1=0)." Query sample: SELECT col1, col2 FROM table
WHERE col1> x AND (1=0)

This is only done at job setup time, not during the MR import. 

Determine if the logic flow can be changed to only make this call once, updating the required
data objects. While impact on the exporting DB should be minimal, it is not guaranteed.



--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Mime
View raw message