sqoop-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "nemon lou (JIRA)" <j...@apache.org>
Subject [jira] [Created] (SQOOP-482) import tool for mysql direct mode reports wrong record number
Date Thu, 03 May 2012 09:08:53 GMT
nemon lou created SQOOP-482:

             Summary: import tool for mysql direct mode reports wrong record number
                 Key: SQOOP-482
                 URL: https://issues.apache.org/jira/browse/SQOOP-482
             Project: Sqoop
          Issue Type: Bug
          Components: connectors/mysql
    Affects Versions: 1.4.1-incubating
         Environment: hadoop 1.0.0
            Reporter: nemon lou
            Priority: Minor
             Fix For: 1.4.2-incubating

When run the sqoop import (via mysqldump) task :
sqoop import --connect jdbc:mysql://[ip]:3306/mysqlslap --table t1    --username root -P 
--hive-import --hive-overwrite   --hive-table tTable --verbose --direct -m 1
The console shows this(part of the log):
  12/05/02 16:21:16 INFO mapred.JobClient:     Map output records=6000594
  12/05/02 16:21:16 INFO mapreduce.ImportJobBase: Retrieved 6000594 records.
However,the real record number in mysql is 1000099.And the number of records in hive is  1000099
So only the console log report the wrong number.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira


View raw message