sqoop-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Louis Mau (JIRA)" <j...@apache.org>
Subject [jira] [Created] (SQOOP-1251) Sqoop job performing Incremental import hangs after the successful import
Date Thu, 05 Dec 2013 18:32:35 GMT
Louis Mau created SQOOP-1251:
--------------------------------

             Summary: Sqoop job performing Incremental import hangs after the successful import
                 Key: SQOOP-1251
                 URL: https://issues.apache.org/jira/browse/SQOOP-1251
             Project: Sqoop
          Issue Type: Bug
          Components: metastore
    Affects Versions: 1.4.3
            Reporter: Louis Mau


To reproduce the problem, create an incremental import job.
$SQOOP_HOME/bin/sqoop job --create mergetest -- import --options-file sqoop-params.txt --table
mergetest --incremental lastmodified --check-column lastmod -m 1
In subsequent "exec", the import completed successfully but the process  hung.

It appears that hsqldb v1.8 used in the metastore only allows "a single session at a time
performs an SQL statement completely, before the next session is allowed access."    In this
scenario, the JobTool created a session to retrieve the previously saved Job info and the
ImportTool created a separate connection for saving incremental info.    Adding a connection.rollback()
call in the read(String jobName) method of  HsqldbJobStorage.java eliminated the hang.   Upgrading
hsqldb to v2.0 might also resolve the problem.



--
This message was sent by Atlassian JIRA
(v6.1#6144)

Mime
View raw message