sqoop-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SQOOP-934) JDBC Connection can timeout after import but before hive import
Date Thu, 20 Jun 2013 23:23:20 GMT

    [ https://issues.apache.org/jira/browse/SQOOP-934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13689833#comment-13689833
] 

Hudson commented on SQOOP-934:
------------------------------

Integrated in Sqoop-ant-jdk-1.6-hadoop200 #756 (See [https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop200/756/])
    SQOOP-934: JDBC Connection can timeout after import but before hive import (Revision 217e2af3f8aa0329d370240749afd01b1e36d1db)

     Result = SUCCESS
jarcec : https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=217e2af3f8aa0329d370240749afd01b1e36d1db
Files : 
* src/java/org/apache/sqoop/manager/ConnManager.java
* src/java/org/apache/sqoop/hive/HiveImport.java
* src/java/org/apache/sqoop/manager/GenericJdbcManager.java

                
> JDBC Connection can timeout after import but before hive import
> ---------------------------------------------------------------
>
>                 Key: SQOOP-934
>                 URL: https://issues.apache.org/jira/browse/SQOOP-934
>             Project: Sqoop
>          Issue Type: Improvement
>    Affects Versions: 1.4.2
>            Reporter: Jarek Jarcec Cecho
>            Assignee: Raghav Kumar Gautam
>             Fix For: 1.4.4
>
>         Attachments: SQOOP-934-2.patch, SQOOP-934.patch
>
>
> Our current [import rutine|https://github.com/apache/sqoop/blob/trunk/src/java/org/apache/sqoop/tool/ImportTool.java#L385]
imports data into HDFS and then tries to do Hive import. As the connection to the remote server
is opened only once at the begging it might timeout during very long mapreduce job. I believe
that we should ensure that the connection is still valid before performing the hive import.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message