sqoop-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SQOOP-2971) OraOop does not close connections properly
Date Fri, 01 Jul 2016 23:34:11 GMT

    [ https://issues.apache.org/jira/browse/SQOOP-2971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15359830#comment-15359830

Hudson commented on SQOOP-2971:

FAILURE: Integrated in Sqoop-hadoop20 #1054 (See [https://builds.apache.org/job/Sqoop-hadoop20/1054/])
SQOOP-2971: OraOop does not close connections properly (Szabolcs Vasas (kathleen: [https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=7808c6bc3e7116534fb2bf83472c8fa8d2d8a0f4])
* src/test/org/apache/sqoop/manager/oracle/OraOopDataDrivenDBInputFormatConnectionCloseTest.java
* src/test/com/cloudera/sqoop/ThirdPartyTests.java
* src/java/org/apache/sqoop/mapreduce/db/DBInputFormat.java
* src/java/org/apache/sqoop/manager/oracle/OraOopDataDrivenDBInputFormat.java

> OraOop does not close connections properly
> ------------------------------------------
>                 Key: SQOOP-2971
>                 URL: https://issues.apache.org/jira/browse/SQOOP-2971
>             Project: Sqoop
>          Issue Type: Bug
>            Reporter: Attila Szabo
>            Assignee: Szabolcs Vasas
>             Fix For: 1.4.6, 1.4.7
>         Attachments: SQOOP-2971.patch, SQOOP-2971.patch
> When importing with OraOop for every mapper task two connections are created, and those
connections are not closed until the end of the import process, thus Sqoop use twice of the
necessary amount, and kinda leaks the expensive resources. This could cause problem when the
number of the connections is limited on the DB server side, however the user would like to
leverage from having more mappers (e.g. right now with 10 avail connections the user cannot
use 10 mappers, but instead only 4).
> Please provide a fix for this issue either by sharing the connection, or closing the
connections when they are not needed anymore.

This message was sent by Atlassian JIRA

View raw message