sqoop-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Abraham Elmahrek (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (SQOOP-1821) External connector loading in Sqoop2
Date Wed, 14 Jan 2015 22:28:35 GMT

     [ https://issues.apache.org/jira/browse/SQOOP-1821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Abraham Elmahrek updated SQOOP-1821:
    Attachment: hbase-connector.jar

[~vybs] a couple of thoughts:
# Class.forName will use the calling classes class loader. So, in places we use {{Class.forName}},
we won't use the proper class loader.
# There's an NPE potential in ConnectorManager.java#L120. It's possible for {{getConnectors}}
to return null, so that the for loop will error out with NPE.
# I'm not 100% of the usage of class loader here, let's try it out with the fake hbase connector
I've attached.

> External connector loading in Sqoop2
> ------------------------------------
>                 Key: SQOOP-1821
>                 URL: https://issues.apache.org/jira/browse/SQOOP-1821
>             Project: Sqoop
>          Issue Type: Bug
>    Affects Versions: 1.99.5
>            Reporter: Veena Basavaraj
>            Assignee: Veena Basavaraj
>             Fix For: 1.99.5
>         Attachments: SQOOP-1821-v1.patch, SQOOP-1821-v2.patch, SQOOP-1821.patch, hbase-connector.jar,
test-connector.jar, test-non-connector.jar
> Edit this wiki to begin with
> https://cwiki.apache.org/confluence/display/SQOOP/Setting+up+Sqoop+2#SettingupSqoop2-InstallinganewconnectortoSqoop2
> Also, add the same to the .rst of need be
> relevant code that loads all connectors 
> https://github.com/apache/sqoop/blob/sqoop2/core/src/main/java/org/apache/sqoop/connector/ConnectorManagerUtils.java#L44
> NOTE : External contributors had issues with getting a new sqoop connector working seamlessly
with the Sqoop2. They had to do some hacks to include this new jar into the class path. 

This message was sent by Atlassian JIRA

View raw message