sqoop-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Abraham Elmahrek (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (SQOOP-1821) External connector loading in Sqoop2
Date Wed, 14 Jan 2015 22:28:35 GMT

     [ https://issues.apache.org/jira/browse/SQOOP-1821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Abraham Elmahrek updated SQOOP-1821:
------------------------------------
    Attachment: hbase-connector.jar

[~vybs] a couple of thoughts:
# Class.forName will use the calling classes class loader. So, in places we use {{Class.forName}},
we won't use the proper class loader.
# There's an NPE potential in ConnectorManager.java#L120. It's possible for {{getConnectors}}
to return null, so that the for loop will error out with NPE.
# I'm not 100% of the usage of class loader here, let's try it out with the fake hbase connector
I've attached.

> External connector loading in Sqoop2
> ------------------------------------
>
>                 Key: SQOOP-1821
>                 URL: https://issues.apache.org/jira/browse/SQOOP-1821
>             Project: Sqoop
>          Issue Type: Bug
>    Affects Versions: 1.99.5
>            Reporter: Veena Basavaraj
>            Assignee: Veena Basavaraj
>             Fix For: 1.99.5
>
>         Attachments: SQOOP-1821-v1.patch, SQOOP-1821-v2.patch, SQOOP-1821.patch, hbase-connector.jar,
test-connector.jar, test-non-connector.jar
>
>
> Edit this wiki to begin with
> https://cwiki.apache.org/confluence/display/SQOOP/Setting+up+Sqoop+2#SettingupSqoop2-InstallinganewconnectortoSqoop2
> Also, add the same to the .rst of need be
> relevant code that loads all connectors 
> https://github.com/apache/sqoop/blob/sqoop2/core/src/main/java/org/apache/sqoop/connector/ConnectorManagerUtils.java#L44
> NOTE : External contributors had issues with getting a new sqoop connector working seamlessly
with the Sqoop2. They had to do some hacks to include this new jar into the class path. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message