sqoop-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Veena Basavaraj (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SQOOP-1821) External connector loading in Sqoop2
Date Thu, 15 Jan 2015 00:39:35 GMT

    [ https://issues.apache.org/jira/browse/SQOOP-1821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14277987#comment-14277987
] 

Veena Basavaraj commented on SQOOP-1821:
----------------------------------------

[~abec] I was able to create a job with the external hbase jar and then start it. Its able
to find all the hbase related classses as I had suggested, It seems like there is a need to
include ClassNotFoundException: org.apache.hadoop.hbase.client.HBaseAdmin in the getJars method
of this connector, but I guess hbase is still WIP.

{code}
	java.security.AccessController.doPrivileged(Native Method)
	java.net.URLClassLoader.findClass(URLClassLoader.java:354)
	java.lang.ClassLoader.loadClass(ClassLoader.java:425)
	java.lang.ClassLoader.loadClass(ClassLoader.java:358)
	org.apache.sqoop.connector.hbase.HBaseExecutor.getAdmin(HBaseExecutor.java:61)
	org.apache.sqoop.connector.hbase.HBaseExecutor.tableExists(HBaseExecutor.java:195)
	org.apache.sqoop.connector.hbase.HBaseToInitializer.initialize(HBaseToInitializer.java:69)
	org.apache.sqoop.connector.hbase.HBaseToInitializer.initialize(HBaseToInitializer.java:36)
	org.apache.sqoop.driver.JobManager.initializeConnector(JobManager.java:448)
	org.apache.sqoop.driver.JobManager.createJobRequest(JobManager.java:372)
	org.apache.sqoop.driver.JobManager.start(JobManager.java:275)
	org.apache.sqoop.handler.JobRequestHandler.startJob(JobRequestHandler.java:368)
	org.apache.sqoop.handler.JobRequestHandler.handleEvent(JobRequestHandler.java:113)
{code} 

> External connector loading in Sqoop2
> ------------------------------------
>
>                 Key: SQOOP-1821
>                 URL: https://issues.apache.org/jira/browse/SQOOP-1821
>             Project: Sqoop
>          Issue Type: Bug
>    Affects Versions: 1.99.5
>            Reporter: Veena Basavaraj
>            Assignee: Veena Basavaraj
>             Fix For: 1.99.5
>
>         Attachments: SQOOP-1821-v1.patch, SQOOP-1821-v2.patch, SQOOP-1821.patch, SQOOP-1821.v5.patch,
SQOOP-1821.v6.patch, hbase-connector.jar, hbase-connector.jar, test-connector.jar, test-non-connector.jar
>
>
> Edit this wiki to begin with
> https://cwiki.apache.org/confluence/display/SQOOP/Setting+up+Sqoop+2#SettingupSqoop2-InstallinganewconnectortoSqoop2
> Also, add the same to the .rst of need be
> relevant code that loads all connectors 
> https://github.com/apache/sqoop/blob/sqoop2/core/src/main/java/org/apache/sqoop/connector/ConnectorManagerUtils.java#L44
> NOTE : External contributors had issues with getting a new sqoop connector working seamlessly
with the Sqoop2. They had to do some hacks to include this new jar into the class path. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message