sqoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From corbacho anthony <acorba...@nflabs.com>
Subject Re: Sqoop and OSGI
Date Thu, 20 Jun 2013 01:17:35 GMT
hello Jarec and Abe.

Abe: the debugging mode show nothing :(
Jarec: In cloudera repo I can only find Sqoop 1.4.0.

There is the full stack (in case):
2013-06-20 10:10:29,022 | ERROR | qtp1742391956-59 | ConnFactory | Could
not load ManagerFactory com.cloudera.sqoop.apache.ConnMananger (not found)
2013-06-20 10:10:29,023 | ERROR | qtp1742391956-59 | BaseSqoopTool | Got
error creating database manager: java.io.IOException: No manager for
connect string: jdbc:mysql://xxx:0000/x
at org.apache.sqoop.ConnFactory.getManager(ConnFactory.java:119)
at org.apache.sqoop.tool.BaseSqoopTool.init(BaseSqoopTool.java:202)
at org.apache.sqoop.tool.ImportTool.init(ImportTool.java:83)
at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:441)
at org.apache.sqoop.Sqoop.run(Sqoop.java:145)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:181)
at org.apache.sqoop.Sqoop.runTool(Sqoop.java:220)
at com.cloudera.sqoop.Sqoop.runTool(Sqoop.java:49)
at com.nflabs.com.peloton.imprt.db.SqoopImport.tested(SqoopImport.java:131)
at com.nflabs.peloton.imprt.impl.ImprtSvcImpl.test(ImprtSvcImpl.java:191)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.aries.proxy.impl.ProxyHandler$1.invoke(ProxyHandler.java:50)
at org.apache.aries.proxy.impl.DefaultWrapper.invoke(DefaultWrapper.java:31)
at org.apache.aries.proxy.impl.ProxyHandler.invoke(ProxyHandler.java:78)
at com.sun.proxy.$Proxy76.test(Unknown Source)
at
com.nflabs.peloton.rs.imprt.ImprtService.BrowseDirectory1(ImprtService.java:478)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at
org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:173)
at
org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:89)
at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:165)
at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:92)
at
org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:58)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at
org.apache.cxf.workqueue.SynchronousExecutor.execute(SynchronousExecutor.java:37)
at
org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:106)
at
org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:263)
at
org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121)
at
org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:207)
at
org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:209)
at
org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:152)
at
org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:114)
at
org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:185)
at
org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:113)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:693)
at
org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:164)
at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:538)
at
org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:478)
at
org.ops4j.pax.web.service.jetty.internal.HttpServiceServletHandler.doHandle(HttpServiceServletHandler.java:70)
at
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:119)
at
org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:480)
at
org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:225)
at
org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:937)
at
org.ops4j.pax.web.service.jetty.internal.HttpServiceContext.doHandle(HttpServiceContext.java:116)
at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:406)
at
org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:183)
at
org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:871)
at
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:117)
at
org.ops4j.pax.web.service.jetty.internal.JettyServerHandlerCollection.handle(JettyServerHandlerCollection.java:72)
at
org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:110)
at org.eclipse.jetty.server.Server.handle(Server.java:346)
at
org.eclipse.jetty.server.HttpConnection.handleRequest(HttpConnection.java:589)
at
org.eclipse.jetty.server.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:1048)
at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:601)
at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:214)
at org.eclipse.jetty.server.HttpConnection.handle(HttpConnection.java:411)
at
org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:535)
at
org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:40)
at
org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:529)
at java.lang.Thread.run(Thread.java:680)

Thanks
Anthony


On Thu, Jun 20, 2013 at 2:52 AM, Abraham Elmahrek <abe@cloudera.com> wrote:

> Anthony,
>
> You could also try enabling debug logging to see what managers are being
> loaded (if any). This can normally be done by adding "--verbose" to your
> list of arguments. I'm not sure how it will work with your intended use
> case.
>
> -Abe
>
>
> On Wed, Jun 19, 2013 at 7:57 AM, Jarek Jarcec Cecho <jarcec@apache.org>wrote:
>
>> Hi Anthony,
>> I'm glad to see your interested in Sqoop project! I have to mention that
>> whereas the direct usage of the Sqoop classes might work, it's not
>> officially supported API and you might hit some issues along the way.
>>
>> I would strongly suggest to upgrade to latest Sqoop version as the 1.4.0
>> is quite old. In most cases using the --driver parameter is not needed as
>> it will instruct Sqoop to use the Generic JDBC Driver instead of
>> specialized MySQL connector, I would suggest to drop this parameter
>> entirely.
>>
>> Jarcec
>>
>> On Wed, Jun 19, 2013 at 03:25:51PM +0900, corbacho anthony wrote:
>> > Hello,
>> >
>> > I am trying to use Sqoop in an osgi pluging but it wont work and I dont
>> > know why.
>> > I keep getting the following error:
>> > "2013-06-19 13:53:27,556 | ERROR | qtp122715895-276 | BaseSqoopTool  |
>> ?  ?
>> > |  -  -  | Got error creating database manager: java.io.IOException: No
>> > manager for connect string: jdbc:mysql://...."
>> >
>> > I have include sqoop in my pom (1.4.0-cdh4b1) and I also have my mysql
>> > driver loader (i can use in the code).
>> >
>> > the part who throw an exception is:
>> >
>> > String[] str = {
>> > "import",
>> > "--driver", "com.mysql.jdbc.Driver",
>> > "--connect", "jdbc:mysql://___MY_DB___",
>> > "--hadoop-home", __HOME__,
>> > "--query", "Select [.....] AND $CONDITIONS",
>> > "--split-by", "id",
>> > "--target-dir", "hdfs://__SERVER__/__FOLDER__",
>> > "--username", "foo",
>> > "--password", "barou"};
>> >
>> > return Sqoop.runTool(str);
>> >
>> > Thanks,
>> > Anthony
>>
>
>

Mime
View raw message