sqoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Suluhan, Murat, Vodafone Turkey" <Murat.Sulu...@vodafone.com>
Subject Sqoop2 problem : Oracle to HDFS
Date Wed, 09 Dec 2015 12:45:21 GMT
Hello

I am working on Cloudera 5.4 Community@RHEL 6.6 environment and using following edition of
sqoop2. I installed it from Cloudera repo.

sqoop2.noarch                 1.99.5+cdh5.4.5+38-1.cdh5.4.5.p0.8.el6
sqoop2-client.noarch          1.99.5+cdh5.4.5+38-1.cdh5.4.5.p0.8.el6

I tried to run following job with sqoop2 user  but I got following error.
Could you help me about it ?

TPLink is Oracle server, it’s up and running
I also checked connection settings with sqlpus, I could successfully connected to Oracle with
same user/password.
Schema is available, given table has lots of data, column names are ok.

Thanks for everything
Suluhan



sqoop:000> show link
+----+-------------+--------------+------------------------+---------+
| Id |    Name     | Connector Id |     Connector Name     | Enabled |
+----+-------------+--------------+------------------------+---------+
| 2  | HDFSLink    | 2            | kite-connector         | true    |
| 4  | TPLink      | 1            | generic-jdbc-connector | true    |
+----+-------------+--------------+------------------------+---------+
sqoop:000> create job -f 4 -t 2
Creating job for links with from id 4 and to id 2
Please fill following values to create new job object
Name: testMurat

From database configuration

Schema name: TPOWNER1
Table name: ACTIVE_REPORT
Table SQL statement:
Table column names: AR_ID, AR_NAME
Partition column name:
Null value allowed for the partition column:
Boundary query:

To Kite Dataset Configuration

Dataset URI: dataset:hdfs:/user/impala/temp/recep
File format:
  0 : CSV
  1 : AVRO
  2 : PARQUET
Choose: 0

Throttling resources

Extractors:
Loaders:
New job was successfully created with validation status OK  and persistent id 9
sqoop:000> start job --jid 9
Exception has occurred during processing command
Exception: java.lang.RuntimeException Message: java.lang.ClassNotFoundException: org.kitesdk.data.DatasetIOException
Stack trace:
         at  org.apache.sqoop.utils.ClassUtils (ClassUtils.java:65)
         at  org.apache.sqoop.utils.ClassUtils (ClassUtils.java:84)
         at  org.apache.sqoop.json.ThrowableBean (ThrowableBean.java:123)
         at  org.apache.sqoop.client.request.ResourceRequest (ResourceRequest.java:127)
         at  org.apache.sqoop.client.request.ResourceRequest (ResourceRequest.java:179)
         at  org.apache.sqoop.client.request.JobResourceRequest (JobResourceRequest.java:112)
         at  org.apache.sqoop.client.request.SqoopResourceRequests (SqoopResourceRequests.java:154)
         at  org.apache.sqoop.client.SqoopClient (SqoopClient.java:460)
         at  org.apache.sqoop.shell.StartJobFunction (StartJobFunction.java:80)
         at  org.apache.sqoop.shell.SqoopFunction (SqoopFunction.java:51)
         at  org.apache.sqoop.shell.SqoopCommand (SqoopCommand.java:127)
         at  org.apache.sqoop.shell.SqoopCommand (SqoopCommand.java:103)
         at  org.codehaus.groovy.tools.shell.Command$execute (null:-1)
         at  org.codehaus.groovy.runtime.callsite.CallSiteArray (CallSiteArray.java:42)
         at  org.codehaus.groovy.tools.shell.Command$execute (null:-1)
         at  org.codehaus.groovy.tools.shell.Shell (Shell.groovy:101)
         at  org.codehaus.groovy.tools.shell.Groovysh (Groovysh.groovy:-1)
         at  sun.reflect.GeneratedMethodAccessor21 (null:-1)
         at  sun.reflect.DelegatingMethodAccessorImpl (DelegatingMethodAccessorImpl.java:43)
         at  java.lang.reflect.Method (Method.java:497)
         at  org.codehaus.groovy.reflection.CachedMethod (CachedMethod.java:90)
         at  groovy.lang.MetaMethod (MetaMethod.java:233)
         at  groovy.lang.MetaClassImpl (MetaClassImpl.java:1054)
         at  org.codehaus.groovy.runtime.ScriptBytecodeAdapter (ScriptBytecodeAdapter.java:128)
         at  org.codehaus.groovy.tools.shell.Groovysh (Groovysh.groovy:173)
         at  sun.reflect.GeneratedMethodAccessor20 (null:-1)
         at  sun.reflect.DelegatingMethodAccessorImpl (DelegatingMethodAccessorImpl.java:43)
         at  java.lang.reflect.Method (Method.java:497)
         at  org.codehaus.groovy.runtime.callsite.PogoMetaMethodSite$PogoCachedMethodSiteNoUnwrapNoCoerce
(PogoMetaMethodSite.java:267)
         at  org.codehaus.groovy.runtime.callsite.PogoMetaMethodSite (PogoMetaMethodSite.java:52)
         at  org.codehaus.groovy.runtime.callsite.AbstractCallSite (AbstractCallSite.java:141)
         at  org.codehaus.groovy.tools.shell.Groovysh (Groovysh.groovy:121)
         at  org.codehaus.groovy.tools.shell.Shell (Shell.groovy:114)
         at  org.codehaus.groovy.tools.shell.Shell$leftShift$0 (null:-1)
         at  org.codehaus.groovy.tools.shell.ShellRunner (ShellRunner.groovy:88)
         at  org.codehaus.groovy.tools.shell.InteractiveShellRunner (InteractiveShellRunner.groovy:-1)
         at  sun.reflect.GeneratedMethodAccessor18 (null:-1)
         at  sun.reflect.DelegatingMethodAccessorImpl (DelegatingMethodAccessorImpl.java:43)
         at  java.lang.reflect.Method (Method.java:497)
         at  org.codehaus.groovy.reflection.CachedMethod (CachedMethod.java:90)
         at  groovy.lang.MetaMethod (MetaMethod.java:233)
         at  groovy.lang.MetaClassImpl (MetaClassImpl.java:1054)
         at  org.codehaus.groovy.runtime.ScriptBytecodeAdapter (ScriptBytecodeAdapter.java:128)
         at  org.codehaus.groovy.runtime.ScriptBytecodeAdapter (ScriptBytecodeAdapter.java:148)
         at  org.codehaus.groovy.tools.shell.InteractiveShellRunner (InteractiveShellRunner.groovy:100)
         at  sun.reflect.GeneratedMethodAccessor17 (null:-1)
         at  sun.reflect.DelegatingMethodAccessorImpl (DelegatingMethodAccessorImpl.java:43)
         at  java.lang.reflect.Method (Method.java:497)
         at  org.codehaus.groovy.runtime.callsite.PogoMetaMethodSite$PogoCachedMethodSiteNoUnwrapNoCoerce
(PogoMetaMethodSite.java:267)
         at  org.codehaus.groovy.runtime.callsite.PogoMetaMethodSite (PogoMetaMethodSite.java:52)
         at  org.codehaus.groovy.runtime.callsite.AbstractCallSite (AbstractCallSite.java:137)
         at  org.codehaus.groovy.tools.shell.ShellRunner (ShellRunner.groovy:57)
         at  org.codehaus.groovy.tools.shell.InteractiveShellRunner (InteractiveShellRunner.groovy:-1)
         at  sun.reflect.NativeMethodAccessorImpl (NativeMethodAccessorImpl.java:-2)
         at  sun.reflect.NativeMethodAccessorImpl (NativeMethodAccessorImpl.java:62)
         at  sun.reflect.DelegatingMethodAccessorImpl (DelegatingMethodAccessorImpl.java:43)
         at  java.lang.reflect.Method (Method.java:497)
         at  org.codehaus.groovy.reflection.CachedMethod (CachedMethod.java:90)
         at  groovy.lang.MetaMethod (MetaMethod.java:233)
         at  groovy.lang.MetaClassImpl (MetaClassImpl.java:1054)
         at  org.codehaus.groovy.runtime.ScriptBytecodeAdapter (ScriptBytecodeAdapter.java:128)
         at  org.codehaus.groovy.runtime.ScriptBytecodeAdapter (ScriptBytecodeAdapter.java:148)
         at  org.codehaus.groovy.tools.shell.InteractiveShellRunner (InteractiveShellRunner.groovy:66)
         at  java_lang_Runnable$run (null:-1)
         at  org.codehaus.groovy.runtime.callsite.CallSiteArray (CallSiteArray.java:42)
         at  org.codehaus.groovy.runtime.callsite.AbstractCallSite (AbstractCallSite.java:108)
         at  org.codehaus.groovy.runtime.callsite.AbstractCallSite (AbstractCallSite.java:112)
         at  org.codehaus.groovy.tools.shell.Groovysh (Groovysh.groovy:463)
         at  org.codehaus.groovy.tools.shell.Groovysh (Groovysh.groovy:402)
         at  org.apache.sqoop.shell.SqoopShell (SqoopShell.java:128)
Caused by: Exception: java.lang.ClassNotFoundException Message: org.kitesdk.data.DatasetIOException
Stack trace:
         at  java.net.URLClassLoader (URLClassLoader.java:381)
         at  java.lang.ClassLoader (ClassLoader.java:424)
         at  sun.misc.Launcher$AppClassLoader (Launcher.java:331)
         at  java.lang.ClassLoader (ClassLoader.java:357)
         at  org.apache.sqoop.utils.ClassUtils (ClassUtils.java:61)
         at  org.apache.sqoop.utils.ClassUtils (ClassUtils.java:84)
         at  org.apache.sqoop.json.ThrowableBean (ThrowableBean.java:123)
         at  org.apache.sqoop.client.request.ResourceRequest (ResourceRequest.java:127)
         at  org.apache.sqoop.client.request.ResourceRequest (ResourceRequest.java:179)
         at  org.apache.sqoop.client.request.JobResourceRequest (JobResourceRequest.java:112)
         at  org.apache.sqoop.client.request.SqoopResourceRequests (SqoopResourceRequests.java:154)
         at  org.apache.sqoop.client.SqoopClient (SqoopClient.java:460)
         at  org.apache.sqoop.shell.StartJobFunction (StartJobFunction.java:80)
         at  org.apache.sqoop.shell.SqoopFunction (SqoopFunction.java:51)
         at  org.apache.sqoop.shell.SqoopCommand (SqoopCommand.java:127)
         at  org.apache.sqoop.shell.SqoopCommand (SqoopCommand.java:103)
         at  org.codehaus.groovy.tools.shell.Command$execute (null:-1)
         at  org.codehaus.groovy.runtime.callsite.CallSiteArray (CallSiteArray.java:42)
         at  org.codehaus.groovy.tools.shell.Command$execute (null:-1)
         at  org.codehaus.groovy.tools.shell.Shell (Shell.groovy:101)
         at  org.codehaus.groovy.tools.shell.Groovysh (Groovysh.groovy:-1)
         at  sun.reflect.GeneratedMethodAccessor21 (null:-1)
         at  sun.reflect.DelegatingMethodAccessorImpl (DelegatingMethodAccessorImpl.java:43)
         at  java.lang.reflect.Method (Method.java:497)
         at  org.codehaus.groovy.reflection.CachedMethod (CachedMethod.java:90)
         at  groovy.lang.MetaMethod (MetaMethod.java:233)
         at  groovy.lang.MetaClassImpl (MetaClassImpl.java:1054)
         at  org.codehaus.groovy.runtime.ScriptBytecodeAdapter (ScriptBytecodeAdapter.java:128)
         at  org.codehaus.groovy.tools.shell.Groovysh (Groovysh.groovy:173)
         at  sun.reflect.GeneratedMethodAccessor20 (null:-1)
         at  sun.reflect.DelegatingMethodAccessorImpl (DelegatingMethodAccessorImpl.java:43)
         at  java.lang.reflect.Method (Method.java:497)
         at  org.codehaus.groovy.runtime.callsite.PogoMetaMethodSite$PogoCachedMethodSiteNoUnwrapNoCoerce
(PogoMetaMethodSite.java:267)
         at  org.codehaus.groovy.runtime.callsite.PogoMetaMethodSite (PogoMetaMethodSite.java:52)
         at  org.codehaus.groovy.runtime.callsite.AbstractCallSite (AbstractCallSite.java:141)
         at  org.codehaus.groovy.tools.shell.Groovysh (Groovysh.groovy:121)
         at  org.codehaus.groovy.tools.shell.Shell (Shell.groovy:114)
         at  org.codehaus.groovy.tools.shell.Shell$leftShift$0 (null:-1)
         at  org.codehaus.groovy.tools.shell.ShellRunner (ShellRunner.groovy:88)
         at  org.codehaus.groovy.tools.shell.InteractiveShellRunner (InteractiveShellRunner.groovy:-1)
         at  sun.reflect.GeneratedMethodAccessor18 (null:-1)
         at  sun.reflect.DelegatingMethodAccessorImpl (DelegatingMethodAccessorImpl.java:43)
         at  java.lang.reflect.Method (Method.java:497)
         at  org.codehaus.groovy.reflection.CachedMethod (CachedMethod.java:90)
         at  groovy.lang.MetaMethod (MetaMethod.java:233)
         at  groovy.lang.MetaClassImpl (MetaClassImpl.java:1054)
         at  org.codehaus.groovy.runtime.ScriptBytecodeAdapter (ScriptBytecodeAdapter.java:128)
         at  org.codehaus.groovy.runtime.ScriptBytecodeAdapter (ScriptBytecodeAdapter.java:148)
         at  org.codehaus.groovy.tools.shell.InteractiveShellRunner (InteractiveShellRunner.groovy:100)
         at  sun.reflect.GeneratedMethodAccessor17 (null:-1)
         at  sun.reflect.DelegatingMethodAccessorImpl (DelegatingMethodAccessorImpl.java:43)
         at  java.lang.reflect.Method (Method.java:497)
         at  org.codehaus.groovy.runtime.callsite.PogoMetaMethodSite$PogoCachedMethodSiteNoUnwrapNoCoerce
(PogoMetaMethodSite.java:267)
         at  org.codehaus.groovy.runtime.callsite.PogoMetaMethodSite (PogoMetaMethodSite.java:52)
         at  org.codehaus.groovy.runtime.callsite.AbstractCallSite (AbstractCallSite.java:137)
         at  org.codehaus.groovy.tools.shell.ShellRunner (ShellRunner.groovy:57)
         at  org.codehaus.groovy.tools.shell.InteractiveShellRunner (InteractiveShellRunner.groovy:-1)
         at  sun.reflect.NativeMethodAccessorImpl (NativeMethodAccessorImpl.java:-2)
         at  sun.reflect.NativeMethodAccessorImpl (NativeMethodAccessorImpl.java:62)
         at  sun.reflect.DelegatingMethodAccessorImpl (DelegatingMethodAccessorImpl.java:43)
         at  java.lang.reflect.Method (Method.java:497)
         at  org.codehaus.groovy.reflection.CachedMethod (CachedMethod.java:90)
         at  groovy.lang.MetaMethod (MetaMethod.java:233)
         at  groovy.lang.MetaClassImpl (MetaClassImpl.java:1054)
         at  org.codehaus.groovy.runtime.ScriptBytecodeAdapter (ScriptBytecodeAdapter.java:128)
         at  org.codehaus.groovy.runtime.ScriptBytecodeAdapter (ScriptBytecodeAdapter.java:148)
         at  org.codehaus.groovy.tools.shell.InteractiveShellRunner (InteractiveShellRunner.groovy:66)
         at  java_lang_Runnable$run (null:-1)
         at  org.codehaus.groovy.runtime.callsite.CallSiteArray (CallSiteArray.java:42)
         at  org.codehaus.groovy.runtime.callsite.AbstractCallSite (AbstractCallSite.java:108)
         at  org.codehaus.groovy.runtime.callsite.AbstractCallSite (AbstractCallSite.java:112)
         at  org.codehaus.groovy.tools.shell.Groovysh (Groovysh.groovy:463)
         at  org.codehaus.groovy.tools.shell.Groovysh (Groovysh.groovy:402)
         at  org.apache.sqoop.shell.SqoopShell (SqoopShell.java:128)
sqoop:000>

[cid:83503c.png@6a9802b8.47bae49e]
MURAT SULUHAN
Enabling Platforms Senior Expert
OSS&System Tools Management
+90 850 542 0000
Murat.Suluhan@vodafone.com<mailto:Murat.Suluhan@vodafone.com>


[cid:1685ec.png@e50befe8.4c8381c0]


Vodafone Turkey
Vodafone Plaza
Büyükdere Caddesi No: 251
34398 Maslak İstanbul
www.vodafone.com.tr

[cid:7e353a.png@3b5b3855.4a99e548]
        [cid:6ef292.png@d359ae3a.4e9f784c]



Yasal Uyarı :
Bu elektronik posta işbu linki kullanarak ulaşabileceğiniz Koşul ve Şartlar dokumanına
tabidir
http://www.vodafone.com.tr/VodafoneHakkinda/eposta-hukuki-sartlar.php


Mime
View raw message