sqoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Venkat <venkat...@gmail.com>
Subject Re: Sqoop import from Oracle DB to Hive
Date Tue, 11 Jun 2013 14:53:51 GMT
The jdbc drivers cannot be just 5k in length.   Check the driver file
ojdbc6.jar (I don't think you need both ojdbc6 and ojdbc5).  Just use
ojdbc6.jar

Venkat


On Tue, Jun 11, 2013 at 5:35 AM, Chalcy <chalcy@gmail.com> wrote:

> Hi Jérôme
>
> The obvious missing parameters are, --target-dir, --num-mappers/-m,
> --hive-table
>
> Add all these parameters to the sqoop command and see what you get.
>
> Thanks,
> Chalcy
>
>
> On Tue, Jun 11, 2013 at 3:36 AM, Jérôme VERDIER <
> verdier.jerome66@gmail.com> wrote:
>
>> Hi everybody,
>>
>> I'm trying to import data into Hive from an Oracle DB using Sqoop command.
>>
>> My Sqoop command is this one :
>>
>> sqoop import --hive-import --connect jdbc:oracle:thin@<IP>:1521/KPI
>> --table KPI.ENTITE --username x --password x --verbose
>>
>> But, i also try this one :
>>
>> sqoop import --hive-import --driver oracle.jdbc.driver.oracledriver
>> --connect jdbc:oracle:thin@<IP>:1521/KPI --table KPI.ENTITE --username x
>> --password x --verbose
>>
>> the two command give me an error, you can see the entire output below :
>>
>> Warning: /usr/lib/hbase does not exist! HBase imports will fail.
>> Please set $HBASE_HOME to the root of your HBase installation.
>> 13/06/11 09:06:41 DEBUG tool.BaseSqoopTool: Enabled debug logging.
>> 13/06/11 09:06:41 WARN tool.BaseSqoopTool: Setting your password on the
>> command-line is insecure. Consider using -P instead.
>> 13/06/11 09:06:41 INFO tool.BaseSqoopTool: Using Hive-specific delimiters
>> for output. You can override
>> 13/06/11 09:06:41 INFO tool.BaseSqoopTool: delimiters with
>> --fields-terminated-by, etc.
>> 13/06/11 09:06:41 DEBUG sqoop.ConnFactory: Loaded manager factory:
>> com.cloudera.sqoop.manager.DefaultManagerFactory
>> 13/06/11 09:06:41 WARN sqoop.ConnFactory: Parameter --driver is set to an
>> explicit driver however appropriate connection manager is not being set
>> (via --connection-manager). Sqoop is going to fall back to
>> org.apache.sqoop.manager.GenericJdbcManager. Please specify explicitly
>> which connection manager should be used next time.
>> 13/06/11 09:06:41 INFO manager.SqlManager: Using default fetchSize of 1000
>> 13/06/11 09:06:41 INFO tool.CodeGenTool: Beginning code generation
>> 13/06/11 09:06:41 ERROR sqoop.Sqoop: Got exception running Sqoop:
>> java.lang.RuntimeException: Could not load db driver class:
>> oracle.jdbc.driver.oracledriver
>> java.lang.RuntimeException: Could not load db driver class:
>> oracle.jdbc.driver.oracledriver
>>         at
>> org.apache.sqoop.manager.SqlManager.makeConnection(SqlManager.java:716)
>>         at
>> org.apache.sqoop.manager.GenericJdbcManager.getConnection(GenericJdbcManager.java:52)
>>         at
>> org.apache.sqoop.manager.SqlManager.execute(SqlManager.java:605)
>>         at
>> org.apache.sqoop.manager.SqlManager.execute(SqlManager.java:628)
>>         at
>> org.apache.sqoop.manager.SqlManager.getColumnTypesForRawQuery(SqlManager.java:235)
>>         at
>> org.apache.sqoop.manager.SqlManager.getColumnTypes(SqlManager.java:219)
>>         at
>> org.apache.sqoop.manager.ConnManager.getColumnTypes(ConnManager.java:283)
>>         at
>> org.apache.sqoop.orm.ClassWriter.getColumnTypes(ClassWriter.java:1255)
>>         at
>> org.apache.sqoop.orm.ClassWriter.generate(ClassWriter.java:1072)
>>         at
>> org.apache.sqoop.tool.CodeGenTool.generateORM(CodeGenTool.java:82)
>>         at
>> org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:390)
>>         at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:476)
>>         at org.apache.sqoop.Sqoop.run(Sqoop.java:145)
>>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
>>         at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:181)
>>         at org.apache.sqoop.Sqoop.runTool(Sqoop.java:220)
>>         at org.apache.sqoop.Sqoop.runTool(Sqoop.java:229)
>>         at org.apache.sqoop.Sqoop.main(Sqoop.java:238)
>>
>> Of course, Oracle JDBC drivers are in SQOOP_HOME/lib, we can see this
>> with ls -l command on this directory :
>>
>> hduser@hadoop:~$ ls -l /usr/local/sqoop/lib
>> total 3464
>> -rw-rw-r-- 1 hduser hadoop 224277 févr. 26 20:31 ant-contrib-1.0b3.jar
>> -rw-rw-r-- 1 hduser hadoop  36455 févr. 26 20:31
>> ant-eclipse-1.0-jvm1.2.jar
>> -rw-rw-r-- 1 hduser hadoop 263268 févr. 26 20:31 avro-1.5.3.jar
>> -rw-rw-r-- 1 hduser hadoop 168042 févr. 26 20:31 avro-ipc-1.5.3.jar
>> -rw-rw-r-- 1 hduser hadoop  89086 févr. 26 20:31 avro-mapred-1.5.3.jar
>> -rw-rw-r-- 1 hduser hadoop 109043 févr. 26 20:31 commons-io-1.4.jar
>> -rw-rw-r-- 1 hduser hadoop 706710 févr. 26 20:31 hsqldb-1.8.0.10.jar
>> -rw-rw-r-- 1 hduser hadoop 207430 févr. 26 20:31
>> jackson-core-asl-1.7.3.jar
>> -rw-rw-r-- 1 hduser hadoop 625229 févr. 26 20:31
>> jackson-mapper-asl-1.7.3.jar
>> -rw-rw-r-- 1 hduser hadoop  53244 févr. 26 20:31 jopt-simple-3.2.jar
>> -rw-r--r-- 1 hduser hadoop   5307 mars  20  2012 ojdbc5.jar
>> -rw-r--r-- 1 hduser hadoop   5307 mars  20  2012 ojdbc6.jar
>> -rw-rw-r-- 1 hduser hadoop  29555 févr. 26 20:31 paranamer-2.3.jar
>> -rw-rw-r-- 1 hduser hadoop 995720 févr. 26 20:31 snappy-java-1.0.3.2.jar
>>
>> Thanks for your help =)
>>
>>
>


-- 
Regards

Venkat

Mime
View raw message