sqoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Chalcy <cha...@gmail.com>
Subject Re: Sqoop import from Oracle DB to Hive
Date Tue, 11 Jun 2013 12:35:26 GMT
Hi Jérôme

The obvious missing parameters are, --target-dir, --num-mappers/-m,
--hive-table

Add all these parameters to the sqoop command and see what you get.

Thanks,
Chalcy


On Tue, Jun 11, 2013 at 3:36 AM, Jérôme VERDIER
<verdier.jerome66@gmail.com>wrote:

> Hi everybody,
>
> I'm trying to import data into Hive from an Oracle DB using Sqoop command.
>
> My Sqoop command is this one :
>
> sqoop import --hive-import --connect jdbc:oracle:thin@<IP>:1521/KPI
> --table KPI.ENTITE --username x --password x --verbose
>
> But, i also try this one :
>
> sqoop import --hive-import --driver oracle.jdbc.driver.oracledriver
> --connect jdbc:oracle:thin@<IP>:1521/KPI --table KPI.ENTITE --username x
> --password x --verbose
>
> the two command give me an error, you can see the entire output below :
>
> Warning: /usr/lib/hbase does not exist! HBase imports will fail.
> Please set $HBASE_HOME to the root of your HBase installation.
> 13/06/11 09:06:41 DEBUG tool.BaseSqoopTool: Enabled debug logging.
> 13/06/11 09:06:41 WARN tool.BaseSqoopTool: Setting your password on the
> command-line is insecure. Consider using -P instead.
> 13/06/11 09:06:41 INFO tool.BaseSqoopTool: Using Hive-specific delimiters
> for output. You can override
> 13/06/11 09:06:41 INFO tool.BaseSqoopTool: delimiters with
> --fields-terminated-by, etc.
> 13/06/11 09:06:41 DEBUG sqoop.ConnFactory: Loaded manager factory:
> com.cloudera.sqoop.manager.DefaultManagerFactory
> 13/06/11 09:06:41 WARN sqoop.ConnFactory: Parameter --driver is set to an
> explicit driver however appropriate connection manager is not being set
> (via --connection-manager). Sqoop is going to fall back to
> org.apache.sqoop.manager.GenericJdbcManager. Please specify explicitly
> which connection manager should be used next time.
> 13/06/11 09:06:41 INFO manager.SqlManager: Using default fetchSize of 1000
> 13/06/11 09:06:41 INFO tool.CodeGenTool: Beginning code generation
> 13/06/11 09:06:41 ERROR sqoop.Sqoop: Got exception running Sqoop:
> java.lang.RuntimeException: Could not load db driver class:
> oracle.jdbc.driver.oracledriver
> java.lang.RuntimeException: Could not load db driver class:
> oracle.jdbc.driver.oracledriver
>         at
> org.apache.sqoop.manager.SqlManager.makeConnection(SqlManager.java:716)
>         at
> org.apache.sqoop.manager.GenericJdbcManager.getConnection(GenericJdbcManager.java:52)
>         at org.apache.sqoop.manager.SqlManager.execute(SqlManager.java:605)
>         at org.apache.sqoop.manager.SqlManager.execute(SqlManager.java:628)
>         at
> org.apache.sqoop.manager.SqlManager.getColumnTypesForRawQuery(SqlManager.java:235)
>         at
> org.apache.sqoop.manager.SqlManager.getColumnTypes(SqlManager.java:219)
>         at
> org.apache.sqoop.manager.ConnManager.getColumnTypes(ConnManager.java:283)
>         at
> org.apache.sqoop.orm.ClassWriter.getColumnTypes(ClassWriter.java:1255)
>         at org.apache.sqoop.orm.ClassWriter.generate(ClassWriter.java:1072)
>         at
> org.apache.sqoop.tool.CodeGenTool.generateORM(CodeGenTool.java:82)
>         at
> org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:390)
>         at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:476)
>         at org.apache.sqoop.Sqoop.run(Sqoop.java:145)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
>         at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:181)
>         at org.apache.sqoop.Sqoop.runTool(Sqoop.java:220)
>         at org.apache.sqoop.Sqoop.runTool(Sqoop.java:229)
>         at org.apache.sqoop.Sqoop.main(Sqoop.java:238)
>
> Of course, Oracle JDBC drivers are in SQOOP_HOME/lib, we can see this with
> ls -l command on this directory :
>
> hduser@hadoop:~$ ls -l /usr/local/sqoop/lib
> total 3464
> -rw-rw-r-- 1 hduser hadoop 224277 févr. 26 20:31 ant-contrib-1.0b3.jar
> -rw-rw-r-- 1 hduser hadoop  36455 févr. 26 20:31
> ant-eclipse-1.0-jvm1.2.jar
> -rw-rw-r-- 1 hduser hadoop 263268 févr. 26 20:31 avro-1.5.3.jar
> -rw-rw-r-- 1 hduser hadoop 168042 févr. 26 20:31 avro-ipc-1.5.3.jar
> -rw-rw-r-- 1 hduser hadoop  89086 févr. 26 20:31 avro-mapred-1.5.3.jar
> -rw-rw-r-- 1 hduser hadoop 109043 févr. 26 20:31 commons-io-1.4.jar
> -rw-rw-r-- 1 hduser hadoop 706710 févr. 26 20:31 hsqldb-1.8.0.10.jar
> -rw-rw-r-- 1 hduser hadoop 207430 févr. 26 20:31
> jackson-core-asl-1.7.3.jar
> -rw-rw-r-- 1 hduser hadoop 625229 févr. 26 20:31
> jackson-mapper-asl-1.7.3.jar
> -rw-rw-r-- 1 hduser hadoop  53244 févr. 26 20:31 jopt-simple-3.2.jar
> -rw-r--r-- 1 hduser hadoop   5307 mars  20  2012 ojdbc5.jar
> -rw-r--r-- 1 hduser hadoop   5307 mars  20  2012 ojdbc6.jar
> -rw-rw-r-- 1 hduser hadoop  29555 févr. 26 20:31 paranamer-2.3.jar
> -rw-rw-r-- 1 hduser hadoop 995720 févr. 26 20:31 snappy-java-1.0.3.2.jar
>
> Thanks for your help =)
>
>

Mime
View raw message