sqoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From bejoy ks <bejo...@gmail.com>
Subject Re: Fw: Fw: [sqoop-user] sqoop import shows ORA-00933: SQL command notproperlyended error
Date Tue, 02 Aug 2011 10:49:31 GMT
Hi Arvind
        Thank you for the detailed explanation to all our queries. I did try
out the options specified by you and now we are running into some different
issues. In our SQOOP import commands when the default connector was
chosen(avoided --driver in import commands) the SQL query generated didn't
contain 'AS' , ie the query syntax in default imports looks fine. The
analysis of other issues encountered are as follows, please go through the
same and share your thoughts. Should I specifically check for any details on
my user credentials with Oracle? Please advise

*Trial 1* : *SQOOP import command*
Execute the SQOOP import command without the --driver option so that the
default oracle connector would be selected
*Test 1:* no of mappers set to 1
*Sqoop Command : *
sqoop import -D oraoop.disabled=true  --connect
jdbc:oracle:thin:@servername:port:SID
--username <user name> --password <password> --table "ENGINE_RAW_OUTPUT"
--columns "Column-1,Column-2,Column-3,Column-4" --split-by
"ENGINE_POSITION"  --target-dir
"/userdata/bejoys/sqoop/aviation/BTEQPOC1/Table_EngineRawOP"  --num-mappers
1 --verbose
*Result :*
Map reduce job is triggered but it just halts after showing 'map 100% reduce
0%' . The job is not showing any failed status but stays in the same status
of 100% map done even after 12 hours. I tried the same import with --direct
option as well but still the same bug.
*Console Log*
11/08/02 04:06:12 DEBUG tool.BaseSqoopTool: Enabled debug logging.
11/08/02 04:06:12 DEBUG util.ClassLoaderStack: Checking for existing class:
com.quest.oraoop.OraOopManagerFactory
11/08/02 04:06:12 DEBUG util.ClassLoaderStack: Class is already available.
Skipping jar /usr/lib/sqoop/lib/oraoop-1.3.0.81.jar
11/08/02 04:06:12 DEBUG sqoop.ConnFactory: Added factory
com.quest.oraoop.OraOopManagerFactory in jar
/usr/lib/sqoop/lib/oraoop-1.3.0.81.jar specified by
/usr/lib/sqoop/conf/managers.d/oraoop
11/08/02 04:06:12 DEBUG sqoop.ConnFactory: Loaded manager factory:
com.quest.oraoop.OraOopManagerFactory
11/08/02 04:06:12 DEBUG sqoop.ConnFactory: Loaded manager factory:
com.cloudera.sqoop.manager.DefaultManagerFactory
11/08/02 04:06:12 DEBUG sqoop.ConnFactory: Trying ManagerFactory:
com.quest.oraoop.OraOopManagerFactory
11/08/02 04:06:13 DEBUG oraoop.OraOopUtilities: Enabled OraOop debug
logging.
11/08/02 04:06:13 DEBUG oraoop.OraOopManagerFactory: Quest® Data Connector
for Oracle and Hadoop can be called by Sqoop!
11/08/02 04:06:13 INFO oraoop.OraOopManagerFactory: Quest® Data Connector
for Oracle and Hadoop is disabled.
11/08/02 04:06:13 DEBUG sqoop.ConnFactory: Trying ManagerFactory:
com.cloudera.sqoop.manager.DefaultManagerFactory
11/08/02 04:06:13 DEBUG manager.DefaultManagerFactory: Trying with scheme:
jdbc:oracle:thin:@servername:port
11/08/02 04:06:13 DEBUG manager.OracleManager$ConnCache: Instantiated new
connection cache.
11/08/02 04:06:13 DEBUG sqoop.ConnFactory: Instantiated ConnManager
com.cloudera.sqoop.manager.OracleManager@7f2ad19e
11/08/02 04:06:13 INFO tool.CodeGenTool: Beginning code generation
11/08/02 04:06:13 DEBUG manager.OracleManager: Creating a new connection for
jdbc:oracle:thin:@servername:port:SID/<username>
11/08/02 04:06:14 INFO manager.OracleManager: Time zone has been set to GMT
11/08/02 04:06:14 INFO manager.SqlManager: Executing SQL statement: SELECT
t.* FROM ENGINE_RAW_OUTPUT t WHERE 1=0
11/08/02 04:06:15 DEBUG orm.ClassWriter: selected columns:
11/08/02 04:06:15 DEBUG orm.ClassWriter:   Column-1
11/08/02 04:06:15 DEBUG orm.ClassWriter:   Column-2
11/08/02 04:06:15 DEBUG orm.ClassWriter:   Column-3
11/08/02 04:06:15 DEBUG orm.ClassWriter:   Column-4
11/08/02 04:06:15 DEBUG orm.ClassWriter: Writing source file:
/tmp/sqoop-bejoys/compile/d5ed6e7e3fe57db53207b85c4095def1/ENGINE_RAW_OUTPUT.java
11/08/02 04:06:15 DEBUG orm.ClassWriter: Table name: ENGINE_RAW_OUTPUT
11/08/02 04:06:15 DEBUG orm.ClassWriter: Columns: Column-1:12, Column-2:2,
Column-3:12, Column-4:12,
11/08/02 04:06:15 DEBUG orm.ClassWriter: sourceFilename is
ENGINE_RAW_OUTPUT.java
11/08/02 04:06:15 DEBUG orm.CompilationManager: Found existing
/tmp/sqoop-bejoys/compile/d5ed6e7e3fe57db53207b85c4095def1/
11/08/02 04:06:15 INFO orm.CompilationManager: HADOOP_HOME is
/usr/lib/hadoop
11/08/02 04:06:15 INFO orm.CompilationManager: Found hadoop core jar at:
/usr/lib/hadoop/hadoop-core.jar
11/08/02 04:06:15 DEBUG orm.CompilationManager: Adding source file:
/tmp/sqoop-bejoys/compile/d5ed6e7e3fe57db53207b85c4095def1/ENGINE_RAW_OUTPUT.java
11/08/02 04:06:15 DEBUG orm.CompilationManager: Invoking javac with args:
11/08/02 04:06:15 DEBUG orm.CompilationManager:   -sourcepath
11/08/02 04:06:15 DEBUG orm.CompilationManager:
/tmp/sqoop-bejoys/compile/d5ed6e7e3fe57db53207b85c4095def1/
11/08/02 04:06:15 DEBUG orm.CompilationManager:   -d
11/08/02 04:06:15 DEBUG orm.CompilationManager:
/tmp/sqoop-bejoys/compile/d5ed6e7e3fe57db53207b85c4095def1/
11/08/02 04:06:15 DEBUG orm.CompilationManager:   -classpath
11/08/02 04:06:15 DEBUG orm.CompilationManager:
/usr/lib/hadoop/conf:/usr/java/jdk1.6.0_21/lib/tools.jar:/usr/lib/hadoop:/usr/lib/hadoop/hadoop-core-0.20.2-cdh3u1.jar:/usr/lib/hadoop/lib/ant-contrib-1.0b3.jar:/usr/lib/hadoop/lib/aspectjrt-1.6.5.jar:/usr/lib/hadoop/lib/aspectjtools-1.6.5.jar:/usr/lib/hadoop/lib/cloudera-hadoop-lzo-20110406115906.0.4.10.0.g2bd0d5b.jar:/usr/lib/hadoop/lib/commons-cli-1.2.jar:/usr/lib/hadoop/lib/commons-codec-1.4.jar:/usr/lib/hadoop/lib/commons-daemon-1.0.1.jar:/usr/lib/hadoop/lib/commons-el-1.0.jar:/usr/lib/hadoop/lib/commons-httpclient-3.0.1.jar:/usr/lib/hadoop/lib/commons-logging-1.0.4.jar:/usr/lib/hadoop/lib/commons-logging-api-1.0.4.jar:/usr/lib/hadoop/lib/commons-net-1.4.1.jar:/usr/lib/hadoop/lib/core-3.1.1.jar:/usr/lib/hadoop/lib/hadoop-fairscheduler-0.20.2-cdh3u1.jar:/usr/lib/hadoop/lib/hadoop-lzo-0.4.10.jar:/usr/lib/hadoop/lib/hsqldb-1.8.0.10.jar:/usr/lib/hadoop/lib/hue-plugins-1.2.0.jar:/usr/lib/hadoop/lib/jackson-core-asl-1.5.2.jar:/usr/lib/hadoop/lib/jackson-mapper-asl-1.5.2.jar:/usr/lib/hadoop/lib/jasper-compiler-5.5.12.jar:/usr/lib/hadoop/lib/jasper-runtime-5.5.12.jar:/usr/lib/hadoop/lib/jets3t-0.6.1.jar:/usr/lib/hadoop/lib/jetty-6.1.26.jar:/usr/lib/hadoop/lib/jetty-servlet-tester-6.1.26.jar:/usr/lib/hadoop/lib/jetty-util-6.1.26.jar:/usr/lib/hadoop/lib/jsch-0.1.42.jar:/usr/lib/hadoop/lib/junit-4.5.jar:/usr/lib/hadoop/lib/kfs-0.2.2.jar:/usr/lib/hadoop/lib/log4j-1.2.15.jar:/usr/lib/hadoop/lib/mockito-all-1.8.2.jar:/usr/lib/hadoop/lib/mysql-connector-java-5.1.15-bin.jar:/usr/lib/hadoop/lib/oro-2.0.8.jar:/usr/lib/hadoop/lib/servlet-api-2.5-20081211.jar:/usr/lib/hadoop/lib/servlet-api-2.5-6.1.14.jar:/usr/lib/hadoop/lib/slf4j-api-1.4.3.jar:/usr/lib/hadoop/lib/slf4j-log4j12-1.4.3.jar:/usr/lib/hadoop/lib/tdgssconfig.jar:/usr/lib/hadoop/lib/TeradataDBInputFormat.jar:/usr/lib/hadoop/lib/terajdbc4.jar:/usr/lib/hadoop/lib/xmlenc-0.52.jar:/usr/lib/hadoop/lib/jsp-2.1/jsp-2.1.jar:/usr/lib/hadoop/lib/jsp-2.1/jsp-api-2.1.jar:/usr/lib/sqoop/conf:/usr/lib/hbase/conf::/usr/lib/sqoop/lib/ant-contrib-1.0b3.jar:/usr/lib/sqoop/lib/ant-eclipse-1.0-jvm1.2.jar:/usr/lib/sqoop/lib/commons-io-1.4.jar:/usr/lib/sqoop/lib/hadoop-mrunit-0.20.2-CDH3b2-SNAPSHOT.jar:/usr/lib/sqoop/lib/ivy-2.0.0-rc2.jar:/usr/lib/sqoop/lib/ojdbc6.jar:/usr/lib/sqoop/lib/oraoop-1.3.0.81.jar:/usr/lib/sqoop/lib/tdgssconfig.jar:/usr/lib/sqoop/lib/terajdbc4.jar:/usr/lib/hbase/hbase-0.90.1-cdh3u0.jar:/usr/lib/hbase/hbase-0.90.1-cdh3u0-tests.jar:/usr/lib/hbase/lib/activation-1.1.jar:/usr/lib/hbase/lib/asm-3.1.jar:/usr/lib/hbase/lib/avro-1.3.3.jar:/usr/lib/hbase/lib/commons-cli-1.2.jar:/usr/lib/hbase/lib/commons-codec-1.4.jar:/usr/lib/hbase/lib/commons-el-1.0.jar:/usr/lib/hbase/lib/commons-httpclient-3.1.jar:/usr/lib/hbase/lib/commons-lang-2.5.jar:/usr/lib/hbase/lib/commons-logging-1.1.1.jar:/usr/lib/hbase/lib/commons-net-1.4.1.jar:/usr/lib/hbase/lib/core-3.1.1.jar:/usr/lib/hbase/lib/guava-r06.jar:/usr/lib/hbase/lib/hadoop-core.jar:/usr/lib/hbase/lib/hbase-0.90.1-cdh3u0.jar:/usr/lib/hbase/lib/hbql-0.89.20100924.1.jar:/usr/lib/hbase/lib/jackson-core-asl-1.5.2.jar:/usr/lib/hbase/lib/jackson-jaxrs-1.5.5.jar:/usr/lib/hbase/lib/jackson-mapper-asl-1.5.2.jar:/usr/lib/hbase/lib/jackson-xc-1.5.5.jar:/usr/lib/hbase/lib/jasper-compiler-5.5.23.jar:/usr/lib/hbase/lib/jasper-runtime-5.5.23.jar:/usr/lib/hbase/lib/jaxb-api-2.1.jar:/usr/lib/hbase/lib/jaxb-impl-2.1.12.jar:/usr/lib/hbase/lib/jersey-core-1.4.jar:/usr/lib/hbase/lib/jersey-json-1.4.jar:/usr/lib/hbase/lib/jersey-server-1.4.jar:/usr/lib/hbase/lib/jettison-1.1.jar:/usr/lib/hbase/lib/jetty-6.1.26.jar:/usr/lib/hbase/lib/jetty-util-6.1.26.jar:/usr/lib/hbase/lib/jruby-complete-1.0.3.jar:/usr/lib/hbase/lib/jsp-2.1-6.1.14.jar:/usr/lib/hbase/lib/jsp-api-2.1-6.1.14.jar:/usr/lib/hbase/lib/jsp-api-2.1.jar:/usr/lib/hbase/lib/jsr311-api-1.1.1.jar:/usr/lib/hbase/lib/log4j-1.2.16.jar:/usr/lib/hbase/lib/protobuf-java-2.3.0.jar:/usr/lib/hbase/lib/servlet-api-2.5-6.1.14.jar:/usr/lib/hbase/lib/servlet-api-2.5.jar:/usr/lib/hbase/lib/slf4j-api-1.5.8.jar:/usr/lib/hbase/lib/slf4j-log4j12-1.5.8.jar:/usr/lib/hbase/lib/stax-api-1.0.1.jar:/usr/lib/hbase/lib/thrift-0.2.0.jar:/usr/lib/hbase/lib/xmlenc-0.52.jar:/usr/lib/hbase/lib/zookeeper.jar:/usr/lib/zookeeper/zookeeper-3.3.3-cdh3u0.jar:/usr/lib/zookeeper/zookeeper.jar:/usr/lib/zookeeper/lib/jline-0.9.94.jar:/usr/lib/zookeeper/lib/log4j-1.2.15.jar:/usr/lib/sqoop/sqoop-1.2.0-cdh3u0.jar:/usr/lib/sqoop/sqoop-test-1.2.0-cdh3u0.jar::/usr/lib/hadoop/hadoop-core.jar:/usr/lib/sqoop/sqoop-1.2.0-cdh3u0.jar
11/08/02 04:06:16 INFO orm.CompilationManager: Writing jar file:
/tmp/sqoop-bejoys/compile/d5ed6e7e3fe57db53207b85c4095def1/ENGINE_RAW_OUTPUT.jar
11/08/02 04:06:16 DEBUG orm.CompilationManager: Scanning for .class files in
directory: /tmp/sqoop-bejoys/compile/d5ed6e7e3fe57db53207b85c4095def1
11/08/02 04:06:16 DEBUG orm.CompilationManager: Got classfile:
/tmp/sqoop-bejoys/compile/d5ed6e7e3fe57db53207b85c4095def1/ENGINE_RAW_OUTPUT.class
-> ENGINE_RAW_OUTPUT.class
11/08/02 04:06:16 DEBUG orm.CompilationManager: Finished writing jar file
/tmp/sqoop-bejoys/compile/d5ed6e7e3fe57db53207b85c4095def1/ENGINE_RAW_OUTPUT.jar
11/08/02 04:06:16 INFO mapreduce.ImportJobBase: Beginning import of
ENGINE_RAW_OUTPUT
11/08/02 04:06:16 DEBUG mapreduce.DataDrivenImportJob: Using table class:
ENGINE_RAW_OUTPUT
11/08/02 04:06:16 DEBUG mapreduce.DataDrivenImportJob: Using InputFormat:
class com.cloudera.sqoop.mapreduce.db.OracleDataDrivenDBInputFormat
11/08/02 04:06:16 DEBUG manager.OracleManager$ConnCache: Caching released
connection for jdbc:oracle:thin:@servername:port:SID/<user name>
11/08/02 04:06:16 DEBUG mapreduce.JobBase: Adding to job classpath:
file:/usr/lib/sqoop/sqoop-1.2.0-cdh3u0.jar
11/08/02 04:06:16 DEBUG mapreduce.JobBase: Adding to job classpath:
file:/usr/lib/sqoop/lib/ojdbc6.jar
11/08/02 04:06:16 DEBUG mapreduce.JobBase: Adding to job classpath:
file:/usr/lib/sqoop/sqoop-1.2.0-cdh3u0.jar
11/08/02 04:06:16 DEBUG mapreduce.JobBase: Adding to job classpath:
file:/usr/lib/sqoop/lib/commons-io-1.4.jar
11/08/02 04:06:16 DEBUG mapreduce.JobBase: Adding to job classpath:
file:/usr/lib/sqoop/lib/ant-contrib-1.0b3.jar
11/08/02 04:06:16 DEBUG mapreduce.JobBase: Adding to job classpath:
file:/usr/lib/sqoop/lib/oraoop-1.3.0.81.jar
11/08/02 04:06:16 DEBUG mapreduce.JobBase: Adding to job classpath:
file:/usr/lib/sqoop/lib/ant-eclipse-1.0-jvm1.2.jar
11/08/02 04:06:16 DEBUG mapreduce.JobBase: Adding to job classpath:
file:/usr/lib/sqoop/lib/tdgssconfig.jar
11/08/02 04:06:16 DEBUG mapreduce.JobBase: Adding to job classpath:
file:/usr/lib/sqoop/lib/hadoop-mrunit-0.20.2-CDH3b2-SNAPSHOT.jar
11/08/02 04:06:16 DEBUG mapreduce.JobBase: Adding to job classpath:
file:/usr/lib/sqoop/lib/ojdbc6.jar
11/08/02 04:06:16 DEBUG mapreduce.JobBase: Adding to job classpath:
file:/usr/lib/sqoop/lib/ivy-2.0.0-rc2.jar
11/08/02 04:06:16 DEBUG mapreduce.JobBase: Adding to job classpath:
file:/usr/lib/sqoop/lib/terajdbc4.jar
11/08/02 04:06:18 INFO mapred.JobClient: Running job: job_201107271252_0061
11/08/02 04:06:19 INFO mapred.JobClient:  map 0% reduce 0%
11/08/02 04:06:31 INFO mapred.JobClient:  map 100% reduce 0%

*Test 2:* no of mappers set to 1 with no --column argument
*Sqoop Command : *
sqoop import -D oraoop.disabled=true  --connect
jdbc:oracle:thin:@servername:port:SID
--username <user name> --password <password> --table "ENGINE_RAW_OUTPUT"
--split-by "ENGINE_POSITION"  --target-dir
"/userdata/bejoys/sqoop/aviation/BTEQPOC1/Table_EngineRawOP"  --num-mappers
1 --verbose
*Result :*
 Now the job totally fails showing a Null Pointer Exception. In the log i
cant figure out the column names fetched. It is empty in the log
Console log
11/08/02 05:38:58 DEBUG tool.BaseSqoopTool: Enabled debug logging.
11/08/02 05:38:58 DEBUG util.ClassLoaderStack: Checking for existing class:
com.quest.oraoop.OraOopManagerFactory
11/08/02 05:38:58 DEBUG util.ClassLoaderStack: Class is already available.
Skipping jar /usr/lib/sqoop/lib/oraoop-1.3.0.81.jar
11/08/02 05:38:58 DEBUG sqoop.ConnFactory: Added factory
com.quest.oraoop.OraOopManagerFactory in jar
/usr/lib/sqoop/lib/oraoop-1.3.0.81.jar specified by
/usr/lib/sqoop/conf/managers.d/oraoop
11/08/02 05:38:58 DEBUG sqoop.ConnFactory: Loaded manager factory:
com.quest.oraoop.OraOopManagerFactory
11/08/02 05:38:58 DEBUG sqoop.ConnFactory: Loaded manager factory:
com.cloudera.sqoop.manager.DefaultManagerFactory
11/08/02 05:38:58 DEBUG sqoop.ConnFactory: Trying ManagerFactory:
com.quest.oraoop.OraOopManagerFactory
11/08/02 05:38:58 DEBUG oraoop.OraOopUtilities: Enabled OraOop debug
logging.
11/08/02 05:38:58 DEBUG oraoop.OraOopManagerFactory: Quest® Data Connector
for Oracle and Hadoop can be called by Sqoop!
11/08/02 05:38:58 INFO oraoop.OraOopManagerFactory: Quest® Data Connector
for Oracle and Hadoop is disabled.
11/08/02 05:38:58 DEBUG sqoop.ConnFactory: Trying ManagerFactory:
com.cloudera.sqoop.manager.DefaultManagerFactory
11/08/02 05:38:58 DEBUG manager.DefaultManagerFactory: Trying with scheme:
jdbc:oracle:thin:@servername:port
11/08/02 05:38:58 DEBUG manager.OracleManager$ConnCache: Instantiated new
connection cache.
11/08/02 05:38:58 DEBUG sqoop.ConnFactory: Instantiated ConnManager
com.cloudera.sqoop.manager.OracleManager@7f2ad19e
11/08/02 05:38:58 INFO tool.CodeGenTool: Beginning code generation
11/08/02 05:38:58 DEBUG manager.OracleManager: Creating a new connection for
jdbc:oracle:thin:@servername:port:SID/<user name>
11/08/02 05:38:59 INFO manager.OracleManager: Time zone has been set to GMT
11/08/02 05:38:59 INFO manager.SqlManager: Executing SQL statement: SELECT
t.* FROM ENGINE_RAW_OUTPUT t WHERE 1=0
11/08/02 05:39:00 DEBUG manager.OracleManager$ConnCache: Caching released
connection for jdbc:oracle:thin:@servername:port:SID/<user name>
11/08/02 05:39:00 DEBUG orm.ClassWriter: selected columns:
11/08/02 05:39:00 DEBUG orm.ClassWriter: Writing source file:
/tmp/sqoop-bejoys/compile/6be05dfcae6a1ee35f1953968e223205/ENGINE_RAW_OUTPUT.java
11/08/02 05:39:00 DEBUG orm.ClassWriter: Table name: ENGINE_RAW_OUTPUT
11/08/02 05:39:00 DEBUG orm.ClassWriter: Columns:
11/08/02 05:39:00 DEBUG orm.ClassWriter: sourceFilename is
ENGINE_RAW_OUTPUT.java
11/08/02 05:39:00 DEBUG orm.CompilationManager: Found existing
/tmp/sqoop-bejoys/compile/6be05dfcae6a1ee35f1953968e223205/
11/08/02 05:39:00 INFO orm.CompilationManager: HADOOP_HOME is
/usr/lib/hadoop
11/08/02 05:39:00 INFO orm.CompilationManager: Found hadoop core jar at:
/usr/lib/hadoop/hadoop-core.jar
11/08/02 05:39:00 DEBUG orm.CompilationManager: Adding source file:
/tmp/sqoop-bejoys/compile/6be05dfcae6a1ee35f1953968e223205/ENGINE_RAW_OUTPUT.java
11/08/02 05:39:00 DEBUG orm.CompilationManager: Invoking javac with args:
11/08/02 05:39:00 DEBUG orm.CompilationManager:   -sourcepath
11/08/02 05:39:00 DEBUG orm.CompilationManager:
/tmp/sqoop-bejoys/compile/6be05dfcae6a1ee35f1953968e223205/
11/08/02 05:39:00 DEBUG orm.CompilationManager:   -d
11/08/02 05:39:00 DEBUG orm.CompilationManager:
/tmp/sqoop-bejoys/compile/6be05dfcae6a1ee35f1953968e223205/
11/08/02 05:39:00 DEBUG orm.CompilationManager:   -classpath
11/08/02 05:39:00 DEBUG orm.CompilationManager:
/usr/lib/hadoop/conf:/usr/java/jdk1.6.0_21/lib/tools.jar:/usr/lib/hadoop:/usr/lib/hadoop/hadoop-core-0.20.2-cdh3u1.jar:/usr/lib/hadoop/lib/ant-contrib-1.0b3.jar:/usr/lib/hadoop/lib/aspectjrt-1.6.5.jar:/usr/lib/hadoop/lib/aspectjtools-1.6.5.jar:/usr/lib/hadoop/lib/cloudera-hadoop-lzo-20110406115906.0.4.10.0.g2bd0d5b.jar:/usr/lib/hadoop/lib/commons-cli-1.2.jar:/usr/lib/hadoop/lib/commons-codec-1.4.jar:/usr/lib/hadoop/lib/commons-daemon-1.0.1.jar:/usr/lib/hadoop/lib/commons-el-1.0.jar:/usr/lib/hadoop/lib/commons-httpclient-3.0.1.jar:/usr/lib/hadoop/lib/commons-logging-1.0.4.jar:/usr/lib/hadoop/lib/commons-logging-api-1.0.4.jar:/usr/lib/hadoop/lib/commons-net-1.4.1.jar:/usr/lib/hadoop/lib/core-3.1.1.jar:/usr/lib/hadoop/lib/hadoop-fairscheduler-0.20.2-cdh3u1.jar:/usr/lib/hadoop/lib/hadoop-lzo-0.4.10.jar:/usr/lib/hadoop/lib/hsqldb-1.8.0.10.jar:/usr/lib/hadoop/lib/hue-plugins-1.2.0.jar:/usr/lib/hadoop/lib/jackson-core-asl-1.5.2.jar:/usr/lib/hadoop/lib/jackson-mapper-asl-1.5.2.jar:/usr/lib/hadoop/lib/jasper-compiler-5.5.12.jar:/usr/lib/hadoop/lib/jasper-runtime-5.5.12.jar:/usr/lib/hadoop/lib/jets3t-0.6.1.jar:/usr/lib/hadoop/lib/jetty-6.1.26.jar:/usr/lib/hadoop/lib/jetty-servlet-tester-6.1.26.jar:/usr/lib/hadoop/lib/jetty-util-6.1.26.jar:/usr/lib/hadoop/lib/jsch-0.1.42.jar:/usr/lib/hadoop/lib/junit-4.5.jar:/usr/lib/hadoop/lib/kfs-0.2.2.jar:/usr/lib/hadoop/lib/log4j-1.2.15.jar:/usr/lib/hadoop/lib/mockito-all-1.8.2.jar:/usr/lib/hadoop/lib/mysql-connector-java-5.1.15-bin.jar:/usr/lib/hadoop/lib/oro-2.0.8.jar:/usr/lib/hadoop/lib/servlet-api-2.5-20081211.jar:/usr/lib/hadoop/lib/servlet-api-2.5-6.1.14.jar:/usr/lib/hadoop/lib/slf4j-api-1.4.3.jar:/usr/lib/hadoop/lib/slf4j-log4j12-1.4.3.jar:/usr/lib/hadoop/lib/tdgssconfig.jar:/usr/lib/hadoop/lib/TeradataDBInputFormat.jar:/usr/lib/hadoop/lib/terajdbc4.jar:/usr/lib/hadoop/lib/xmlenc-0.52.jar:/usr/lib/hadoop/lib/jsp-2.1/jsp-2.1.jar:/usr/lib/hadoop/lib/jsp-2.1/jsp-api-2.1.jar:/usr/lib/sqoop/conf:/usr/lib/hbase/conf::/usr/lib/sqoop/lib/ant-contrib-1.0b3.jar:/usr/lib/sqoop/lib/ant-eclipse-1.0-jvm1.2.jar:/usr/lib/sqoop/lib/commons-io-1.4.jar:/usr/lib/sqoop/lib/hadoop-mrunit-0.20.2-CDH3b2-SNAPSHOT.jar:/usr/lib/sqoop/lib/ivy-2.0.0-rc2.jar:/usr/lib/sqoop/lib/ojdbc6.jar:/usr/lib/sqoop/lib/oraoop-1.3.0.81.jar:/usr/lib/sqoop/lib/tdgssconfig.jar:/usr/lib/sqoop/lib/terajdbc4.jar:/usr/lib/hbase/hbase-0.90.1-cdh3u0.jar:/usr/lib/hbase/hbase-0.90.1-cdh3u0-tests.jar:/usr/lib/hbase/lib/activation-1.1.jar:/usr/lib/hbase/lib/asm-3.1.jar:/usr/lib/hbase/lib/avro-1.3.3.jar:/usr/lib/hbase/lib/commons-cli-1.2.jar:/usr/lib/hbase/lib/commons-codec-1.4.jar:/usr/lib/hbase/lib/commons-el-1.0.jar:/usr/lib/hbase/lib/commons-httpclient-3.1.jar:/usr/lib/hbase/lib/commons-lang-2.5.jar:/usr/lib/hbase/lib/commons-logging-1.1.1.jar:/usr/lib/hbase/lib/commons-net-1.4.1.jar:/usr/lib/hbase/lib/core-3.1.1.jar:/usr/lib/hbase/lib/guava-r06.jar:/usr/lib/hbase/lib/hadoop-core.jar:/usr/lib/hbase/lib/hbase-0.90.1-cdh3u0.jar:/usr/lib/hbase/lib/hbql-0.89.20100924.1.jar:/usr/lib/hbase/lib/jackson-core-asl-1.5.2.jar:/usr/lib/hbase/lib/jackson-jaxrs-1.5.5.jar:/usr/lib/hbase/lib/jackson-mapper-asl-1.5.2.jar:/usr/lib/hbase/lib/jackson-xc-1.5.5.jar:/usr/lib/hbase/lib/jasper-compiler-5.5.23.jar:/usr/lib/hbase/lib/jasper-runtime-5.5.23.jar:/usr/lib/hbase/lib/jaxb-api-2.1.jar:/usr/lib/hbase/lib/jaxb-impl-2.1.12.jar:/usr/lib/hbase/lib/jersey-core-1.4.jar:/usr/lib/hbase/lib/jersey-json-1.4.jar:/usr/lib/hbase/lib/jersey-server-1.4.jar:/usr/lib/hbase/lib/jettison-1.1.jar:/usr/lib/hbase/lib/jetty-6.1.26.jar:/usr/lib/hbase/lib/jetty-util-6.1.26.jar:/usr/lib/hbase/lib/jruby-complete-1.0.3.jar:/usr/lib/hbase/lib/jsp-2.1-6.1.14.jar:/usr/lib/hbase/lib/jsp-api-2.1-6.1.14.jar:/usr/lib/hbase/lib/jsp-api-2.1.jar:/usr/lib/hbase/lib/jsr311-api-1.1.1.jar:/usr/lib/hbase/lib/log4j-1.2.16.jar:/usr/lib/hbase/lib/protobuf-java-2.3.0.jar:/usr/lib/hbase/lib/servlet-api-2.5-6.1.14.jar:/usr/lib/hbase/lib/servlet-api-2.5.jar:/usr/lib/hbase/lib/slf4j-api-1.5.8.jar:/usr/lib/hbase/lib/slf4j-log4j12-1.5.8.jar:/usr/lib/hbase/lib/stax-api-1.0.1.jar:/usr/lib/hbase/lib/thrift-0.2.0.jar:/usr/lib/hbase/lib/xmlenc-0.52.jar:/usr/lib/hbase/lib/zookeeper.jar:/usr/lib/zookeeper/zookeeper-3.3.3-cdh3u0.jar:/usr/lib/zookeeper/zookeeper.jar:/usr/lib/zookeeper/lib/jline-0.9.94.jar:/usr/lib/zookeeper/lib/log4j-1.2.15.jar:/usr/lib/sqoop/sqoop-1.2.0-cdh3u0.jar:/usr/lib/sqoop/sqoop-test-1.2.0-cdh3u0.jar::/usr/lib/hadoop/hadoop-core.jar:/usr/lib/sqoop/sqoop-1.2.0-cdh3u0.jar
11/08/02 05:39:01 INFO orm.CompilationManager: Writing jar file:
/tmp/sqoop-bejoys/compile/6be05dfcae6a1ee35f1953968e223205/ENGINE_RAW_OUTPUT.jar
11/08/02 05:39:01 DEBUG orm.CompilationManager: Scanning for .class files in
directory: /tmp/sqoop-bejoys/compile/6be05dfcae6a1ee35f1953968e223205
11/08/02 05:39:01 DEBUG orm.CompilationManager: Got classfile:
/tmp/sqoop-bejoys/compile/6be05dfcae6a1ee35f1953968e223205/ENGINE_RAW_OUTPUT.class
-> ENGINE_RAW_OUTPUT.class
11/08/02 05:39:01 DEBUG orm.CompilationManager: Finished writing jar file
/tmp/sqoop-bejoys/compile/6be05dfcae6a1ee35f1953968e223205/ENGINE_RAW_OUTPUT.jar
11/08/02 05:39:01 INFO mapreduce.ImportJobBase: Beginning import of
ENGINE_RAW_OUTPUT
11/08/02 05:39:01 DEBUG manager.OracleManager$ConnCache: Got cached
connection for jdbc:oracle:thin:@servername:port:SID/<username>
11/08/02 05:39:01 INFO manager.OracleManager: Time zone has been set to GMT
11/08/02 05:39:01 DEBUG manager.OracleManager$ConnCache: Caching released
connection for jdbc:oracle:thin:@servername:port:SID/<user name>
11/08/02 05:39:01 DEBUG mapreduce.DataDrivenImportJob: Using table class:
ENGINE_RAW_OUTPUT
11/08/02 05:39:01 DEBUG mapreduce.DataDrivenImportJob: Using InputFormat:
class com.cloudera.sqoop.mapreduce.db.OracleDataDrivenDBInputFormat
11/08/02 05:39:01 DEBUG mapreduce.JobBase: Adding to job classpath:
file:/usr/lib/sqoop/sqoop-1.2.0-cdh3u0.jar
11/08/02 05:39:01 DEBUG mapreduce.JobBase: Adding to job classpath:
file:/usr/lib/sqoop/lib/ojdbc6.jar
11/08/02 05:39:01 DEBUG mapreduce.JobBase: Adding to job classpath:
file:/usr/lib/sqoop/sqoop-1.2.0-cdh3u0.jar
11/08/02 05:39:01 DEBUG mapreduce.JobBase: Adding to job classpath:
file:/usr/lib/sqoop/lib/commons-io-1.4.jar
11/08/02 05:39:01 DEBUG mapreduce.JobBase: Adding to job classpath:
file:/usr/lib/sqoop/lib/ant-contrib-1.0b3.jar
11/08/02 05:39:01 DEBUG mapreduce.JobBase: Adding to job classpath:
file:/usr/lib/sqoop/lib/oraoop-1.3.0.81.jar
11/08/02 05:39:01 DEBUG mapreduce.JobBase: Adding to job classpath:
file:/usr/lib/sqoop/lib/ant-eclipse-1.0-jvm1.2.jar
11/08/02 05:39:01 DEBUG mapreduce.JobBase: Adding to job classpath:
file:/usr/lib/sqoop/lib/tdgssconfig.jar
11/08/02 05:39:01 DEBUG mapreduce.JobBase: Adding to job classpath:
file:/usr/lib/sqoop/lib/hadoop-mrunit-0.20.2-CDH3b2-SNAPSHOT.jar
11/08/02 05:39:01 DEBUG mapreduce.JobBase: Adding to job classpath:
file:/usr/lib/sqoop/lib/ojdbc6.jar
11/08/02 05:39:01 DEBUG mapreduce.JobBase: Adding to job classpath:
file:/usr/lib/sqoop/lib/ivy-2.0.0-rc2.jar
11/08/02 05:39:01 DEBUG mapreduce.JobBase: Adding to job classpath:
file:/usr/lib/sqoop/lib/terajdbc4.jar
11/08/02 05:39:03 INFO mapred.JobClient: Running job: job_201107271252_0080
11/08/02 05:39:04 INFO mapred.JobClient:  map 0% reduce 0%
11/08/02 05:39:13 INFO mapred.JobClient: Task Id :
attempt_201107271252_0080_m_000000_0, Status : FAILED
java.lang.NullPointerException
        at
com.cloudera.sqoop.mapreduce.db.DataDrivenDBRecordReader.getSelectQuery(DataDrivenDBRecordReader.java:87)
        at
com.cloudera.sqoop.mapreduce.db.DBRecordReader.nextKeyValue(DBRecordReader.java:225)
        at
org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.nextKeyValue(MapTask.java:456)
        at
org.apache.hadoop.mapreduce.MapContext.nextKeyValue(MapContext.java:67)
        at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:143)
        at
com.cloudera.sqoop.mapreduce.AutoProgressMapper.run(AutoProgressMapper.java:187)
        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:647)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:323)
        at org.apache.hadoop.mapred.Child$4.run(Child.java:270)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:396)
        at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1127)
        at org.apache.hadoop.mapred.Child.main(Child.java:264)

attempt_201107271252_0080_m_000000_0: log4j:WARN No appenders could be found
for logger (org.apache.hadoop.hdfs.DFSClient).
attempt_201107271252_0080_m_000000_0: log4j:WARN Please initialize the log4j
system properly.
11/08/02 05:39:19 INFO mapred.JobClient: Task Id :
attempt_201107271252_0080_m_000000_1, Status : FAILED
java.lang.NullPointerException
        at
com.cloudera.sqoop.mapreduce.db.DataDrivenDBRecordReader.getSelectQuery(DataDrivenDBRecordReader.java:87)
        at
com.cloudera.sqoop.mapreduce.db.DBRecordReader.nextKeyValue(DBRecordReader.java:225)
        at
org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.nextKeyValue(MapTask.java:456)
        at
org.apache.hadoop.mapreduce.MapContext.nextKeyValue(MapContext.java:67)
        at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:143)
        at
com.cloudera.sqoop.mapreduce.AutoProgressMapper.run(AutoProgressMapper.java:187)
        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:647)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:323)
        at org.apache.hadoop.mapred.Child$4.run(Child.java:270)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:396)
        at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1127)
        at org.apache.hadoop.mapred.Child.main(Child.java:264)

attempt_201107271252_0080_m_000000_1: log4j:WARN No appenders could be found
for logger (org.apache.hadoop.hdfs.DFSClient).
attempt_201107271252_0080_m_000000_1: log4j:WARN Please initialize the log4j
system properly.
11/08/02 05:39:26 INFO mapred.JobClient: Task Id :
attempt_201107271252_0080_m_000000_2, Status : FAILED
java.lang.NullPointerException
        at
com.cloudera.sqoop.mapreduce.db.DataDrivenDBRecordReader.getSelectQuery(DataDrivenDBRecordReader.java:87)
        at
com.cloudera.sqoop.mapreduce.db.DBRecordReader.nextKeyValue(DBRecordReader.java:225)
        at
org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.nextKeyValue(MapTask.java:456)
        at
org.apache.hadoop.mapreduce.MapContext.nextKeyValue(MapContext.java:67)
        at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:143)
        at
com.cloudera.sqoop.mapreduce.AutoProgressMapper.run(AutoProgressMapper.java:187)
        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:647)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:323)
        at org.apache.hadoop.mapred.Child$4.run(Child.java:270)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:396)
        at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1127)
        at org.apache.hadoop.mapred.Child.main(Child.java:264)

attempt_201107271252_0080_m_000000_2: log4j:WARN No appenders could be found
for logger (org.apache.hadoop.hdfs.DFSClient).
attempt_201107271252_0080_m_000000_2: log4j:WARN Please initialize the log4j
system properly.
11/08/02 05:39:33 INFO mapred.JobClient: Job complete: job_201107271252_0080
11/08/02 05:39:33 INFO mapred.JobClient: Counters: 6
11/08/02 05:39:33 INFO mapred.JobClient:   Job Counters
11/08/02 05:39:33 INFO mapred.JobClient:     SLOTS_MILLIS_MAPS=25174
11/08/02 05:39:33 INFO mapred.JobClient:     Total time spent by all reduces
waiting after reserving slots (ms)=0
11/08/02 05:39:33 INFO mapred.JobClient:     Total time spent by all maps
waiting after reserving slots (ms)=0
11/08/02 05:39:33 INFO mapred.JobClient:     Launched map tasks=4
11/08/02 05:39:33 INFO mapred.JobClient:     SLOTS_MILLIS_REDUCES=0
11/08/02 05:39:33 INFO mapred.JobClient:     Failed map tasks=1
11/08/02 05:39:33 INFO mapreduce.ImportJobBase: Transferred 0 bytes in
31.9772 seconds (0 bytes/sec)
11/08/02 05:39:33 INFO mapreduce.ImportJobBase: Retrieved 0 records.
11/08/02 05:39:33 ERROR tool.ImportTool: Error during import: Import job
failed!



*Test 3:* Multiple mappers
*Sqoop Command*
sqoop import -D oraoop.disabled=true --connect
jdbc:oracle:thin:@servername:port:SID
--username <user name> --password <password> --table "ENGINE_RAW_OUTPUT"
--split-by "ENGINE_POSITION"  --target-dir
"/userdata/bejoys/sqoop/aviation/BTEQPOC1/Table_EnginerrawoutputT4"
--num-mappers 4 --verbose
*Result :*
When i try providing more than 1 mapper,  the map reduce job ceases to
trigger even after 4 hours.Again the process in  halt without showing any
failure status.
*Console Log*
11/08/02 05:21:47 DEBUG tool.BaseSqoopTool: Enabled debug logging.
11/08/02 05:21:47 DEBUG util.ClassLoaderStack: Checking for existing class:
com.quest.oraoop.OraOopManagerFactory
11/08/02 05:21:47 DEBUG util.ClassLoaderStack: Class is already available.
Skipping jar /usr/lib/sqoop/lib/oraoop-1.3.0.81.jar
11/08/02 05:21:47 DEBUG sqoop.ConnFactory: Added factory
com.quest.oraoop.OraOopManagerFactory in jar
/usr/lib/sqoop/lib/oraoop-1.3.0.81.jar specified by
/usr/lib/sqoop/conf/managers.d/oraoop
11/08/02 05:21:47 DEBUG sqoop.ConnFactory: Loaded manager factory:
com.quest.oraoop.OraOopManagerFactory
11/08/02 05:21:47 DEBUG sqoop.ConnFactory: Loaded manager factory:
com.cloudera.sqoop.manager.DefaultManagerFactory
11/08/02 05:21:47 DEBUG sqoop.ConnFactory: Trying ManagerFactory:
com.quest.oraoop.OraOopManagerFactory
11/08/02 05:21:47 DEBUG oraoop.OraOopUtilities: Enabled OraOop debug
logging.
11/08/02 05:21:47 DEBUG oraoop.OraOopManagerFactory: Quest® Data Connector
for Oracle and Hadoop can be called by Sqoop!
11/08/02 05:21:47 INFO oraoop.OraOopManagerFactory: Quest® Data Connector
for Oracle and Hadoop is disabled.
11/08/02 05:21:47 DEBUG sqoop.ConnFactory: Trying ManagerFactory:
com.cloudera.sqoop.manager.DefaultManagerFactory
11/08/02 05:21:47 DEBUG manager.DefaultManagerFactory: Trying with scheme:
jdbc:oracle:thin:@servername:port
11/08/02 05:21:47 DEBUG manager.OracleManager$ConnCache: Instantiated new
connection cache.
11/08/02 05:21:47 DEBUG sqoop.ConnFactory: Instantiated ConnManager
com.cloudera.sqoop.manager.OracleManager@7f2ad19e
11/08/02 05:21:47 INFO tool.CodeGenTool: Beginning code generation
11/08/02 05:21:47 DEBUG manager.OracleManager: Creating a new connection for
jdbc:oracle:thin:@servername:port:SID/<user name>
11/08/02 05:21:48 INFO manager.OracleManager: Time zone has been set to GMT
11/08/02 05:21:48 INFO manager.SqlManager: Executing SQL statement: SELECT
t.* FROM ENGINE_RAW_OUTPUT t WHERE 1=0
11/08/02 05:21:49 DEBUG manager.OracleManager$ConnCache: Caching released
connection for jdbc:oracle:thin:@servername:port:SID/<user name>
11/08/02 05:21:49 DEBUG orm.ClassWriter: selected columns:
11/08/02 05:21:49 DEBUG orm.ClassWriter: Writing source file:
/tmp/sqoop-bejoys/compile/fc174aaa18506bf006d5aca8d30ab54e/ENGINE_RAW_OUTPUT.java
11/08/02 05:21:49 DEBUG orm.ClassWriter: Table name: ENGINE_RAW_OUTPUT
11/08/02 05:21:49 DEBUG orm.ClassWriter: Columns:
11/08/02 05:21:49 DEBUG orm.ClassWriter: sourceFilename is
ENGINE_RAW_OUTPUT.java
11/08/02 05:21:49 DEBUG orm.CompilationManager: Found existing
/tmp/sqoop-bejoys/compile/fc174aaa18506bf006d5aca8d30ab54e/
11/08/02 05:21:49 INFO orm.CompilationManager: HADOOP_HOME is
/usr/lib/hadoop
11/08/02 05:21:49 INFO orm.CompilationManager: Found hadoop core jar at:
/usr/lib/hadoop/hadoop-core.jar
11/08/02 05:21:49 DEBUG orm.CompilationManager: Adding source file:
/tmp/sqoop-bejoys/compile/fc174aaa18506bf006d5aca8d30ab54e/ENGINE_RAW_OUTPUT.java
11/08/02 05:21:49 DEBUG orm.CompilationManager: Invoking javac with args:
11/08/02 05:21:49 DEBUG orm.CompilationManager:   -sourcepath
11/08/02 05:21:49 DEBUG orm.CompilationManager:
/tmp/sqoop-bejoys/compile/fc174aaa18506bf006d5aca8d30ab54e/
11/08/02 05:21:49 DEBUG orm.CompilationManager:   -d
11/08/02 05:21:49 DEBUG orm.CompilationManager:
/tmp/sqoop-bejoys/compile/fc174aaa18506bf006d5aca8d30ab54e/
11/08/02 05:21:49 DEBUG orm.CompilationManager:   -classpath
11/08/02 05:21:49 DEBUG orm.CompilationManager:
/usr/lib/hadoop/conf:/usr/java/jdk1.6.0_21/lib/tools.jar:/usr/lib/hadoop:/usr/lib/hadoop/hadoop-core-0.20.2-cdh3u1.jar:/usr/lib/hadoop/lib/ant-contrib-1.0b3.jar:/usr/lib/hadoop/lib/aspectjrt-1.6.5.jar:/usr/lib/hadoop/lib/aspectjtools-1.6.5.jar:/usr/lib/hadoop/lib/cloudera-hadoop-lzo-20110406115906.0.4.10.0.g2bd0d5b.jar:/usr/lib/hadoop/lib/commons-cli-1.2.jar:/usr/lib/hadoop/lib/commons-codec-1.4.jar:/usr/lib/hadoop/lib/commons-daemon-1.0.1.jar:/usr/lib/hadoop/lib/commons-el-1.0.jar:/usr/lib/hadoop/lib/commons-httpclient-3.0.1.jar:/usr/lib/hadoop/lib/commons-logging-1.0.4.jar:/usr/lib/hadoop/lib/commons-logging-api-1.0.4.jar:/usr/lib/hadoop/lib/commons-net-1.4.1.jar:/usr/lib/hadoop/lib/core-3.1.1.jar:/usr/lib/hadoop/lib/hadoop-fairscheduler-0.20.2-cdh3u1.jar:/usr/lib/hadoop/lib/hadoop-lzo-0.4.10.jar:/usr/lib/hadoop/lib/hsqldb-1.8.0.10.jar:/usr/lib/hadoop/lib/hue-plugins-1.2.0.jar:/usr/lib/hadoop/lib/jackson-core-asl-1.5.2.jar:/usr/lib/hadoop/lib/jackson-mapper-asl-1.5.2.jar:/usr/lib/hadoop/lib/jasper-compiler-5.5.12.jar:/usr/lib/hadoop/lib/jasper-runtime-5.5.12.jar:/usr/lib/hadoop/lib/jets3t-0.6.1.jar:/usr/lib/hadoop/lib/jetty-6.1.26.jar:/usr/lib/hadoop/lib/jetty-servlet-tester-6.1.26.jar:/usr/lib/hadoop/lib/jetty-util-6.1.26.jar:/usr/lib/hadoop/lib/jsch-0.1.42.jar:/usr/lib/hadoop/lib/junit-4.5.jar:/usr/lib/hadoop/lib/kfs-0.2.2.jar:/usr/lib/hadoop/lib/log4j-1.2.15.jar:/usr/lib/hadoop/lib/mockito-all-1.8.2.jar:/usr/lib/hadoop/lib/mysql-connector-java-5.1.15-bin.jar:/usr/lib/hadoop/lib/oro-2.0.8.jar:/usr/lib/hadoop/lib/servlet-api-2.5-20081211.jar:/usr/lib/hadoop/lib/servlet-api-2.5-6.1.14.jar:/usr/lib/hadoop/lib/slf4j-api-1.4.3.jar:/usr/lib/hadoop/lib/slf4j-log4j12-1.4.3.jar:/usr/lib/hadoop/lib/tdgssconfig.jar:/usr/lib/hadoop/lib/TeradataDBInputFormat.jar:/usr/lib/hadoop/lib/terajdbc4.jar:/usr/lib/hadoop/lib/xmlenc-0.52.jar:/usr/lib/hadoop/lib/jsp-2.1/jsp-2.1.jar:/usr/lib/hadoop/lib/jsp-2.1/jsp-api-2.1.jar:/usr/lib/sqoop/conf:/usr/lib/hbase/conf::/usr/lib/sqoop/lib/ant-contrib-1.0b3.jar:/usr/lib/sqoop/lib/ant-eclipse-1.0-jvm1.2.jar:/usr/lib/sqoop/lib/commons-io-1.4.jar:/usr/lib/sqoop/lib/hadoop-mrunit-0.20.2-CDH3b2-SNAPSHOT.jar:/usr/lib/sqoop/lib/ivy-2.0.0-rc2.jar:/usr/lib/sqoop/lib/ojdbc6.jar:/usr/lib/sqoop/lib/oraoop-1.3.0.81.jar:/usr/lib/sqoop/lib/tdgssconfig.jar:/usr/lib/sqoop/lib/terajdbc4.jar:/usr/lib/hbase/hbase-0.90.1-cdh3u0.jar:/usr/lib/hbase/hbase-0.90.1-cdh3u0-tests.jar:/usr/lib/hbase/lib/activation-1.1.jar:/usr/lib/hbase/lib/asm-3.1.jar:/usr/lib/hbase/lib/avro-1.3.3.jar:/usr/lib/hbase/lib/commons-cli-1.2.jar:/usr/lib/hbase/lib/commons-codec-1.4.jar:/usr/lib/hbase/lib/commons-el-1.0.jar:/usr/lib/hbase/lib/commons-httpclient-3.1.jar:/usr/lib/hbase/lib/commons-lang-2.5.jar:/usr/lib/hbase/lib/commons-logging-1.1.1.jar:/usr/lib/hbase/lib/commons-net-1.4.1.jar:/usr/lib/hbase/lib/core-3.1.1.jar:/usr/lib/hbase/lib/guava-r06.jar:/usr/lib/hbase/lib/hadoop-core.jar:/usr/lib/hbase/lib/hbase-0.90.1-cdh3u0.jar:/usr/lib/hbase/lib/hbql-0.89.20100924.1.jar:/usr/lib/hbase/lib/jackson-core-asl-1.5.2.jar:/usr/lib/hbase/lib/jackson-jaxrs-1.5.5.jar:/usr/lib/hbase/lib/jackson-mapper-asl-1.5.2.jar:/usr/lib/hbase/lib/jackson-xc-1.5.5.jar:/usr/lib/hbase/lib/jasper-compiler-5.5.23.jar:/usr/lib/hbase/lib/jasper-runtime-5.5.23.jar:/usr/lib/hbase/lib/jaxb-api-2.1.jar:/usr/lib/hbase/lib/jaxb-impl-2.1.12.jar:/usr/lib/hbase/lib/jersey-core-1.4.jar:/usr/lib/hbase/lib/jersey-json-1.4.jar:/usr/lib/hbase/lib/jersey-server-1.4.jar:/usr/lib/hbase/lib/jettison-1.1.jar:/usr/lib/hbase/lib/jetty-6.1.26.jar:/usr/lib/hbase/lib/jetty-util-6.1.26.jar:/usr/lib/hbase/lib/jruby-complete-1.0.3.jar:/usr/lib/hbase/lib/jsp-2.1-6.1.14.jar:/usr/lib/hbase/lib/jsp-api-2.1-6.1.14.jar:/usr/lib/hbase/lib/jsp-api-2.1.jar:/usr/lib/hbase/lib/jsr311-api-1.1.1.jar:/usr/lib/hbase/lib/log4j-1.2.16.jar:/usr/lib/hbase/lib/protobuf-java-2.3.0.jar:/usr/lib/hbase/lib/servlet-api-2.5-6.1.14.jar:/usr/lib/hbase/lib/servlet-api-2.5.jar:/usr/lib/hbase/lib/slf4j-api-1.5.8.jar:/usr/lib/hbase/lib/slf4j-log4j12-1.5.8.jar:/usr/lib/hbase/lib/stax-api-1.0.1.jar:/usr/lib/hbase/lib/thrift-0.2.0.jar:/usr/lib/hbase/lib/xmlenc-0.52.jar:/usr/lib/hbase/lib/zookeeper.jar:/usr/lib/zookeeper/zookeeper-3.3.3-cdh3u0.jar:/usr/lib/zookeeper/zookeeper.jar:/usr/lib/zookeeper/lib/jline-0.9.94.jar:/usr/lib/zookeeper/lib/log4j-1.2.15.jar:/usr/lib/sqoop/sqoop-1.2.0-cdh3u0.jar:/usr/lib/sqoop/sqoop-test-1.2.0-cdh3u0.jar::/usr/lib/hadoop/hadoop-core.jar:/usr/lib/sqoop/sqoop-1.2.0-cdh3u0.jar
11/08/02 05:21:50 INFO orm.CompilationManager: Writing jar file:
/tmp/sqoop-bejoys/compile/fc174aaa18506bf006d5aca8d30ab54e/ENGINE_RAW_OUTPUT.jar
11/08/02 05:21:50 DEBUG orm.CompilationManager: Scanning for .class files in
directory: /tmp/sqoop-bejoys/compile/fc174aaa18506bf006d5aca8d30ab54e
11/08/02 05:21:50 DEBUG orm.CompilationManager: Got classfile:
/tmp/sqoop-bejoys/compile/fc174aaa18506bf006d5aca8d30ab54e/ENGINE_RAW_OUTPUT.class
-> ENGINE_RAW_OUTPUT.class
11/08/02 05:21:50 DEBUG orm.CompilationManager: Finished writing jar file
/tmp/sqoop-bejoys/compile/fc174aaa18506bf006d5aca8d30ab54e/ENGINE_RAW_OUTPUT.jar
11/08/02 05:21:50 INFO mapreduce.ImportJobBase: Beginning import of
ENGINE_RAW_OUTPUT
11/08/02 05:21:50 DEBUG manager.OracleManager$ConnCache: Got cached
connection for jdbc:oracle:thin:@servername:port:SID/<user name>
11/08/02 05:21:50 INFO manager.OracleManager: Time zone has been set to GMT
11/08/02 05:21:50 DEBUG manager.OracleManager$ConnCache: Caching released
connection for jdbc:oracle:thin:@servername:port:SID/<user name>
11/08/02 05:21:50 DEBUG mapreduce.DataDrivenImportJob: Using table class:
ENGINE_RAW_OUTPUT
11/08/02 05:21:50 DEBUG mapreduce.DataDrivenImportJob: Using InputFormat:
class com.cloudera.sqoop.mapreduce.db.OracleDataDrivenDBInputFormat
11/08/02 05:21:50 DEBUG mapreduce.JobBase: Adding to job classpath:
file:/usr/lib/sqoop/sqoop-1.2.0-cdh3u0.jar
11/08/02 05:21:50 DEBUG mapreduce.JobBase: Adding to job classpath:
file:/usr/lib/sqoop/lib/ojdbc6.jar
11/08/02 05:21:50 DEBUG mapreduce.JobBase: Adding to job classpath:
file:/usr/lib/sqoop/sqoop-1.2.0-cdh3u0.jar
11/08/02 05:21:50 DEBUG mapreduce.JobBase: Adding to job classpath:
file:/usr/lib/sqoop/lib/commons-io-1.4.jar
11/08/02 05:21:50 DEBUG mapreduce.JobBase: Adding to job classpath:
file:/usr/lib/sqoop/lib/ant-contrib-1.0b3.jar
11/08/02 05:21:50 DEBUG mapreduce.JobBase: Adding to job classpath:
file:/usr/lib/sqoop/lib/oraoop-1.3.0.81.jar
11/08/02 05:21:50 DEBUG mapreduce.JobBase: Adding to job classpath:
file:/usr/lib/sqoop/lib/ant-eclipse-1.0-jvm1.2.jar
11/08/02 05:21:50 DEBUG mapreduce.JobBase: Adding to job classpath:
file:/usr/lib/sqoop/lib/tdgssconfig.jar
11/08/02 05:21:50 DEBUG mapreduce.JobBase: Adding to job classpath:
file:/usr/lib/sqoop/lib/hadoop-mrunit-0.20.2-CDH3b2-SNAPSHOT.jar
11/08/02 05:21:50 DEBUG mapreduce.JobBase: Adding to job classpath:
file:/usr/lib/sqoop/lib/ojdbc6.jar
11/08/02 05:21:50 DEBUG mapreduce.JobBase: Adding to job classpath:
file:/usr/lib/sqoop/lib/ivy-2.0.0-rc2.jar
11/08/02 05:21:50 DEBUG mapreduce.JobBase: Adding to job classpath:
file:/usr/lib/sqoop/lib/terajdbc4.jar


*Trial 2* : *SQOOP free-form  query import*
Execute the SQOOP import command without the --driver option so that the
default oracle connector would be selected
*Test 1*
*Sqoop Command : *
sqoop import -D oraoop.disabled=true  --connect
jdbc:oracle:thin:@servername:port:SID
--username <user name> --password <password> --query 'Select * from
ENGINE_RAW_OUTPUT where ENGINE_POSITION<=4 AND $CONDITIONS' --split-by
ENGINE_POSITION --target-dir
/userdata/bejoys/sqoop/aviation/BTEQPOC1/testtabledata --verbose
*Result :* Showing an exception due to SQL syntax
*Console Log :*
11/08/02 04:59:24 DEBUG tool.BaseSqoopTool: Enabled debug logging.
11/08/02 04:59:24 DEBUG util.ClassLoaderStack: Checking for existing class:
com.quest.oraoop.OraOopManagerFactory
11/08/02 04:59:24 DEBUG util.ClassLoaderStack: Class is already available.
Skipping jar /usr/lib/sqoop/lib/oraoop-1.3.0.81.jar
11/08/02 04:59:24 DEBUG sqoop.ConnFactory: Added factory
com.quest.oraoop.OraOopManagerFactory in jar
/usr/lib/sqoop/lib/oraoop-1.3.0.81.jar specified by
/usr/lib/sqoop/conf/managers.d/oraoop
11/08/02 04:59:24 DEBUG sqoop.ConnFactory: Loaded manager factory:
com.quest.oraoop.OraOopManagerFactory
11/08/02 04:59:24 DEBUG sqoop.ConnFactory: Loaded manager factory:
com.cloudera.sqoop.manager.DefaultManagerFactory
11/08/02 04:59:24 DEBUG sqoop.ConnFactory: Trying ManagerFactory:
com.quest.oraoop.OraOopManagerFactory
11/08/02 04:59:24 DEBUG oraoop.OraOopUtilities: Enabled OraOop debug
logging.
11/08/02 04:59:24 DEBUG oraoop.OraOopManagerFactory: Quest® Data Connector
for Oracle and Hadoop can be called by Sqoop!
11/08/02 04:59:24 INFO oraoop.OraOopManagerFactory: Quest® Data Connector
for Oracle and Hadoop is disabled.
11/08/02 04:59:24 DEBUG sqoop.ConnFactory: Trying ManagerFactory:
com.cloudera.sqoop.manager.DefaultManagerFactory
11/08/02 04:59:24 DEBUG manager.DefaultManagerFactory: Trying with scheme:
jdbc:oracle:thin:@servername:port
11/08/02 04:59:24 DEBUG manager.OracleManager$ConnCache: Instantiated new
connection cache.
11/08/02 04:59:24 DEBUG sqoop.ConnFactory: Instantiated ConnManager
com.cloudera.sqoop.manager.OracleManager@54281d4b
11/08/02 04:59:24 INFO tool.CodeGenTool: Beginning code generation
11/08/02 04:59:24 DEBUG manager.OracleManager: Creating a new connection for
jdbc:oracle:thin:@servername:port:SID/<user name>
11/08/02 04:59:25 INFO manager.OracleManager: Time zone has been set to GMT
11/08/02 04:59:25 INFO manager.SqlManager: Executing SQL statement: Select *
from ENGINE_RAW_OUTPUT where ENGINE_POSITION<=4 AND  (1 = 0)
11/08/02 04:59:26 INFO manager.SqlManager: Executing SQL statement: Select *
from ENGINE_RAW_OUTPUT where ENGINE_POSITION<=4 AND  (1 = 0)
11/08/02 04:59:26 DEBUG orm.ClassWriter: selected columns:
11/08/02 04:59:26 DEBUG orm.ClassWriter:   Column-1
11/08/02 04:59:26 DEBUG orm.ClassWriter:   Column-2
11/08/02 04:59:26 DEBUG orm.ClassWriter:   Column-3
11/08/02 04:59:26 DEBUG orm.ClassWriter:   Column-4
11/08/02 04:59:26 DEBUG orm.ClassWriter:   Column-5
11/08/02 04:59:26 DEBUG orm.ClassWriter:   Column-6
11/08/02 04:59:26 DEBUG orm.ClassWriter:   Column-7
11/08/02 04:59:26 DEBUG orm.ClassWriter:   Column-8
11/08/02 04:59:26 DEBUG orm.ClassWriter: Writing source file:
/tmp/sqoop-bejoys/compile/2c3f02ed485a7bc0997c76690db3d2c7/QueryResult.java
11/08/02 04:59:26 DEBUG orm.ClassWriter: Table name: null
11/08/02 04:59:26 DEBUG orm.ClassWriter: Columns: Column-1:12, Column-2:2,
Column-3:12, Column-4:93, Column-5:12, Column-6:2, Column-7:2, Column-8:12,
11/08/02 04:59:26 DEBUG orm.ClassWriter: sourceFilename is QueryResult.java
11/08/02 04:59:26 DEBUG orm.CompilationManager: Found existing
/tmp/sqoop-bejoys/compile/2c3f02ed485a7bc0997c76690db3d2c7/
11/08/02 04:59:26 INFO orm.CompilationManager: HADOOP_HOME is
/usr/lib/hadoop
11/08/02 04:59:26 INFO orm.CompilationManager: Found hadoop core jar at:
/usr/lib/hadoop/hadoop-core.jar
11/08/02 04:59:26 DEBUG orm.CompilationManager: Adding source file:
/tmp/sqoop-bejoys/compile/2c3f02ed485a7bc0997c76690db3d2c7/QueryResult.java
11/08/02 04:59:26 DEBUG orm.CompilationManager: Invoking javac with args:
11/08/02 04:59:26 DEBUG orm.CompilationManager:   -sourcepath
11/08/02 04:59:26 DEBUG orm.CompilationManager:
/tmp/sqoop-bejoys/compile/2c3f02ed485a7bc0997c76690db3d2c7/
11/08/02 04:59:26 DEBUG orm.CompilationManager:   -d
11/08/02 04:59:26 DEBUG orm.CompilationManager:
/tmp/sqoop-bejoys/compile/2c3f02ed485a7bc0997c76690db3d2c7/
11/08/02 04:59:26 DEBUG orm.CompilationManager:   -classpath
11/08/02 04:59:26 DEBUG orm.CompilationManager:
/usr/lib/hadoop/conf:/usr/java/jdk1.6.0_21/lib/tools.jar:/usr/lib/hadoop:/usr/lib/hadoop/hadoop-core-0.20.2-cdh3u1.jar:/usr/lib/hadoop/lib/ant-contrib-1.0b3.jar:/usr/lib/hadoop/lib/aspectjrt-1.6.5.jar:/usr/lib/hadoop/lib/aspectjtools-1.6.5.jar:/usr/lib/hadoop/lib/cloudera-hadoop-lzo-20110406115906.0.4.10.0.g2bd0d5b.jar:/usr/lib/hadoop/lib/commons-cli-1.2.jar:/usr/lib/hadoop/lib/commons-codec-1.4.jar:/usr/lib/hadoop/lib/commons-daemon-1.0.1.jar:/usr/lib/hadoop/lib/commons-el-1.0.jar:/usr/lib/hadoop/lib/commons-httpclient-3.0.1.jar:/usr/lib/hadoop/lib/commons-logging-1.0.4.jar:/usr/lib/hadoop/lib/commons-logging-api-1.0.4.jar:/usr/lib/hadoop/lib/commons-net-1.4.1.jar:/usr/lib/hadoop/lib/core-3.1.1.jar:/usr/lib/hadoop/lib/hadoop-fairscheduler-0.20.2-cdh3u1.jar:/usr/lib/hadoop/lib/hadoop-lzo-0.4.10.jar:/usr/lib/hadoop/lib/hsqldb-1.8.0.10.jar:/usr/lib/hadoop/lib/hue-plugins-1.2.0.jar:/usr/lib/hadoop/lib/jackson-core-asl-1.5.2.jar:/usr/lib/hadoop/lib/jackson-mapper-asl-1.5.2.jar:/usr/lib/hadoop/lib/jasper-compiler-5.5.12.jar:/usr/lib/hadoop/lib/jasper-runtime-5.5.12.jar:/usr/lib/hadoop/lib/jets3t-0.6.1.jar:/usr/lib/hadoop/lib/jetty-6.1.26.jar:/usr/lib/hadoop/lib/jetty-servlet-tester-6.1.26.jar:/usr/lib/hadoop/lib/jetty-util-6.1.26.jar:/usr/lib/hadoop/lib/jsch-0.1.42.jar:/usr/lib/hadoop/lib/junit-4.5.jar:/usr/lib/hadoop/lib/kfs-0.2.2.jar:/usr/lib/hadoop/lib/log4j-1.2.15.jar:/usr/lib/hadoop/lib/mockito-all-1.8.2.jar:/usr/lib/hadoop/lib/mysql-connector-java-5.1.15-bin.jar:/usr/lib/hadoop/lib/oro-2.0.8.jar:/usr/lib/hadoop/lib/servlet-api-2.5-20081211.jar:/usr/lib/hadoop/lib/servlet-api-2.5-6.1.14.jar:/usr/lib/hadoop/lib/slf4j-api-1.4.3.jar:/usr/lib/hadoop/lib/slf4j-log4j12-1.4.3.jar:/usr/lib/hadoop/lib/tdgssconfig.jar:/usr/lib/hadoop/lib/TeradataDBInputFormat.jar:/usr/lib/hadoop/lib/terajdbc4.jar:/usr/lib/hadoop/lib/xmlenc-0.52.jar:/usr/lib/hadoop/lib/jsp-2.1/jsp-2.1.jar:/usr/lib/hadoop/lib/jsp-2.1/jsp-api-2.1.jar:/usr/lib/sqoop/conf:/usr/lib/hbase/conf::/usr/lib/sqoop/lib/ant-contrib-1.0b3.jar:/usr/lib/sqoop/lib/ant-eclipse-1.0-jvm1.2.jar:/usr/lib/sqoop/lib/commons-io-1.4.jar:/usr/lib/sqoop/lib/hadoop-mrunit-0.20.2-CDH3b2-SNAPSHOT.jar:/usr/lib/sqoop/lib/ivy-2.0.0-rc2.jar:/usr/lib/sqoop/lib/ojdbc6.jar:/usr/lib/sqoop/lib/oraoop-1.3.0.81.jar:/usr/lib/sqoop/lib/tdgssconfig.jar:/usr/lib/sqoop/lib/terajdbc4.jar:/usr/lib/hbase/hbase-0.90.1-cdh3u0.jar:/usr/lib/hbase/hbase-0.90.1-cdh3u0-tests.jar:/usr/lib/hbase/lib/activation-1.1.jar:/usr/lib/hbase/lib/asm-3.1.jar:/usr/lib/hbase/lib/avro-1.3.3.jar:/usr/lib/hbase/lib/commons-cli-1.2.jar:/usr/lib/hbase/lib/commons-codec-1.4.jar:/usr/lib/hbase/lib/commons-el-1.0.jar:/usr/lib/hbase/lib/commons-httpclient-3.1.jar:/usr/lib/hbase/lib/commons-lang-2.5.jar:/usr/lib/hbase/lib/commons-logging-1.1.1.jar:/usr/lib/hbase/lib/commons-net-1.4.1.jar:/usr/lib/hbase/lib/core-3.1.1.jar:/usr/lib/hbase/lib/guava-r06.jar:/usr/lib/hbase/lib/hadoop-core.jar:/usr/lib/hbase/lib/hbase-0.90.1-cdh3u0.jar:/usr/lib/hbase/lib/hbql-0.89.20100924.1.jar:/usr/lib/hbase/lib/jackson-core-asl-1.5.2.jar:/usr/lib/hbase/lib/jackson-jaxrs-1.5.5.jar:/usr/lib/hbase/lib/jackson-mapper-asl-1.5.2.jar:/usr/lib/hbase/lib/jackson-xc-1.5.5.jar:/usr/lib/hbase/lib/jasper-compiler-5.5.23.jar:/usr/lib/hbase/lib/jasper-runtime-5.5.23.jar:/usr/lib/hbase/lib/jaxb-api-2.1.jar:/usr/lib/hbase/lib/jaxb-impl-2.1.12.jar:/usr/lib/hbase/lib/jersey-core-1.4.jar:/usr/lib/hbase/lib/jersey-json-1.4.jar:/usr/lib/hbase/lib/jersey-server-1.4.jar:/usr/lib/hbase/lib/jettison-1.1.jar:/usr/lib/hbase/lib/jetty-6.1.26.jar:/usr/lib/hbase/lib/jetty-util-6.1.26.jar:/usr/lib/hbase/lib/jruby-complete-1.0.3.jar:/usr/lib/hbase/lib/jsp-2.1-6.1.14.jar:/usr/lib/hbase/lib/jsp-api-2.1-6.1.14.jar:/usr/lib/hbase/lib/jsp-api-2.1.jar:/usr/lib/hbase/lib/jsr311-api-1.1.1.jar:/usr/lib/hbase/lib/log4j-1.2.16.jar:/usr/lib/hbase/lib/protobuf-java-2.3.0.jar:/usr/lib/hbase/lib/servlet-api-2.5-6.1.14.jar:/usr/lib/hbase/lib/servlet-api-2.5.jar:/usr/lib/hbase/lib/slf4j-api-1.5.8.jar:/usr/lib/hbase/lib/slf4j-log4j12-1.5.8.jar:/usr/lib/hbase/lib/stax-api-1.0.1.jar:/usr/lib/hbase/lib/thrift-0.2.0.jar:/usr/lib/hbase/lib/xmlenc-0.52.jar:/usr/lib/hbase/lib/zookeeper.jar:/usr/lib/zookeeper/zookeeper-3.3.3-cdh3u0.jar:/usr/lib/zookeeper/zookeeper.jar:/usr/lib/zookeeper/lib/jline-0.9.94.jar:/usr/lib/zookeeper/lib/log4j-1.2.15.jar:/usr/lib/sqoop/sqoop-1.2.0-cdh3u0.jar:/usr/lib/sqoop/sqoop-test-1.2.0-cdh3u0.jar::/usr/lib/hadoop/hadoop-core.jar:/usr/lib/sqoop/sqoop-1.2.0-cdh3u0.jar
11/08/02 04:59:27 INFO orm.CompilationManager: Writing jar file:
/tmp/sqoop-bejoys/compile/2c3f02ed485a7bc0997c76690db3d2c7/QueryResult.jar
11/08/02 04:59:27 DEBUG orm.CompilationManager: Scanning for .class files in
directory: /tmp/sqoop-bejoys/compile/2c3f02ed485a7bc0997c76690db3d2c7
11/08/02 04:59:27 DEBUG orm.CompilationManager: Got classfile:
/tmp/sqoop-bejoys/compile/2c3f02ed485a7bc0997c76690db3d2c7/QueryResult.class
-> QueryResult.class
11/08/02 04:59:27 DEBUG orm.CompilationManager: Finished writing jar file
/tmp/sqoop-bejoys/compile/2c3f02ed485a7bc0997c76690db3d2c7/QueryResult.jar
11/08/02 04:59:27 INFO mapreduce.ImportJobBase: Beginning query import.
11/08/02 04:59:27 DEBUG mapreduce.DataDrivenImportJob: Using table class:
QueryResult
11/08/02 04:59:27 DEBUG mapreduce.DataDrivenImportJob: Using InputFormat:
class com.cloudera.sqoop.mapreduce.db.DataDrivenDBInputFormat
11/08/02 04:59:27 DEBUG manager.OracleManager$ConnCache: Caching released
connection for jdbc:oracle:thin:@servername:port:SID/<user name>
11/08/02 04:59:27 DEBUG mapreduce.JobBase: Adding to job classpath:
file:/usr/lib/sqoop/sqoop-1.2.0-cdh3u0.jar
11/08/02 04:59:27 DEBUG mapreduce.JobBase: Adding to job classpath:
file:/usr/lib/sqoop/lib/ojdbc6.jar
11/08/02 04:59:27 DEBUG mapreduce.JobBase: Adding to job classpath:
file:/usr/lib/sqoop/sqoop-1.2.0-cdh3u0.jar
11/08/02 04:59:27 DEBUG mapreduce.JobBase: Adding to job classpath:
file:/usr/lib/sqoop/lib/commons-io-1.4.jar
11/08/02 04:59:27 DEBUG mapreduce.JobBase: Adding to job classpath:
file:/usr/lib/sqoop/lib/ant-contrib-1.0b3.jar
11/08/02 04:59:27 DEBUG mapreduce.JobBase: Adding to job classpath:
file:/usr/lib/sqoop/lib/oraoop-1.3.0.81.jar
11/08/02 04:59:27 DEBUG mapreduce.JobBase: Adding to job classpath:
file:/usr/lib/sqoop/lib/ant-eclipse-1.0-jvm1.2.jar
11/08/02 04:59:27 DEBUG mapreduce.JobBase: Adding to job classpath:
file:/usr/lib/sqoop/lib/tdgssconfig.jar
11/08/02 04:59:27 DEBUG mapreduce.JobBase: Adding to job classpath:
file:/usr/lib/sqoop/lib/hadoop-mrunit-0.20.2-CDH3b2-SNAPSHOT.jar
11/08/02 04:59:27 DEBUG mapreduce.JobBase: Adding to job classpath:
file:/usr/lib/sqoop/lib/ojdbc6.jar
11/08/02 04:59:27 DEBUG mapreduce.JobBase: Adding to job classpath:
file:/usr/lib/sqoop/lib/ivy-2.0.0-rc2.jar
11/08/02 04:59:27 DEBUG mapreduce.JobBase: Adding to job classpath:
file:/usr/lib/sqoop/lib/terajdbc4.jar
11/08/02 04:59:29 INFO mapred.JobClient: Cleaning up the staging area
hdfs://
stecisphdop212.corporate.ge.com/tmp/hadoop-mapred/mapred/staging/bejoys/.staging/job_201107271252_0066
11/08/02 04:59:29 ERROR tool.ImportTool: Encountered IOException running
import job: java.io.IOException: ORA-00933: SQL command not properly ended

        at
com.cloudera.sqoop.mapreduce.db.DataDrivenDBInputFormat.getSplits(DataDrivenDBInputFormat.java:201)
        at
org.apache.hadoop.mapred.JobClient.writeNewSplits(JobClient.java:944)
        at
org.apache.hadoop.mapred.JobClient.writeSplits(JobClient.java:961)
        at org.apache.hadoop.mapred.JobClient.access$500(JobClient.java:170)
        at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:880)
        at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:833)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:396)
        at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1127)
        at
org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:833)
        at org.apache.hadoop.mapreduce.Job.submit(Job.java:476)
        at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:506)
        at
com.cloudera.sqoop.mapreduce.ImportJobBase.runJob(ImportJobBase.java:107)
        at
com.cloudera.sqoop.mapreduce.ImportJobBase.runImport(ImportJobBase.java:166)
        at
com.cloudera.sqoop.manager.SqlManager.importQuery(SqlManager.java:419)
        at
com.cloudera.sqoop.tool.ImportTool.importTable(ImportTool.java:352)
        at com.cloudera.sqoop.tool.ImportTool.run(ImportTool.java:423)
        at com.cloudera.sqoop.Sqoop.run(Sqoop.java:144)
        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
        at com.cloudera.sqoop.Sqoop.runSqoop(Sqoop.java:180)
        at com.cloudera.sqoop.Sqoop.runTool(Sqoop.java:218)
        at com.cloudera.sqoop.Sqoop.main(Sqoop.java:228)

Thank You

On Thu, Jul 28, 2011 at 11:23 AM, Arvind Prabhakar <arvind@apache.org>wrote:

> Bejoy, Reju,
>
> A closer inspection of all your detailed cases reveals that the built
> in Oracle connector is not kicking in. This could be because you have
> explicitly specified the JDBC driver via the --driver option. Can you
> please try running the original command without the --driver <
> driver-name > arguments?
>
> Thanks,
> Arvind
>
> On Wed, Jul 27, 2011 at 6:45 PM, Arvind Prabhakar <arvind@apache.org>
> wrote:
> > [bcc:sqoop-user@cloudera.org]
> >
> > Hi Bejoy,
> >
> > Thanks for your detailed and methodical analysis. This certainly helps
> > narrow the problem down. As it turns out, the problem is due to the
> > use of "AS" keyword in the query for projections. We have seen this
> > problem before and fixed it for the bounds query use-case. See
> > SQOOP-204 for details. For this I have created SQOOP-304 and will try
> > to provide a patch at the earliest.
> >
> > The "1=0" is actually a no-op condition which guarantees that no data
> > will be selected by the query. It is used as a means to obtain an
> > empty result set which can then be used to obtain the metadata
> > necessary for identifying columns and datatypes etc.
> >
> > For the free-form query import, please try to specify AND between your
> > condition and the condition token required by Sqoop. For example:
> > "Select * from ENGINE_RAW_OUTPUT where ENGINE_POSITION=1 AND
> > $CONDITIONS". Do let us know if that helps.
> >
> > SQOOP-204: https://issues.cloudera.org/browse/SQOOP-204
> > SQOOP-304: https://issues.apache.org/jira/browse/SQOOP-304
> >
> > Thanks,
> > Arvind
> >
> > On Wed, Jul 27, 2011 at 6:06 AM, bejoy ks <bejoyks@gmail.com> wrote:
> >> Hi Arvind
> >>         A few more identifications on top of this. I tried framing a
> simple
> >> Jdbc program and ran it on the Linux box that holds the name node of our
> >> cluster. I tried a couple of queries using the same and below are the
> >> results
> >> Simple Select Query
> >> Select * from ENGINE_RAW_OUTPUT;
> >> It worked absolutely fine retrieving the results.
> >>
> >> Sqoop generated Select Query
> >> SELECT t.* FROM ENGINE_RAW_OUTPUT AS t WHERE 1=0;
> >> It threw an error as, 'SQL command not properly ended'
> >>
> >> Is the import getting failed because of the syntax issues in SQL queries
> >> fired by SQOOP to oracle db? I'm not a db savy, it'd be great if you
> could
> >> just briefly explain what does this '1=0' mean in SQOOP import generated
> >> queries.
> >>
> >> Also I tried a free form query import as
> >> sqoop import -D oraoop.disabled=true --driver oracle.jdbc.OracleDriver
> >> --connect jdbc:oracle:thin:@servername:port:SID --username <user name>
> >> --password <password> --query "Select * from ENGINE_RAW_OUTPUT where
> >> ENGINE_POSITION=1 $CONDITIONS" --split-by AIRCRAFT_ID --target-dir
> >> /userdata/bejoys/sqoop/ttdata
> >>
> >> But the command fails with the error as
> 'java.sql.SQLSyntaxErrorException:
> >> ORA-00907: missing right parenthesis' and the Sqoop generated query is
> >> 'Select * from ENGINE_RAW_OUTPUT where ENGINE_POSITION=1  (1 = 0)'
> >> Seems like that error due to the SQL Query generated by SQOOP. Can we
> have
> >> your Thoughts on this issue?
> >>
> >> The error log is as follows
> >> 11/07/27 08:11:04 INFO oraoop.OraOopManagerFactory: Quest® Data
> Connector
> >> for Oracle and Hadoop is disabled.
> >> 11/07/27 08:11:04 INFO tool.CodeGenTool: Beginning code generation
> >> 11/07/27 08:11:05 INFO manager.SqlManager: Executing SQL statement:
> Select *
> >> from ENGINE_RAW_OUTPUT where ENGINE_POSITION=1  (1 = 0)
> >> 11/07/27 08:11:05 ERROR manager.SqlManager: Error executing statement:
> >> java.sql.SQLSyntaxErrorException: ORA-00907: missing right parenthesis
> >>
> >> 11/07/27 08:11:05 INFO manager.SqlManager: Executing SQL statement:
> Select *
> >> from ENGINE_RAW_OUTPUT where ENGINE_POSITION=1  (1 = 0)
> >> 11/07/27 08:11:06 ERROR manager.SqlManager: Error executing statement:
> >> java.sql.SQLSyntaxErrorException: ORA-00907: missing right parenthesis
> >>
> >> java.sql.SQLSyntaxErrorException: ORA-00907: missing right parenthesis
> >>
> >>         at oracle.jdbc.driver.T4CTTIoer.processError(T4CTTIoer.java:440)
> >>         at oracle.jdbc.driver.T4CTTIoer.processError(T4CTTIoer.java:396)
> >>         at oracle.jdbc.driver.T4C8Oall.processError(T4C8Oall.java:837)
> >>         at oracle.jdbc.driver.T4CTTIfun.receive(T4CTTIfun.java:445)
> >>         at oracle.jdbc.driver.T4CTTIfun.doRPC(T4CTTIfun.java:191)
> >>         at oracle.jdbc.driver.T4C8Oall.doOALL(T4C8Oall.java:523)
> >>         at
> >>
> oracle.jdbc.driver.T4CPreparedStatement.doOall8(T4CPreparedStatement.java:207)
> >>         at
> >>
> oracle.jdbc.driver.T4CPreparedStatement.executeForDescribe(T4CPreparedStatement.java:863)
> >>         at
> >>
> oracle.jdbc.driver.OracleStatement.executeMaybeDescribe(OracleStatement.java:1153)
> >>         at
> >>
> oracle.jdbc.driver.OracleStatement.doExecuteWithTimeout(OracleStatement.java:1275)
> >>         at
> >>
> oracle.jdbc.driver.OraclePreparedStatement.executeInternal(OraclePreparedStatement.java:3576)
> >>         at
> >>
> oracle.jdbc.driver.OraclePreparedStatement.executeQuery(OraclePreparedStatement.java:3620)
> >>         at
> >>
> oracle.jdbc.driver.OraclePreparedStatementWrapper.executeQuery(OraclePreparedStatementWrapper.java:1491)
> >>         at
> >> com.cloudera.sqoop.manager.SqlManager.execute(SqlManager.java:442)
> >>         at
> >>
> com.cloudera.sqoop.manager.SqlManager.getColumnNamesForRawQuery(SqlManager.java:112)
> >>         at
> >>
> com.cloudera.sqoop.manager.SqlManager.getColumnNamesForQuery(SqlManager.java:103)
> >>         at
> com.cloudera.sqoop.orm.ClassWriter.generate(ClassWriter.java:927)
> >>         at
> >> com.cloudera.sqoop.tool.CodeGenTool.generateORM(CodeGenTool.java:82)
> >>         at
> >> com.cloudera.sqoop.tool.ImportTool.importTable(ImportTool.java:337)
> >>         at com.cloudera.sqoop.tool.ImportTool.run(ImportTool.java:423)
> >>         at com.cloudera.sqoop.Sqoop.run(Sqoop.java:144)
> >>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> >>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
> >>         at com.cloudera.sqoop.Sqoop.runSqoop(Sqoop.java:180)
> >>         at com.cloudera.sqoop.Sqoop.runTool(Sqoop.java:218)
> >>         at com.cloudera.sqoop.Sqoop.main(Sqoop.java:228)
> >> 11/07/27 08:11:06 ERROR sqoop.Sqoop: Got exception running Sqoop:
> >> java.lang.NullPointerException
> >> java.lang.NullPointerException
> >>         at
> >> com.cloudera.sqoop.orm.ClassWriter.cleanColNames(ClassWriter.java:889)
> >>         at
> com.cloudera.sqoop.orm.ClassWriter.generate(ClassWriter.java:951)
> >>         at
> >> com.cloudera.sqoop.tool.CodeGenTool.generateORM(CodeGenTool.java:82)
> >>         at
> >> com.cloudera.sqoop.tool.ImportTool.importTable(ImportTool.java:337)
> >>         at com.cloudera.sqoop.tool.ImportTool.run(ImportTool.java:423)
> >>         at com.cloudera.sqoop.Sqoop.run(Sqoop.java:144)
> >>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> >>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
> >>         at com.cloudera.sqoop.Sqoop.runSqoop(Sqoop.java:180)
> >>         at com.cloudera.sqoop.Sqoop.runTool(Sqoop.java:218)
> >>         at com.cloudera.sqoop.Sqoop.main(Sqoop.java:228)
> >>
> >>
> >>
> >> On Tue, Jul 26, 2011 at 5:02 PM, bejoy ks <bejoyks@gmail.com> wrote:
> >>>
> >>> Hi Arvind
> >>>             I did make  some deep dive to analye the same and below are
> a
> >>> few findings from my end. Hope it helps you to guide us in identifying
> the
> >>> root cause.
> >>>
> >>> Analysis 1
> >>> Tried the Sqoop import with oraoop enabled for the same query that
> failed
> >>> with the default jdbc driver
> >>> Sqoop command
> >>>
> >>> sqoop import -D oraoop.disabled=true --driver oracle.jdbc.OracleDriver
> >>> --connect jdbc:oracle:thin:@servername:
> >>>
> >>> port:SID --username <user name> --password <password>  --table
> >>> ENGINE_RAW_OUTPUT --split-by ENGINE_POSITION  --warehouse-dir
> >>> /userdata/bejoys/sqoop/ --num-mappers 15
> >>> Result
> >>> Getting an error as table or view doesn not exist.
> >>> Console log
> >>>
> >>> 11/07/26 05:45:51 WARN oraoop.OraOopManagerFactory: Unable to determine
> >>> the Oracle-type of the object named ENGINE_RAW_OUTPUT owned by <user
> name>.
> >>>
> >>> Error:
> >>>
> >>> ORA-00942: table or view does not exist
> >>>
> >>>
> >>>
> >>> 11/07/26 05:45:51 WARN oraoop.OraOopManagerFactory: Unable to determine
> >>> whether the Oracle table <user name>.ENGINE_RAW_OUTPUT is an
> index-organized
> >>> table.
> >>>
> >>> Error:
> >>>
> >>> ORA-00942: table or view does not exist
> >>>
> >>>
> >>>
> >>> 11/07/26 05:45:51 INFO oraoop.OraOopManagerFactory:
> >>>
> >>> ******************************************************************
> >>>
> >>> *** Using Quest® Data Connector for Oracle and Hadoop 1.3.0.81 ***
> >>>
> >>> *** Copyright 2011 Quest Software, Inc.                        ***
> >>>
> >>> *** ALL RIGHTS RESERVED.                                       ***
> >>>
> >>> ******************************************************************
> >>>
> >>> 11/07/26 05:45:51 INFO oraoop.OraOopManagerFactory: Oracle Database
> >>> version: Oracle9i Enterprise Edition Release 9.2.0.8.0 - 64bit
> Production
> >>>
> >>> 11/07/26 05:45:51 INFO oraoop.OraOopManagerFactory: This Oracle
> database
> >>> is not a RAC.
> >>>
> >>> 11/07/26 05:45:51 INFO tool.CodeGenTool: Beginning code generation
> >>>
> >>> 11/07/26 05:45:52 ERROR sqoop.Sqoop: Got exception running Sqoop:
> >>> java.lang.RuntimeException: java.sql.SQLSyntaxErrorException:
> ORA-00942:
> >>> table or view does not exist
> >>>
> >>>
> >>>
> >>> java.lang.RuntimeException: java.sql.SQLSyntaxErrorException:
> ORA-00942:
> >>> table or view does not exist
> >>>
> >>>
> >>>
> >>>         at
> >>>
> com.quest.oraoop.OraOopConnManager.getColumnNamesInOracleTable(OraOopConnManager.java:119)
> >>>
> >>>         at
> >>>
> com.quest.oraoop.OraOopConnManager.getSelectedColumnNamesInOracleTable(OraOopConnManager.java:130)
> >>>
> >>>         at
> >>>
> com.quest.oraoop.OraOopConnManager.getColTypesQuery(OraOopConnManager.java:193)
> >>>
> >>>         at
> >>>
> com.cloudera.sqoop.manager.SqlManager.getColumnTypes(SqlManager.java:160)
> >>>
> >>>         at
> >>>
> com.quest.oraoop.OraOopConnManager.getColumnTypes(OraOopConnManager.java:455)
> >>>
> >>>         at
> >>> com.cloudera.sqoop.orm.ClassWriter.generate(ClassWriter.java:908)
> >>>
> >>>         at
> >>> com.cloudera.sqoop.tool.CodeGenTool.generateORM(CodeGenTool.java:82)
> >>>
> >>>         at
> >>> com.cloudera.sqoop.tool.ImportTool.importTable(ImportTool.java:337)
> >>>
> >>>         at com.cloudera.sqoop.tool.ImportTool.run(ImportTool.java:423)
> >>>
> >>>         at com.cloudera.sqoop.Sqoop.run(Sqoop.java:144)
> >>>
> >>>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> >>>
> >>>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
> >>>
> >>>         at com.cloudera.sqoop.Sqoop.runSqoop(Sqoop.java:180)
> >>>
> >>>         at com.cloudera.sqoop.Sqoop.runTool(Sqoop.java:218)
> >>>
> >>>         at com.cloudera.sqoop.Sqoop.main(Sqoop.java:228)
> >>>
> >>> Caused by: java.sql.SQLSyntaxErrorException: ORA-00942: table or view
> does
> >>> not exist
> >>>
> >>>
> >>>
> >>>         at
> oracle.jdbc.driver.T4CTTIoer.processError(T4CTTIoer.java:440)
> >>>
> >>>         at
> oracle.jdbc.driver.T4CTTIoer.processError(T4CTTIoer.java:396)
> >>>
> >>>         at oracle.jdbc.driver.T4C8Oall.processError(T4C8Oall.java:837)
> >>>
> >>>         at oracle.jdbc.driver.T4CTTIfun.receive(T4CTTIfun.java:445)
> >>>
> >>>         at oracle.jdbc.driver.T4CTTIfun.doRPC(T4CTTIfun.java:191)
> >>>
> >>>         at oracle.jdbc.driver.T4C8Oall.doOALL(T4C8Oall.java:523)
> >>>
> >>>         at
> >>>
> oracle.jdbc.driver.T4CPreparedStatement.doOall8(T4CPreparedStatement.java:207)
> >>>
> >>>         at
> >>>
> oracle.jdbc.driver.T4CPreparedStatement.executeForDescribe(T4CPreparedStatement.java:863)
> >>>
> >>>         at
> >>>
> oracle.jdbc.driver.OracleStatement.executeMaybeDescribe(OracleStatement.java:1153)
> >>>
> >>>         at
> >>>
> oracle.jdbc.driver.OracleStatement.doExecuteWithTimeout(OracleStatement.java:1275)
> >>>
> >>>         at
> >>>
> oracle.jdbc.driver.OraclePreparedStatement.executeInternal(OraclePreparedStatement.java:3576)
> >>>
> >>>         at
> >>>
> oracle.jdbc.driver.OraclePreparedStatement.executeQuery(OraclePreparedStatement.java:3620)
> >>>
> >>>         at
> >>>
> oracle.jdbc.driver.OraclePreparedStatementWrapper.executeQuery(OraclePreparedStatementWrapper.java:1491)
> >>>
> >>>         at
> >>>
> com.quest.oraoop.OraOopOracleQueries.getTableColumns(OraOopOracleQueries.java:432)
> >>>
> >>>         at
> >>>
> com.quest.oraoop.OraOopOracleQueries.getTableColumns(OraOopOracleQueries.java:538)
> >>>
> >>>         at
> >>>
> com.quest.oraoop.OraOopOracleQueries.getTableColumnNames(OraOopOracleQueries.java:389)
> >>>
> >>>         at
> >>>
> com.quest.oraoop.OraOopConnManager.getColumnNamesInOracleTable(OraOopConnManager.java:109)
> >>>
> >>>         ... 14 more
> >>>
> >>> Analysis 2
> >>> Tried the Sqoop list tables command to check whether the table
> >>> ENGINE_RAW_OUTPUT would be listed
> >>> Sqoop command
> >>>
> >>> sqoop list-tables --driver oracle.jdbc.OracleDriver --connect
> >>> jdbc:oracle:thin:@servername:
> >>>
> >>> port:SID --username <user name> --password <password>
> >>> Result
> >>> The table name 'ENGINE_RAW_OUTPUT' is in the output list
> >>>
> >>> Analysis 3
> >>> Checked whether I could execute a Select Query on the database table
> using
> >>> Sqoop Eval tool
> >>> Sqoop command
> >>>
> >>> sqoop eval --driver oracle.jdbc.OracleDriver --connect
> >>> jdbc:oracle:thin:@servername:
> >>>
> >>> port:SID --username <user name> --password <password>
> >>>
> >>> --query "select * from ENGINE_RAW_OUTPUT"
> >>>
> >>> Result
> >>>
> >>> Command executed sucessfully returing the records
> >>>
> >>> Analysis 4
> >>>
> >>> Tried to execute the SQOOP generated sql query while doing SQOOP import
> >>> with SQOOP eval tool
> >>>
> >>> Sqoop command
> >>>
> >>> sqoop eval --driver oracle.jdbc.OracleDriver --connect
> >>> jdbc:oracle:thin:@servername:
> >>>
> >>> port:SID --username <user name> --password <password>
> >>>
> >>> --query "SELECT t.* FROM ENGINE_RAW_OUTPUT AS t WHERE 1=0"
> >>>
> >>> Result
> >>>
> >>> Error is thrown stating the SQL command is not properly ended.
> >>>
> >>> Console Log
> >>>
> >>> 11/07/26 06:06:50 WARN tool.EvalSqlTool: SQL exception executing
> >>> statement: java.sql.SQLSyntaxErrorException: ORA-00933: SQL command not
> >>> properly ended
> >>>
> >>>
> >>>
> >>>         at
> oracle.jdbc.driver.T4CTTIoer.processError(T4CTTIoer.java:440)
> >>>
> >>>         at
> oracle.jdbc.driver.T4CTTIoer.processError(T4CTTIoer.java:396)
> >>>
> >>>         at oracle.jdbc.driver.T4C8Oall.processError(T4C8Oall.java:837)
> >>>
> >>>         at oracle.jdbc.driver.T4CTTIfun.receive(T4CTTIfun.java:445)
> >>>
> >>>         at oracle.jdbc.driver.T4CTTIfun.doRPC(T4CTTIfun.java:191)
> >>>
> >>>         at oracle.jdbc.driver.T4C8Oall.doOALL(T4C8Oall.java:523)
> >>>
> >>>         at
> >>>
> oracle.jdbc.driver.T4CPreparedStatement.doOall8(T4CPreparedStatement.java:207)
> >>>
> >>>         at
> >>>
> oracle.jdbc.driver.T4CPreparedStatement.executeForDescribe(T4CPreparedStatement.java:863)
> >>>
> >>>         at
> >>>
> oracle.jdbc.driver.OracleStatement.executeMaybeDescribe(OracleStatement.java:1153)
> >>>
> >>>         at
> >>>
> oracle.jdbc.driver.OracleStatement.doExecuteWithTimeout(OracleStatement.java:1275)
> >>>
> >>>         at
> >>>
> oracle.jdbc.driver.OraclePreparedStatement.executeInternal(OraclePreparedStatement.java:3576)
> >>>
> >>>         at
> >>>
> oracle.jdbc.driver.OraclePreparedStatement.execute(OraclePreparedStatement.java:3677)
> >>>
> >>>         at
> >>>
> oracle.jdbc.driver.OraclePreparedStatementWrapper.execute(OraclePreparedStatementWrapper.java:1374)
> >>>
> >>>         at com.cloudera.sqoop.tool.EvalSqlTool.run(EvalSqlTool.java:68)
> >>>
> >>>         at com.cloudera.sqoop.Sqoop.run(Sqoop.java:144)
> >>>
> >>>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> >>>
> >>>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
> >>>
> >>>         at com.cloudera.sqoop.Sqoop.runSqoop(Sqoop.java:180)
> >>>
> >>>         at com.cloudera.sqoop.Sqoop.runTool(Sqoop.java:218)
> >>>
> >>>         at com.cloudera.sqoop.Sqoop.main(Sqoop.java:228)
> >>>
> >>>
> >>> On Tue, Jul 26, 2011 at 12:03 PM, Reju R <rejurs@gmail.com> wrote:
> >>>>
> >>>> Hi Arvind,
> >>>>      We have tried without the schema.table. I am providing the
> complete
> >>>> command and the error again I have got.
> >>>>
> >>>>
> >>>> Details regarding sqoop installation
> >>>>
> >>>> sqoop Installation : git commit id
> >>>> 455acc8dee10b6a3579358cccc3635241076391b
> >>>> Compiled by hudson@ubuntu-slave02 on Fri Mar 25 16:25:35 PDT 2011
> >>>>
> >>>> JDBC driver: ojdbc6.jar
> >>>>
> >>>> java version: 1.6.0_21
> >>>>
> >>>> hadoop version: Hadoop 0.20.2-cdh3u0
> >>>> Subversion  -r 81256ad0f2e4ab2bd34b04f53d25a6c23686dd14
> >>>> Compiled by root on Fri Mar 25 20:07:24 EDT 2011
> >>>> From source with checksum 6c1f62dddc4eac69b6b973c18bbc0f55
> >>>>
> >>>> Oracle database version: Oracle9i Enterprise Edition Release 9.2.0.8.0
> >>>> - 64bit
> >>>>                                      PL/SQL Release 9.2.0.8.0
> >>>>                                      "CORE 9.2.0.8.0"
> >>>>                                       TNS for Solaris: Version
> 9.2.0.8.0
> >>>>                                      NLSRTL Version 9.2.0.8.0
> >>>>
> >>>>
> >>>>
> >>>>
> >>>>
> >>>> OS Information
> >>>>
> >>>> Linux  2.6.18-128.el5 #1 SMP Wed Jan 21 08:45:05 EST 2009 x86_64
> >>>> x86_64 x86_64 GNU/Linux
> >>>>
> >>>>
> >>>> sqoop import  -D oraoop.disabled=true --driver
> oracle.jdbc.OracleDriver
> >>>> --connect jdbc:oracle:thin:@evnctpp1.ae.ge.com:1523:evnctpp1
> --username
> >>>> OPS\$NFNE049 -P --table ENGINE_RAW_OUTPUT --split-by AIRCRAFT_ID
> >>>> --warehouse-dir
> >>>>
> /userdata/aviation/ETL_PoC/engine_raw_output/engine_raw_output_oracle_test
> >>>> --hive-import --hive-table engine_raw_output_oracle_test --verbose
> >>>> 11/07/26 02:29:43 DEBUG tool.BaseSqoopTool: Enabled debug logging.
> >>>> Enter password:
> >>>> 11/07/26 02:30:02 INFO tool.BaseSqoopTool: Using Hive-specific
> delimiters
> >>>> for output. You can override
> >>>> 11/07/26 02:30:02 INFO tool.BaseSqoopTool: delimiters with
> >>>> --fields-terminated-by, etc.
> >>>> 11/07/26 02:30:02 DEBUG util.ClassLoaderStack: Checking for existing
> >>>> class: com.quest.oraoop.OraOopManagerFactory
> >>>> 11/07/26 02:30:02 DEBUG util.ClassLoaderStack: Class is already
> >>>> available. Skipping jar /usr/lib/sqoop/lib/oraoop-1.3.0.81.jar
> >>>> 11/07/26 02:30:02 DEBUG sqoop.ConnFactory: Added factory
> >>>> com.quest.oraoop.OraOopManagerFactory in jar
> >>>> /usr/lib/sqoop/lib/oraoop-1.3.0.81.jar specified by
> >>>> /usr/lib/sqoop/conf/managers.d/oraoop
> >>>> 11/07/26 02:30:02 DEBUG sqoop.ConnFactory: Loaded manager factory:
> >>>> com.quest.oraoop.OraOopManagerFactory
> >>>> 11/07/26 02:30:02 DEBUG sqoop.ConnFactory: Loaded manager factory:
> >>>> com.cloudera.sqoop.manager.DefaultManagerFactory
> >>>> 11/07/26 02:30:02 DEBUG sqoop.ConnFactory: Trying ManagerFactory:
> >>>> com.quest.oraoop.OraOopManagerFactory
> >>>> 11/07/26 02:30:02 DEBUG oraoop.OraOopUtilities: Enabled OraOop debug
> >>>> logging.
> >>>> 11/07/26 02:30:02 DEBUG oraoop.OraOopManagerFactory: Quest® Data
> >>>> Connector for Oracle and Hadoop can be called by Sqoop!
> >>>> 11/07/26 02:30:02 INFO oraoop.OraOopManagerFactory: Quest® Data
> >>>> Connector for Oracle and Hadoop is disabled.
> >>>> 11/07/26 02:30:02 DEBUG sqoop.ConnFactory: Trying ManagerFactory:
> >>>> com.cloudera.sqoop.manager.DefaultManagerFactory
> >>>> 11/07/26 02:30:02 DEBUG sqoop.ConnFactory: Instantiated ConnManager
> >>>> com.cloudera.sqoop.manager.GenericJdbcManager@5e7808b9
> >>>> 11/07/26 02:30:02 INFO tool.CodeGenTool: Beginning code generation
> >>>> 11/07/26 02:30:03 INFO manager.SqlManager: Executing SQL statement:
> >>>> SELECT t.* FROM ENGINE_RAW_OUTPUT AS t WHERE 1=0
> >>>> 11/07/26 02:30:03 ERROR manager.SqlManager: Error executing statement:
> >>>> java.sql.SQLSyntaxErrorException: ORA-00933: SQL command not properly
> ended
> >>>> 11/07/26 02:30:03 INFO manager.SqlManager: Executing SQL statement:
> >>>> SELECT t.* FROM ENGINE_RAW_OUTPUT AS t WHERE 1=0
> >>>> 11/07/26 02:30:04 ERROR manager.SqlManager: Error executing statement:
> >>>> java.sql.SQLSyntaxErrorException: ORA-00933: SQL command not properly
> ended
> >>>> java.sql.SQLSyntaxErrorException: ORA-00933: SQL command not properly
> >>>> ended
> >>>>         at
> oracle.jdbc.driver.T4CTTIoer.processError(T4CTTIoer.java:440)
> >>>>         at
> oracle.jdbc.driver.T4CTTIoer.processError(T4CTTIoer.java:396)
> >>>>         at oracle.jdbc.driver.T4C8Oall.processError(T4C8Oall.java:837)
> >>>>         at oracle.jdbc.driver.T4CTTIfun.receive(T4CTTIfun.java:445)
> >>>>         at oracle.jdbc.driver.T4CTTIfun.doRPC(T4CTTIfun.java:191)
> >>>>         at oracle.jdbc.driver.T4C8Oall.doOALL(T4C8Oall.java:523)
> >>>>         at
> >>>>
> oracle.jdbc.driver.T4CPreparedStatement.doOall8(T4CPreparedStatement.java:207)
> >>>>         at
> >>>>
> oracle.jdbc.driver.T4CPreparedStatement.executeForDescribe(T4CPreparedStatement.java:863)
> >>>>         at
> >>>>
> oracle.jdbc.driver.OracleStatement.executeMaybeDescribe(OracleStatement.java:1153)
> >>>>         at
> >>>>
> oracle.jdbc.driver.OracleStatement.doExecuteWithTimeout(OracleStatement.java:1275)
> >>>>         at
> >>>>
> oracle.jdbc.driver.OraclePreparedStatement.executeInternal(OraclePreparedStatement.java:3576)
> >>>>         at
> >>>>
> oracle.jdbc.driver.OraclePreparedStatement.executeQuery(OraclePreparedStatement.java:3620)
> >>>>         at
> >>>>
> oracle.jdbc.driver.OraclePreparedStatementWrapper.executeQuery(OraclePreparedStatementWrapper.java:1491)
> >>>>         at
> >>>> com.cloudera.sqoop.manager.SqlManager.execute(SqlManager.java:442)
> >>>>         at
> >>>>
> com.cloudera.sqoop.manager.SqlManager.getColumnNamesForRawQuery(SqlManager.java:112)
> >>>>         at
> >>>>
> com.cloudera.sqoop.manager.SqlManager.getColumnNames(SqlManager.java:96)
> >>>>         at
> >>>> com.cloudera.sqoop.orm.ClassWriter.generate(ClassWriter.java:924)
> >>>>         at
> >>>> com.cloudera.sqoop.tool.CodeGenTool.generateORM(CodeGenTool.java:82)
> >>>>         at
> >>>> com.cloudera.sqoop.tool.ImportTool.importTable(ImportTool.java:337)
> >>>>         at com.cloudera.sqoop.tool.ImportTool.run(ImportTool.java:423)
> >>>>         at com.cloudera.sqoop.Sqoop.run(Sqoop.java:144)
> >>>>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> >>>>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
> >>>>         at com.cloudera.sqoop.Sqoop.runSqoop(Sqoop.java:180)
> >>>>         at com.cloudera.sqoop.Sqoop.runTool(Sqoop.java:218)
> >>>>         at com.cloudera.sqoop.Sqoop.main(Sqoop.java:228)
> >>>> 11/07/26 02:30:04 ERROR sqoop.Sqoop: Got exception running Sqoop:
> >>>> java.lang.NullPointerException
> >>>> java.lang.NullPointerException
> >>>>         at
> >>>> com.cloudera.sqoop.orm.ClassWriter.cleanColNames(ClassWriter.java:889)
> >>>>         at
> >>>> com.cloudera.sqoop.orm.ClassWriter.generate(ClassWriter.java:951)
> >>>>         at
> >>>> com.cloudera.sqoop.tool.CodeGenTool.generateORM(CodeGenTool.java:82)
> >>>>         at
> >>>> com.cloudera.sqoop.tool.ImportTool.importTable(ImportTool.java:337)
> >>>>         at com.cloudera.sqoop.tool.ImportTool.run(ImportTool.java:423)
> >>>>         at com.cloudera.sqoop.Sqoop.run(Sqoop.java:144)
> >>>>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> >>>>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
> >>>>         at com.cloudera.sqoop.Sqoop.runSqoop(Sqoop.java:180)
> >>>>         at com.cloudera.sqoop.Sqoop.runTool(Sqoop.java:218)
> >>>>         at com.cloudera.sqoop.Sqoop.main(Sqoop.java:228)
> >>>>
> >>>>
> >>>> On Tue, Jul 26, 2011 at 10:34 AM, <bejoyks@gmail.com> wrote:
> >>>>>
> >>>>> Reju
> >>>>>     Arvind's response to the post. Please respond with the details on
> to
> >>>>> sqoop-user@incubator.apache.org , the new mailing list
> >>>>>
> >>>>> Regards
> >>>>> Bejoy K S
> >>>>>
> >>>>> -----Original Message-----
> >>>>> From: Arvind Prabhakar <arvind@apache.org>
> >>>>> Date: Mon, 25 Jul 2011 13:08:27
> >>>>> To: <sqoop-user@incubator.apache.org>; <bejoyks@gmail.com>
> >>>>> Subject: Re: Fw: [sqoop-user] sqoop import shows ORA-00933: SQL
> command
> >>>>> not
> >>>>>  properlyended error
> >>>>>
> >>>>> Bejoy,
> >>>>>
> >>>>> In the import statement, are you providing the table name using a
> >>>>> schema qualifier prefix (schema.table)? If so, that could be the
> >>>>> problem. See SQOOP-222 [1] for details.  If this indeed is the issue
> >>>>> you are running into, a work-around would be to change the table name
> >>>>> to a simple table name and use the username/password of the account
> >>>>> that owns the schema.
> >>>>>
> >>>>> If doing the above does not fix the problem, please provide more
> >>>>> details about the version of Sqoop, and the complete command you
> >>>>> issued (with masked password).
> >>>>>
> >>>>> [1] https://issues.cloudera.org/browse/SQOOP-222
> >>>>>
> >>>>> Thanks,
> >>>>> Arvind
> >>>>>
> >>>>> On Mon, Jul 25, 2011 at 10:16 AM,  <bejoyks@gmail.com> wrote:
> >>>>> > Redirecting the message to new apache sqoop mailing list
> >>>>> > Regards
> >>>>> > Bejoy K S
> >>>>> >
> >>>>> > -----Original Message-----
> >>>>> > From: reju <rejurs@gmail.com>
> >>>>> > Date: Mon, 25 Jul 2011 09:41:29
> >>>>> > To: Sqoop Users<sqoop-user@cloudera.org>
> >>>>> > Reply-To: sqoop-user@cloudera.org
> >>>>> > Subject: [sqoop-user] sqoop import shows ORA-00933: SQL command not
> >>>>> > properly
> >>>>> >  ended error
> >>>>> >
> >>>>> > sqoop import  -D  oraoop.disabled=true --driver
> >>>>> > oracle.jdbc.OracleDriver --connect
> >>>>> > jdbc:oracle:thin:@servername:port:SID --username username
> -password
> >>>>> >
> >>>>> > password --table tablename --split-by fielname --warehouse-dir
> >>>>> > warehusedirectory --hive-import --hive-table tabelname --verbose
> >>>>> >
> >>>>> > 11/07/25 12:37:43 DEBUG tool.BaseSqoopTool: Enabled debug logging.
> >>>>> > 11/07/25 12:37:43 WARN tool.BaseSqoopTool: Setting your password on
> >>>>> > the command-line is insecure. Consider using -P instead.
> >>>>> > 11/07/25 12:37:43 INFO tool.BaseSqoopTool: Using Hive-specific
> >>>>> > delimiters for output. You can override
> >>>>> > 11/07/25 12:37:43 INFO tool.BaseSqoopTool: delimiters with
> --fields-
> >>>>> > terminated-by, etc.
> >>>>> > 11/07/25 12:37:43 DEBUG util.ClassLoaderStack: Checking for
> existing
> >>>>> > class: com.quest.oraoop.OraOopManagerFactory
> >>>>> > 11/07/25 12:37:43 DEBUG util.ClassLoaderStack: Class is already
> >>>>> > available. Skipping jar /usr/lib/sqoop/lib/oraoop-1.3.0.81.jar
> >>>>> > 11/07/25 12:37:43 DEBUG sqoop.ConnFactory: Added factory
> >>>>> > com.quest.oraoop.OraOopManagerFactory in jar /usr/lib/sqoop/lib/
> >>>>> > oraoop-1.3.0.81.jar specified by
> >>>>> >
> >>>>> > /usr/lib/sqoop/conf/managers.d/oraoop
> >>>>> > 11/07/25 12:37:43 DEBUG sqoop.ConnFactory: Loaded manager factory:
> >>>>> > com.quest.oraoop.OraOopManagerFactory
> >>>>> > 11/07/25 12:37:43 DEBUG sqoop.ConnFactory: Loaded manager factory:
> >>>>> > com.cloudera.sqoop.manager.DefaultManagerFactory
> >>>>> > 11/07/25 12:37:43 DEBUG sqoop.ConnFactory: Trying ManagerFactory:
> >>>>> > com.quest.oraoop.OraOopManagerFactory
> >>>>> > 11/07/25 12:37:43 DEBUG oraoop.OraOopUtilities: Enabled OraOop
> debug
> >>>>> > logging.
> >>>>> > 11/07/25 12:37:43 DEBUG oraoop.OraOopManagerFactory: Quest® Data
> >>>>> > Connector for Oracle and Hadoop can be called by Sqoop!
> >>>>> > 11/07/25 12:37:43 INFO oraoop.OraOopManagerFactory: Quest® Data
> >>>>> > Connector for Oracle and Hadoop is disabled.
> >>>>> > 11/07/25 12:37:43 DEBUG sqoop.ConnFactory: Trying ManagerFactory:
> >>>>> > com.cloudera.sqoop.manager.DefaultManagerFactory
> >>>>> > 11/07/25 12:37:43 DEBUG sqoop.ConnFactory: Instantiated ConnManager
> >>>>> > com.cloudera.sqoop.manager.GenericJdbcManager@851052d
> >>>>> > 11/07/25 12:37:43 INFO tool.CodeGenTool: Beginning code generation
> >>>>> > 11/07/25 12:37:44 INFO manager.SqlManager: Executing SQL statement:
> >>>>> > SELECT t.* FROM ENGINE_RAW_OUTPUT AS t WHERE 1=0
> >>>>> > 11/07/25 12:37:44 ERROR manager.SqlManager: Error executing
> statement:
> >>>>> > java.sql.SQLSyntaxErrorException: ORA-00933: SQL command not
> properly
> >>>>> > ended
> >>>>> >
> >>>>> > 11/07/25 12:37:44 INFO manager.SqlManager: Executing SQL statement:
> >>>>> > SELECT t.* FROM ENGINE_RAW_OUTPUT AS t WHERE 1=0
> >>>>> > 11/07/25 12:37:44 ERROR manager.SqlManager: Error executing
> statement:
> >>>>> > java.sql.SQLSyntaxErrorException: ORA-00933: SQL command not
> properly
> >>>>> > ended
> >>>>> >
> >>>>> > java.sql.SQLSyntaxErrorException: ORA-00933: SQL command not
> properly
> >>>>> > ended
> >>>>> >
> >>>>> >        at oracle.jdbc.driver.T4CTTIoer.processError(T4CTTIoer.java:
> >>>>> > 440)
> >>>>> >        at oracle.jdbc.driver.T4CTTIoer.processError(T4CTTIoer.java:
> >>>>> > 396)
> >>>>> >        at
> oracle.jdbc.driver.T4C8Oall.processError(T4C8Oall.java:837)
> >>>>> >        at oracle.jdbc.driver.T4CTTIfun.receive(T4CTTIfun.java:445)
> >>>>> >        at oracle.jdbc.driver.T4CTTIfun.doRPC(T4CTTIfun.java:191)
> >>>>> >        at oracle.jdbc.driver.T4C8Oall.doOALL(T4C8Oall.java:523)
> >>>>> >        at
> >>>>> >
> >>>>> >
> oracle.jdbc.driver.T4CPreparedStatement.doOall8(T4CPreparedStatement.java:
> >>>>> > 207)
> >>>>> >        at
> >>>>> >
> >>>>> >
> oracle.jdbc.driver.T4CPreparedStatement.executeForDescribe(T4CPreparedStatement.java:
> >>>>> > 863)
> >>>>> >        at
> >>>>> >
> >>>>> >
> oracle.jdbc.driver.OracleStatement.executeMaybeDescribe(OracleStatement.java:
> >>>>> > 1153)
> >>>>> >        at
> >>>>> >
> >>>>> >
> oracle.jdbc.driver.OracleStatement.doExecuteWithTimeout(OracleStatement.java:
> >>>>> > 1275)
> >>>>> >        at
> >>>>> >
> >>>>> >
> oracle.jdbc.driver.OraclePreparedStatement.executeInternal(OraclePreparedStatement.java:
> >>>>> > 3576)
> >>>>> >        at
> >>>>> >
> >>>>> >
> oracle.jdbc.driver.OraclePreparedStatement.executeQuery(OraclePreparedStatement.java:
> >>>>> > 3620)
> >>>>> >        at
> >>>>> >
> >>>>> >
> oracle.jdbc.driver.OraclePreparedStatementWrapper.executeQuery(OraclePreparedStatementWrapper.java:
> >>>>> > 1491)
> >>>>> >        at
> >>>>> > com.cloudera.sqoop.manager.SqlManager.execute(SqlManager.java:442)
> >>>>> >        at
> >>>>> >
> >>>>> >
> com.cloudera.sqoop.manager.SqlManager.getColumnNamesForRawQuery(SqlManager.java:
> >>>>> > 112)
> >>>>> >        at
> >>>>> >
> com.cloudera.sqoop.manager.SqlManager.getColumnNames(SqlManager.java:
> >>>>> > 96)
> >>>>> >        at
> >>>>> > com.cloudera.sqoop.orm.ClassWriter.generate(ClassWriter.java:924)
> >>>>> >        at
> >>>>> >
> com.cloudera.sqoop.tool.CodeGenTool.generateORM(CodeGenTool.java:82)
> >>>>> >        at
> >>>>> > com.cloudera.sqoop.tool.ImportTool.importTable(ImportTool.java:337)
> >>>>> >        at
> com.cloudera.sqoop.tool.ImportTool.run(ImportTool.java:423)
> >>>>> >        at com.cloudera.sqoop.Sqoop.run(Sqoop.java:144)
> >>>>> >        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> >>>>> >        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
> >>>>> >        at com.cloudera.sqoop.Sqoop.runSqoop(Sqoop.java:180)
> >>>>> >        at com.cloudera.sqoop.Sqoop.runTool(Sqoop.java:218)
> >>>>> >        at com.cloudera.sqoop.Sqoop.main(Sqoop.java:228)
> >>>>> > 11/07/25 12:37:44 ERROR sqoop.Sqoop: Got exception running Sqoop:
> >>>>> > java.lang.NullPointerException
> >>>>> > java.lang.NullPointerException
> >>>>> >        at
> >>>>> >
> com.cloudera.sqoop.orm.ClassWriter.cleanColNames(ClassWriter.java:889)
> >>>>> >        at
> >>>>> > com.cloudera.sqoop.orm.ClassWriter.generate(ClassWriter.java:951)
> >>>>> >        at
> >>>>> >
> com.cloudera.sqoop.tool.CodeGenTool.generateORM(CodeGenTool.java:82)
> >>>>> >        at
> >>>>> > com.cloudera.sqoop.tool.ImportTool.importTable(ImportTool.java:337)
> >>>>> >        at
> com.cloudera.sqoop.tool.ImportTool.run(ImportTool.java:423)
> >>>>> >        at com.cloudera.sqoop.Sqoop.run(Sqoop.java:144)
> >>>>> >        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> >>>>> >        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
> >>>>> >        at com.cloudera.sqoop.Sqoop.runSqoop(Sqoop.java:180)
> >>>>> >        at com.cloudera.sqoop.Sqoop.runTool(Sqoop.java:218)
> >>>>> >        at com.cloudera.sqoop.Sqoop.main(Sqoop.java:228)
> >>>>> >
> >>>>> > --
> >>>>> > NOTE: The mailing list sqoop-user@cloudera.org is deprecated in
> favor
> >>>>> > of Apache Sqoop mailing list sqoop-user@incubator.apache.org.
> Please
> >>>>> > subscribe to it by sending an email to
> >>>>> > incubator-sqoop-user-subscribe@apache.org.
> >>>>> >
> >>>>
> >>>>
> >>>>
> >>>> --
> >>>> Thanks and Regards
> >>>> Reju. R
> >>>
> >>>
> >>>
> >>> --
> >>> Regards
> >>>        Bejoy
> >>
> >>
> >>
> >> --
> >> Regards
> >>        Bejoy
> >>
> >
>



-- 
Regards
       Bejoy

Mime
View raw message