sqoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Zhou, Richard" <richard.z...@intel.com>
Subject RE: Issue with incremental Import !!!
Date Tue, 16 Jun 2015 06:57:18 GMT
Hey Sanjiv Signh:

Thanks for your information. Would you raise a JIRA in https://issues.apache.org/jira/issues/?filter=-1
? And we will try to fix it. But it will take some time, we need do full testing, and it will
be fixed in the next release.
If you are urgent, you could follow http://sqoop.apache.org/docs/1.4.6/SqoopDevGuide.html
to download the source code for Sqoop1 and fix and build it yourself.
Let me know if you have trouble on it. Thanks.


Regards
Richard

From: @Sanjiv Singh [mailto:sanjiv.is.on@gmail.com]
Sent: Tuesday, June 16, 2015 11:52 AM
To: user@sqoop.apache.org
Subject: Re: Issue with incremental Import !!!

Hi
I have walked through implementation of method org.apache.sqoop.manager.SqlManager.getCurrentDbTimestamp()


  protected String getCurTimestampQuery() {

    return "SELECT CURRENT_TIMESTAMP()";

  }

SqlManager uses "SELECT CURRENT_TIMESTAMP();" to get current timestamp which is syntactically
incorrect.
For teradata, It should be "SELECT CURRENT_TIMESTAMP;"

Please help me in resolving the issue.

Regards,
Sanjiv Singh

[http://grepcode.com/static/app/images/1x1.gif]<http://grepcode.com/file/repository.cloudera.com/content/repositories/releases/org.apache.sqoop/sqoop/1.4.5-cdh5.3.2/org/apache/sqoop/manager/SqlManager.java>



Regards
Sanjiv Singh
Mob :  +091 9990-447-339

On Tue, Jun 16, 2015 at 9:09 AM, @Sanjiv Singh <sanjiv.is.on@gmail.com<mailto:sanjiv.is.on@gmail.com>>
wrote:
Hi,

I am trying incremental import  through SQOOP from Teradata to Hadoop. which is not working
in my case.

It seems from error that SQOOP internally creating SQL which are syntactically incorrect.
I even tried with --verbose option ....no usefull info.

Here is Table schema at Teradata which I am importing to Hadoop :

CREATE TABLE Employee
(EmpNo INT NOT NULL,
EmpName CHAR(30),
DOB DATE,
Mob integer,
LastUpdated timestamp
);
Here is import command  :

>> sqoop import --connect jdbc:teradata://XXXXXXXX/Database=XXXXX  --driver com.teradata.jdbc.TeraDriver
--username XXXXX --password XXXXXX  --table Employee --target-dir /user/hive/incremental_emp_table
-m 1 --check-column LastUpdated --incremental lastmodified --last-value "2001-12-17 07:36:01.280000"

Warning: /usr/share/hadoop_echosystem/sqoop-1.4.5//../accumulo does not exist! Accumulo imports
will fail.
Please set $ACCUMULO_HOME to the root of your Accumulo installation.
Warning: /usr/share/hadoop_echosystem/sqoop-1.4.5//../zookeeper does not exist! Accumulo imports
will fail.
Please set $ZOOKEEPER_HOME to the root of your Zookeeper installation.
Note: /tmp/sqoop-cloud/compile/917cdf768aea5267d838a949502ed0d0/Employee.java uses or overrides
a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/usr/share/hadoop_echosystem/hadoop-2.6.0/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/usr/share/hadoop_echosystem/hbase-0.96.1-hadoop2/lib/slf4j-log4j12-1.6.4.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/usr/share/hadoop_echosystem/apache-hive-1.0.0-bin/lib/hive-jdbc-1.0.0-standalone.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
15/06/16 14:20:16 ERROR manager.SqlManager: SQL exception accessing current timestamp: com.teradata.jdbc.jdbc_4.util.JDBCException:
[Teradata Database] [TeraJDBC 14.10.00.26] [Error 3706] [SQLState 42000] Syntax error: expected
something between '(' and ')'.
com.teradata.jdbc.jdbc_4.util.JDBCException: [Teradata Database] [TeraJDBC 14.10.00.26] [Error
3706] [SQLState 42000] Syntax error: expected something between '(' and ')'.
    at com.teradata.jdbc.jdbc_4.util.ErrorFactory.makeDatabaseSQLException(ErrorFactory.java:307)
    at com.teradata.jdbc.jdbc_4.statemachine.ReceiveInitSubState.action(ReceiveInitSubState.java:109)
    at com.teradata.jdbc.jdbc_4.statemachine.StatementReceiveState.subStateMachine(StatementReceiveState.java:314)
    at com.teradata.jdbc.jdbc_4.statemachine.StatementReceiveState.action(StatementReceiveState.java:202)
    at com.teradata.jdbc.jdbc_4.statemachine.StatementController.runBody(StatementController.java:123)
    at com.teradata.jdbc.jdbc_4.statemachine.StatementController.run(StatementController.java:114)
    at com.teradata.jdbc.jdbc_4.TDStatement.executeStatement(TDStatement.java:384)
    at com.teradata.jdbc.jdbc_4.TDStatement.executeStatement(TDStatement.java:326)
    at com.teradata.jdbc.jdbc_4.TDStatement.doNonPrepExecuteQuery(TDStatement.java:314)
    at com.teradata.jdbc.jdbc_4.TDStatement.executeQuery(TDStatement.java:1091)
    at org.apache.sqoop.manager.SqlManager.getCurrentDbTimestamp(SqlManager.java:960)
    at org.apache.sqoop.tool.ImportTool.initIncrementalConstraints(ImportTool.java:328)
    at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:488)
    at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:601)
    at org.apache.sqoop.Sqoop.run(Sqoop.java:143)
    at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
    at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:179)
    at org.apache.sqoop.Sqoop.runTool(Sqoop.java:218)
    at org.apache.sqoop.Sqoop.runTool(Sqoop.java:227)
    at org.apache.sqoop.Sqoop.main(Sqoop.java:236)
15/06/16 14:20:16 ERROR tool.ImportTool: Encountered IOException running import job: java.io.IOException:
Could not get current time from database
    at org.apache.sqoop.tool.ImportTool.initIncrementalConstraints(ImportTool.java:330)
    at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:488)
    at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:601)
    at org.apache.sqoop.Sqoop.run(Sqoop.java:143)
    at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
    at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:179)
    at org.apache.sqoop.Sqoop.runTool(Sqoop.java:218)
    at org.apache.sqoop.Sqoop.runTool(Sqoop.java:227)
    at org.apache.sqoop.Sqoop.main(Sqoop.java:236)


Any help highly appreciated.

Regards
Sanjiv Singh
Mob :  +091 9990-447-339


Mime
View raw message