sqoop-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "suresh kumar (JIRA)" <j...@apache.org>
Subject [jira] [Created] (SQOOP-3401) sqoop import incremental last modified failed
Date Wed, 24 Oct 2018 14:08:00 GMT
suresh kumar created SQOOP-3401:
-----------------------------------

             Summary: sqoop import incremental last modified failed
                 Key: SQOOP-3401
                 URL: https://issues.apache.org/jira/browse/SQOOP-3401
             Project: Sqoop
          Issue Type: Bug
            Reporter: suresh kumar


I am trying to do incremental last modified using sqoop

sqoop job --create IncrementalImport \

-- import \

--connect 'jdbc:sqlserver://servername;username=xxxxx;password=xxxx;database=xxxx' \

--driver "com.microsoft.sqlserver.jdbc.SQLServerDriver" \

--table table_name \

--target-dir /dir_name \

--incremental lastmodified \

--check-column date \

--merge-key primary_key_column \

-m 1

I am getting the issue when executing the sqoop job --exec IncrementalImport

Warning: /usr/hdp/2.6.5.0-292/accumulo does not exist! Accumulo imports will fail. Please
set $ACCUMULO_HOME to the root of your Accumulo installation. Picked up JAVA_TOOL_OPTIONS:
-Xmx1024m -Djava.io.tmpdir=/h/tmp 18/10/24 08:27:40 INFO sqoop.Sqoop: Running Sqoop version:
1.4.6.2.6.5.0-292 ssound13@hpchdd2e:~> sqoop job --exec IncrementalImportLastModified Warning:
/usr/hdp/2.6.5.0-292/accumulo does not exist! Accumulo imports will fail. Please set $ACCUMULO_HOME
to the root of your Accumulo installation. Picked up JAVA_TOOL_OPTIONS: -Xmx1024m -Djava.io.tmpdir=/h/tmp
18/10/24 08:27:57 INFO sqoop.Sqoop: Running Sqoop version: 1.4.6.2.6.5.0-292 18/10/24 08:27:58
WARN sqoop.ConnFactory: Parameter --driver is set to an explicit driver however appropriate
connection manager is not being set (via --connection-manager). Sqoop is going to fall back
to org.apache.sqoop.manager.GenericJdbcManager. Please specify explicitly which connection
manager should be used next time. 18/10/24 08:27:58 INFO manager.SqlManager: Using default
fetchSize of 1000 18/10/24 08:27:58 INFO tool.CodeGenTool: Beginning code generation 18/10/24
08:27:59 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM table_name AS t
WHERE 1=0 18/10/24 08:27:59 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM
table_name AS t WHERE 1=0 18/10/24 08:27:59 INFO orm.CompilationManager: HADOOP_MAPRED_HOME
is /usr/hdp/2.6.5.0-292/hadoop-mapreduce Note: /tmp/sqoop-ssound13/compile/48dc5192c1b8869fb61635da887c3aa0/table_name.java
uses or overrides a deprecated API. Note: Recompile with -Xlint:deprecation for details. 18/10/24
08:28:00 INFO orm.CompilationManager: Writing jar file: /tmp/sqoop-ssound13/compile/48dc5192c1b8869fb61635da887c3aa0/Attrib_Type.jar
18/10/24 08:28:01 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM table_name
AS t WHERE 1=0 18/10/24 08:28:01 ERROR manager.SqlManager: SQL exception accessing current
timestamp: com.microsoft.sqlserver.jdbc.SQLServerException: Incorrect syntax near ')'. com.microsoft.sqlserver.jdbc.SQLServerException:
Incorrect syntax near ')'. at com.microsoft.sqlserver.jdbc.SQLServerException.makeFromDatabaseError(SQLServerException.java:216)
at com.microsoft.sqlserver.jdbc.SQLServerStatement.getNextResult(SQLServerStatement.java:1515)
at com.microsoft.sqlserver.jdbc.SQLServerStatement.doExecuteStatement(SQLServerStatement.java:792)
at com.microsoft.sqlserver.jdbc.SQLServerStatement$StmtExecCmd.doExecute(SQLServerStatement.java:689)
at com.microsoft.sqlserver.jdbc.TDSCommand.execute(IOBuffer.java:5696) at com.microsoft.sqlserver.jdbc.SQLServerConnection.executeCommand(SQLServerConnection.java:1715)
at com.microsoft.sqlserver.jdbc.SQLServerStatement.executeCommand(SQLServerStatement.java:180)
at com.microsoft.sqlserver.jdbc.SQLServerStatement.executeStatement(SQLServerStatement.java:155)
at com.microsoft.sqlserver.jdbc.SQLServerStatement.executeQuery(SQLServerStatement.java:616)
at org.apache.sqoop.manager.SqlManager.getCurrentDbTimestamp(SqlManager.java:987) at org.apache.sqoop.tool.ImportTool.initIncrementalConstraints(ImportTool.java:328)
at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:498) at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:615)
at org.apache.sqoop.tool.JobTool.execJob(JobTool.java:243) at org.apache.sqoop.tool.JobTool.run(JobTool.java:298)
at org.apache.sqoop.Sqoop.run(Sqoop.java:147) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)
at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:183) at org.apache.sqoop.Sqoop.runTool(Sqoop.java:225)
at org.apache.sqoop.Sqoop.runTool(Sqoop.java:234) at org.apache.sqoop.Sqoop.main(Sqoop.java:243)
18/10/24 08:28:01 ERROR tool.ImportTool: Encountered IOException running import job: java.io.IOException:
Could not get current time from database at org.apache.sqoop.tool.ImportTool.initIncrementalConstraints(ImportTool.java:330)
at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:498) at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:615)
at org.apache.sqoop.tool.JobTool.execJob(JobTool.java:243) at org.apache.sqoop.tool.JobTool.run(JobTool.java:298)
at org.apache.sqoop.Sqoop.run(Sqoop.java:147) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)
at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:183) at org.apache.sqoop.Sqoop.runTool(Sqoop.java:225)
at org.apache.sqoop.Sqoop.runTool(Sqoop.java:234) at org.apache.sqoop.Sqoop.main(Sqoop.java:243)

can anyone please help reg the issue

in the sql server the last modified column has datatype as datetime - yyyy-mm-dd 00:00:000.0000



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message