sqoop-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Veena Basavaraj (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SQOOP-1815) Date and DateTime is not encoded in Single Quotes ( + unit tests)
Date Thu, 04 Dec 2014 00:19:12 GMT

    [ https://issues.apache.org/jira/browse/SQOOP-1815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14233699#comment-14233699
] 

Veena Basavaraj commented on SQOOP-1815:
----------------------------------------

So after giving up on trying to debug the MR job on MiniCluster, I tried a real cluster and
here is the interesting thing. Now the JODA time needs to be added to MR dependencies

{code}
2014-12-03 16:12:52,114 INFO [OutputFormatLoader-consumer] org.apache.sqoop.job.mr.SqoopOutputFormatLoadExecutor:
Loader has finished
2014-12-03 16:12:52,115 INFO [main] org.apache.sqoop.job.mr.SqoopOutputFormatLoadExecutor:
SqoopOutputFormatLoadExecutor::SqoopRecordWriter is closed
2014-12-03 16:12:52,116 FATAL [main] org.apache.hadoop.mapred.YarnChild: Error running child
: java.lang.NoSuchMethodError: org.joda.time.LocalDate.parse(Ljava/lang/String;)Lorg/joda/time/LocalDate;
	at org.apache.sqoop.connector.idf.CSVIntermediateDataFormat.parseCSVStringArrayElement(CSVIntermediateDataFormat.java:264)
	at org.apache.sqoop.connector.idf.CSVIntermediateDataFormat.getObjectData(CSVIntermediateDataFormat.java:226)
	at org.apache.sqoop.job.mr.SqoopMapper$SqoopMapDataWriter.writeContent(SqoopMapper.java:148)
	at org.apache.sqoop.job.mr.SqoopMapper$SqoopMapDataWriter.writeArrayRecord(SqoopMapper.java:125)
	at org.apache.sqoop.connector.jdbc.GenericJdbcExtractor.extract(GenericJdbcExtractor.java:96)
	at org.apache.sqoop.connector.jdbc.GenericJdbcExtractor.extract(GenericJdbcExtractor.java:38)
	at org.apache.sqoop.job.mr.SqoopMapper.run(SqoopMapper.java:94)
	at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:784)
	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
	at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168)
	at java.security.AccessController.doPrivileged(Native Method)

{code}

[~jarcec] can you comment?

> Date and DateTime is not encoded in Single Quotes  ( + unit tests)
> ------------------------------------------------------------------
>
>                 Key: SQOOP-1815
>                 URL: https://issues.apache.org/jira/browse/SQOOP-1815
>             Project: Sqoop
>          Issue Type: Sub-task
>          Components: sqoop2-framework
>            Reporter: Veena Basavaraj
>            Assignee: Veena Basavaraj
>             Fix For: 1.99.5
>
>         Attachments: SQOOP-1815-v2.patch, SQOOP-1815-v5.patch, SQOOP-1815.patch
>
>
> I deem this is a BUG in the current code where the date and date time encoded in single
quotes. 
> Correction: as the bug says, it is not encoded.!



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message