sqoop-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Veena Basavaraj (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SQOOP-1815) Date and DateTime is not encoded in Single Quotes ( + unit tests)
Date Wed, 03 Dec 2014 23:12:12 GMT

    [ https://issues.apache.org/jira/browse/SQOOP-1815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14233652#comment-14233652
] 

Veena Basavaraj commented on SQOOP-1815:
----------------------------------------

Also something odd I have noticed in the sqoop log locally...
file:///var/folders/l8/hyl1hnqj3vq57gdf8f9nb0740000gp/T/sqoop-cargo-tests/org.apache.sqoop.integration.connector.jdbc.generic.PartitionerTest/testSplitter[id-5-5]/log/sqoop.log

It is missing the load phase in the TO, even though it prints about HdfdLoader been used.

Soon after the 

2014-12-03 14:52:53,192 DEBUG mr.SqoopInputFormat [org.apache.sqoop.job.mr.SqoopInputFormat.getSplits(SqoopInputFormat.java:77)]
Partition: 16 <= "id" AND "id" <= 19

there is the next message of 

2014-12-03 14:52:53,576 DEBUG mapreduce.MapreduceSubmissionEngine [org.apache.sqoop.submission.mapreduce.MapreduceSubmissionEngine.submit(MapreduceSubmissionEngine.java:253)]
Executed new map-reduce job with id job_1417647106005_0002

{code}
2014-12-03 14:52:51,485 DEBUG driver.JobManager [org.apache.sqoop.driver.JobManager.createJobRequest(JobManager.java:377)]
Using entities: From{initializer=org.apache.sqoop.connector.jdbc.GenericJdbcFromInitializer,
destroyer=org.apache.sqoop.connector.jdbc.GenericJdbcFromDestroyer, partitioner=org.apache.sqoop.connector.jdbc.GenericJdbcPartitioner,
extractor=org.apache.sqoop.connector.jdbc.GenericJdbcExtractor}, To {initializer=org.apache.sqoop.connector.hdfs.HdfsToInitializer,
destroyer=org.apache.sqoop.connector.hdfs.HdfsToDestroyer, loader=class org.apache.sqoop.connector.hdfs.HdfsLoader}
2014-12-03 14:52:51,491 DEBUG repository.JdbcRepositoryTransaction [org.apache.sqoop.repository.JdbcRepositoryTransaction.begin(JdbcRepositoryTransaction.java:73)]
Tx count-begin: 1, rollback: false
2014-12-03 14:52:51,513 DEBUG repository.JdbcRepositoryTransaction [org.apache.sqoop.repository.JdbcRepositoryTransaction.commit(JdbcRepositoryTransaction.java:84)]
Tx count-commit: 1, rollback: false
2014-12-03 14:52:51,513 DEBUG repository.JdbcRepositoryTransaction [org.apache.sqoop.repository.JdbcRepositoryTransaction.close(JdbcRepositoryTransaction.java:103)]
Tx count-close: 0, rollback: false
2014-12-03 14:52:51,513 INFO  repository.JdbcRepositoryTransaction [org.apache.sqoop.repository.JdbcRepositoryTransaction.close(JdbcRepositoryTransaction.java:111)]
Attempting transaction commit
2014-12-03 14:52:53,190 DEBUG mr.SqoopInputFormat [org.apache.sqoop.job.mr.SqoopInputFormat.getSplits(SqoopInputFormat.java:77)]
Partition: 1 <= "id" AND "id" < 5
2014-12-03 14:52:53,191 DEBUG mr.SqoopInputFormat [org.apache.sqoop.job.mr.SqoopInputFormat.getSplits(SqoopInputFormat.java:77)]
Partition: 5 <= "id" AND "id" < 9
2014-12-03 14:52:53,191 DEBUG mr.SqoopInputFormat [org.apache.sqoop.job.mr.SqoopInputFormat.getSplits(SqoopInputFormat.java:77)]
Partition: 9 <= "id" AND "id" < 13
2014-12-03 14:52:53,192 DEBUG mr.SqoopInputFormat [org.apache.sqoop.job.mr.SqoopInputFormat.getSplits(SqoopInputFormat.java:77)]
Partition: 13 <= "id" AND "id" < 16
2014-12-03 14:52:53,192 DEBUG mr.SqoopInputFormat [org.apache.sqoop.job.mr.SqoopInputFormat.getSplits(SqoopInputFormat.java:77)]
Partition: 16 <= "id" AND "id" <= 19
2014-12-03 14:52:53,576 DEBUG mapreduce.MapreduceSubmissionEngine [org.apache.sqoop.submission.mapreduce.MapreduceSubmissionEngine.submit(MapreduceSubmissionEngine.java:253)]
Executed new map-reduce job with id job_1417647106005_0002

{code}


> Date and DateTime is not encoded in Single Quotes  ( + unit tests)
> ------------------------------------------------------------------
>
>                 Key: SQOOP-1815
>                 URL: https://issues.apache.org/jira/browse/SQOOP-1815
>             Project: Sqoop
>          Issue Type: Sub-task
>          Components: sqoop2-framework
>            Reporter: Veena Basavaraj
>            Assignee: Veena Basavaraj
>             Fix For: 1.99.5
>
>         Attachments: SQOOP-1815-v2.patch, SQOOP-1815-v5.patch, SQOOP-1815.patch
>
>
> I deem this is a BUG in the current code where the date and date time encoded in single
quotes. 
> Correction: as the bug says, it is not encoded.!



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message