sqoop-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SQOOP-1112) Sqoop2: Date splitter might return splits omitting some boundaries
Date Wed, 03 Jul 2013 00:31:20 GMT

    [ https://issues.apache.org/jira/browse/SQOOP-1112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13698442#comment-13698442
] 

Hudson commented on SQOOP-1112:
-------------------------------

Integrated in Sqoop2-hadoop200 #429 (See [https://builds.apache.org/job/Sqoop2-hadoop200/429/])
    SQOOP-1112: Sqoop2: Date splitter might return splits omitting some boundaries (Revision
d4b2d61653dee63a8624895ae1198eb7fa3b551c)

     Result = SUCCESS
jarcec : https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=d4b2d61653dee63a8624895ae1198eb7fa3b551c
Files : 
* connector/connector-generic-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/GenericJdbcImportPartitioner.java
* connector/connector-generic-jdbc/src/test/java/org/apache/sqoop/connector/jdbc/TestImportPartitioner.java

                
> Sqoop2: Date splitter might return splits omitting some boundaries
> ------------------------------------------------------------------
>
>                 Key: SQOOP-1112
>                 URL: https://issues.apache.org/jira/browse/SQOOP-1112
>             Project: Sqoop
>          Issue Type: Bug
>    Affects Versions: 1.99.2
>            Reporter: Jarek Jarcec Cecho
>            Assignee: Venkat Ranganathan
>             Fix For: 1.99.3
>
>         Attachments: incorrect_boudnary_test.path, SQOOP-1112.patch
>
>
> Attached test case that is using {{Date}} splitter for interval from {{2004-10-20}} to
{{2013-10-17}} will create following splits on my machine (with PDT timezone):
> {code}
> '2004-10-19' <= DCOL AND DCOL < '2007-10-19'
> '2007-10-19' <= DCOL AND DCOL < '2010-10-18'
> '2010-10-18' <= DCOL AND DCOL <= '2013-10-16'
> {code}
> The last split is missing entire day {{2013-10-17}}. I'm assuming that the issue is in
the timezone conversions that we've introduced in SQOOP-1080.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message