sqoop-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF subversion and git services (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SQOOP-1154) Sqoop2: Text partitioner might miss or include edge values
Date Wed, 31 Jul 2013 05:49:49 GMT

    [ https://issues.apache.org/jira/browse/SQOOP-1154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13724908#comment-13724908
] 

ASF subversion and git services commented on SQOOP-1154:
--------------------------------------------------------

Commit 9c7adb4e112e57e5d2c4720be71b8a5278ef7638 in branch refs/heads/sqoop2 from [~venkatnrangan]
[ https://git-wip-us.apache.org/repos/asf?p=sqoop.git;h=9c7adb4 ]

SQOOP-1154: Sqoop2: Text partitioner might miss or include edge values

(Jarek Jarcec Cecho via Venkat Ranganathan)

                
> Sqoop2: Text partitioner might miss or include edge values
> ----------------------------------------------------------
>
>                 Key: SQOOP-1154
>                 URL: https://issues.apache.org/jira/browse/SQOOP-1154
>             Project: Sqoop
>          Issue Type: Bug
>    Affects Versions: 1.99.2
>            Reporter: Jarek Jarcec Cecho
>            Assignee: Jarek Jarcec Cecho
>             Fix For: 1.99.3
>
>         Attachments: bugSQOOP-1154.patch, import_test_case.patch
>
>
> Attached is test case that will use Varchar partitioner to generate 3, 5, 10 and 13 partitions
for interval "Breezy Badger" to "Warty Warthog". For all cases generated partitions looks
like the following:
> {code}
> 'Bree' <= VCCOL AND VCCOL < SOME_VALUE
> SOME_VALUE <= VCCOL AND VCCOL <= 'Wart'
> {code}
> As {{'Warty Warthog' > 'Wart'}}, the last value will be never imported. Also similarly
as {{'Bree' < 'Breezy Badger'}}, additional values might be imported as well (for example
'Breedy Budget'). I think that the varchar partitioner must have the interval boundaries there
without any truncation, for example:
> {code}
> 'Breezy Badget' <= VCCOL AND VCCOL < SOME_VALUE
> SOME_VALUE <= VCCOL AND VCCOL <= 'Warty Warthog'
> {code}

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message