sqoop-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Boglarka Egyed (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (SQOOP-3319) Extract code using Kite into separate classes
Date Tue, 29 May 2018 13:18:00 GMT

    [ https://issues.apache.org/jira/browse/SQOOP-3319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16493437#comment-16493437
] 

Boglarka Egyed edited comment on SQOOP-3319 at 5/29/18 1:17 PM:
----------------------------------------------------------------

The [unit test job|https://builds.apache.org/job/Sqoop-hadoop200/] had failing tests:
 * TestAccumuloImport - somewhat flaky, became green on re-execution
 * TestLargeObjectLoader - seems to be failing due to a current Apache Infrastructure slowness
issue (time out), it passes on Mac and Linux OS too

These are unrelated to this specific change.

Thanks [~vasas] for this patch, please close the related Review Request to..


was (Author: boglarkaegyed):
The [unit test job|https://builds.apache.org/job/Sqoop-hadoop200/] had failing tests:
* TestAccumuloImport - somewhat flaky, became green on re-execution
* TestLargeObjectLoader - seems to be failing due to a current Apache Infrastructure slowness
issue (time out)

These are unrelated to this specific change.

Thanks [~vasas] for this patch, please close the related Review Request to..

> Extract code using Kite into separate classes
> ---------------------------------------------
>
>                 Key: SQOOP-3319
>                 URL: https://issues.apache.org/jira/browse/SQOOP-3319
>             Project: Sqoop
>          Issue Type: Sub-task
>            Reporter: Szabolcs Vasas
>            Assignee: Szabolcs Vasas
>            Priority: Major
>             Fix For: 3.0.0
>
>         Attachments: SQOOP-3319.patch, SQOOP-3319.patch
>
>
> Kite Dataset API is used in many places in the code to read/write Parquet files and configure
MR jobs.
> The goal of this JIRA is to introduce an implementation agnostic interface for Parquet
reading/writing and extract the code using Kite Dataset API into separate classes implementing
this interface. The benefit of this refactoring is that it enables us introducing a new Parquet
reading/writing implementation which does not use Kite but plugs in easily.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message