sqoop-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Fero Szabo (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SQOOP-3381) Upgrade the Parquet library from 1.6.0 to 1.9.0
Date Fri, 05 Oct 2018 09:36:00 GMT

    [ https://issues.apache.org/jira/browse/SQOOP-3381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16639554#comment-16639554
] 

Fero Szabo commented on SQOOP-3381:
-----------------------------------

Hi [~dvoros],

Thanks for your comment and sorry for the late answer!

I've been pretty busy in the last few weeks with other issues, but now am ready to continue
working on this one. Thanks for pointing me to the shaded parquet-hadoop-bundle. A few Hive
tests are failing because of it... It makes me wonder if you've made progress with SQOOP-3305 in
the meantime, and if upgrading Hive to 3.1.0 would solve this problem?

Because of the failing Hive tests, I haven't tested on a cluster, yet, but will certainly
do so. 

> Upgrade the Parquet library from 1.6.0 to 1.9.0
> -----------------------------------------------
>
>                 Key: SQOOP-3381
>                 URL: https://issues.apache.org/jira/browse/SQOOP-3381
>             Project: Sqoop
>          Issue Type: Sub-task
>    Affects Versions: 1.4.7
>            Reporter: Fero Szabo
>            Assignee: Fero Szabo
>            Priority: Major
>             Fix For: 3.0.0
>
>
> As we will need to register a data supplier in the fix for parquet decimal support, we
will need a version that contains PARQUET-243.
> We need to upgrade the Parquet library to a version that contains this fix and is compatible
with Hadoop. Most probably, the newest version will be adequate. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message