hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sergey Shelukhin (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-19810) StorageHandler fail to ship jars in Tez intermittently
Date Fri, 15 Jun 2018 18:42:00 GMT

    [ https://issues.apache.org/jira/browse/HIVE-19810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16514227#comment-16514227
] 

Sergey Shelukhin commented on HIVE-19810:
-----------------------------------------

+1. Did you test the patch on some cluster, since there's no unit test? 

> StorageHandler fail to ship jars in Tez intermittently
> ------------------------------------------------------
>
>                 Key: HIVE-19810
>                 URL: https://issues.apache.org/jira/browse/HIVE-19810
>             Project: Hive
>          Issue Type: Bug
>          Components: Tez
>            Reporter: Daniel Dai
>            Assignee: Daniel Dai
>            Priority: Major
>         Attachments: HIVE-19810.1.patch, HIVE-19810.2.patch, testcase.patch
>
>
> Hive relies on StorageHandler to ship jars to backend automatically in several cases:
JdbcStorageHandler, HBaseStorageHandler, AccumuloStorageHandler. This does not work reliably,
in particular, the first dag in the session will have those jars, the second will not unless
container is reused. In the later case, the containers allocated to first dag will be reused
in the second dag so the container will have additional resources.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message