hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From László Pintér (Jira) <j...@apache.org>
Subject [jira] [Commented] (HIVE-25308) Use new Tez API to get JobID for Iceberg commits
Date Thu, 08 Jul 2021 08:48:00 GMT

    [ https://issues.apache.org/jira/browse/HIVE-25308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17377216#comment-17377216
] 

László Pintér commented on HIVE-25308:
--------------------------------------

Merged into master. Thanks, [~Marton Bod] for the patch and [~kuczoram] for the review!

> Use new Tez API to get JobID for Iceberg commits
> ------------------------------------------------
>
>                 Key: HIVE-25308
>                 URL: https://issues.apache.org/jira/browse/HIVE-25308
>             Project: Hive
>          Issue Type: Improvement
>            Reporter: Marton Bod
>            Assignee: Marton Bod
>            Priority: Major
>              Labels: pull-request-available
>          Time Spent: 10m
>  Remaining Estimate: 0h
>
> When committing Iceberg writes, currently we only have the JobID without the vertexID,
therefore we have to list the folder {{<tableLocation>/temp}} first, and parse out
the full JobIDs (incl. vertexID) from the resulting folder names.
> With Tez 0.10.1 released, now we have a new API we can call to acquire the full JobID,
making the file listing unnecessary.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Mime
View raw message