hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From László Pintér (Jira) <>
Subject [jira] [Commented] (HIVE-25308) Use new Tez API to get JobID for Iceberg commits
Date Thu, 08 Jul 2021 08:48:00 GMT


László Pintér commented on HIVE-25308:

Merged into master. Thanks, [~Marton Bod] for the patch and [~kuczoram] for the review!

> Use new Tez API to get JobID for Iceberg commits
> ------------------------------------------------
>                 Key: HIVE-25308
>                 URL:
>             Project: Hive
>          Issue Type: Improvement
>            Reporter: Marton Bod
>            Assignee: Marton Bod
>            Priority: Major
>              Labels: pull-request-available
>          Time Spent: 10m
>  Remaining Estimate: 0h
> When committing Iceberg writes, currently we only have the JobID without the vertexID,
therefore we have to list the folder {{<tableLocation>/temp}} first, and parse out
the full JobIDs (incl. vertexID) from the resulting folder names.
> With Tez 0.10.1 released, now we have a new API we can call to acquire the full JobID,
making the file listing unnecessary.

This message was sent by Atlassian Jira

View raw message