hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Marton Bod (Jira)" <j...@apache.org>
Subject [jira] [Assigned] (HIVE-25308) Use new Tez API to get JobID for Iceberg commits
Date Tue, 06 Jul 2021 10:15:00 GMT

     [ https://issues.apache.org/jira/browse/HIVE-25308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Marton Bod reassigned HIVE-25308:
---------------------------------


> Use new Tez API to get JobID for Iceberg commits
> ------------------------------------------------
>
>                 Key: HIVE-25308
>                 URL: https://issues.apache.org/jira/browse/HIVE-25308
>             Project: Hive
>          Issue Type: Improvement
>            Reporter: Marton Bod
>            Assignee: Marton Bod
>            Priority: Major
>
> When committing Iceberg writes, currently we only have the JobID without the vertexID,
therefore we have to list the folder {{<tableLocation>/temp}} first, and parse out
the full JobIDs (incl. vertexID) from the resulting folder names.
> With Tez 0.10.1 released, now we have a new API we can call to acquire the full JobID,
making the file listing unnecessary.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Mime
View raw message