hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Lefty Leverenz (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-10104) LLAP: Generate consistent splits and locations for the same split across jobs
Date Wed, 01 Apr 2015 05:56:53 GMT

    [ https://issues.apache.org/jira/browse/HIVE-10104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14390028#comment-14390028
] 

Lefty Leverenz commented on HIVE-10104:
---------------------------------------

This adds *hive.tez.input.generate.consistent.splits* to HiveConf.java, so I'm linking it
to HIVE-9850 (documentation for llap).

> LLAP: Generate consistent splits and locations for the same split across jobs
> -----------------------------------------------------------------------------
>
>                 Key: HIVE-10104
>                 URL: https://issues.apache.org/jira/browse/HIVE-10104
>             Project: Hive
>          Issue Type: Sub-task
>            Reporter: Siddharth Seth
>            Assignee: Siddharth Seth
>             Fix For: llap
>
>         Attachments: HIVE-10104.1.txt, HIVE-10104.2.txt
>
>
> Locations for splits are currently randomized. Also, the order of splits is random -
depending on how threads end up generating the splits.
> Add an option to sort the splits, and generate repeatable locations - assuming all other
factors are the same.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message