hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Lefty Leverenz (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (HIVE-16602) Implement shared scans with Tez
Date Mon, 25 Sep 2017 05:41:00 GMT

    [ https://issues.apache.org/jira/browse/HIVE-16602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16009573#comment-16009573
] 

Lefty Leverenz edited comment on HIVE-16602 at 9/25/17 5:40 AM:
----------------------------------------------------------------

Doc note:  This adds *hive.optimize.shared.scan* to HiveConf.java, so it needs to be documented
in the wiki.  (Although it isn't a "hive.tez.*" config, perhaps it should be listed with other
Tez-related configs at the beginning of the Tez section.)

* [Configuration Properties -- Query and DDL Execution | https://cwiki.apache.org/confluence/display/Hive/Configuration+Properties#ConfigurationProperties-QueryandDDLExecution]
* [Configuration Properties -- Tez | https://cwiki.apache.org/confluence/display/Hive/Configuration+Properties#ConfigurationProperties-Tez]

Added a TODOC3.0 label.

Update (25/Sep/17):  HIVE-16867 removes *hive.optimize.shared.scan* (while adding *hive.optimize.shared.work*)
in release 3.0.0, so don't document *hive.optimize.shared.scan* after all.  I removed the
TODOC3.0 label.


was (Author: lefty@hortonworks.com):
Doc note:  This adds *hive.optimize.shared.scan* to HiveConf.java, so it needs to be documented
in the wiki.  (Although it isn't a "hive.tez.*" config, perhaps it should be listed with other
Tez-related configs at the beginning of the Tez section.)

* [Configuration Properties -- Query and DDL Execution | https://cwiki.apache.org/confluence/display/Hive/Configuration+Properties#ConfigurationProperties-QueryandDDLExecution]
* [Configuration Properties -- Tez | https://cwiki.apache.org/confluence/display/Hive/Configuration+Properties#ConfigurationProperties-Tez]

Added a TODOC3.0 label.

> Implement shared scans with Tez
> -------------------------------
>
>                 Key: HIVE-16602
>                 URL: https://issues.apache.org/jira/browse/HIVE-16602
>             Project: Hive
>          Issue Type: New Feature
>          Components: Physical Optimizer
>    Affects Versions: 3.0.0
>            Reporter: Jesus Camacho Rodriguez
>            Assignee: Jesus Camacho Rodriguez
>             Fix For: 3.0.0
>
>         Attachments: HIVE-16602.01.patch, HIVE-16602.02.patch, HIVE-16602.03.patch, HIVE-16602.04.patch,
HIVE-16602.patch
>
>
> Given a query plan, the goal is to identify scans on input tables that can be merged
so the data is read only once. Optimization will be carried out at the physical level.
> In the longer term, identification of equivalent expressions and reutilization of intermediary
results should be done at the logical layer via Spool operator.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message