spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ice bai (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (SPARK-24998) spark-sql will scan the same table repeatedly when doing multi-insert
Date Fri, 03 Aug 2018 11:35:00 GMT

     [ https://issues.apache.org/jira/browse/SPARK-24998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

ice bai updated SPARK-24998:
----------------------------
    Summary: spark-sql will scan the same table repeatedly when doing multi-insert  (was:
spark-sql will scan the same table repeatedly when doing multi-insert")

> spark-sql will scan the same table repeatedly when doing multi-insert
> ---------------------------------------------------------------------
>
>                 Key: SPARK-24998
>                 URL: https://issues.apache.org/jira/browse/SPARK-24998
>             Project: Spark
>          Issue Type: Improvement
>          Components: SQL
>    Affects Versions: 2.3.0
>            Reporter: ice bai
>            Priority: Major
>         Attachments: scan_table_many_times.png
>
>
> Such as the query likes "From xx SELECT yy INSERT INTO a INSERT INTO b INSERT INTO c
..." .
> Following screenshot shows the stages:
> !scan_table_many_times.png!
> But, Hive only scan once.
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message