spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Reynold Xin (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SPARK-21363) Prevent column name duplication in temporary view
Date Mon, 02 Apr 2018 19:56:00 GMT

    [ https://issues.apache.org/jira/browse/SPARK-21363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16423048#comment-16423048
] 

Reynold Xin commented on SPARK-21363:
-------------------------------------

How can user drop the fields or rename them after joins?

 

> Prevent column name duplication in temporary view
> -------------------------------------------------
>
>                 Key: SPARK-21363
>                 URL: https://issues.apache.org/jira/browse/SPARK-21363
>             Project: Spark
>          Issue Type: Improvement
>          Components: SQL
>    Affects Versions: 2.1.1
>            Reporter: Takeshi Yamamuro
>            Priority: Minor
>
> In SPARK-20460, we refactored some existing checks for column name duplication. The master
currently allows name duplication for temporary views like an example below though, IMO we
better prevent it along with permanent views (the master prevents the case for the permanent
views).
> {code}
> scala> Seq((1, 1)).toDF("a", "a").createOrReplaceTempView("t")
> scala> sql("SELECT * FROM t").show
> +---+---+
> |  a|  a|
> +---+---+
> |  1|  1|
> +---+---+
> {code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message