spark-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Apache Spark (JIRA)" <j...@apache.org>
Subject [jira] [Assigned] (SPARK-19419) Unable to detect all the cases of cartesian products when spark.sql.crossJoin.enabled is false
Date Wed, 01 Feb 2017 06:15:51 GMT

     [ https://issues.apache.org/jira/browse/SPARK-19419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Apache Spark reassigned SPARK-19419:
------------------------------------

    Assignee: Apache Spark  (was: Xiao Li)

> Unable to detect all the cases of cartesian products when spark.sql.crossJoin.enabled
is false
> ----------------------------------------------------------------------------------------------
>
>                 Key: SPARK-19419
>                 URL: https://issues.apache.org/jira/browse/SPARK-19419
>             Project: Spark
>          Issue Type: Bug
>          Components: SQL
>    Affects Versions: 2.1.0
>            Reporter: Xiao Li
>            Assignee: Apache Spark
>
> The existing detection is unable to cover all the cartesian product cases. For example,

>   - Case 1) having non-equal predicates in join conditiions of an inner join.
>   - Case 2) equi-join's key columns are not sortable and both sides are not small enough
for broadcasting.
> This PR is to move the cross-join detection back to `BroadcastNestedLoopJoinExec` and
`CartesianProductExec`. 



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org


Mime
View raw message