From issues-return-128389-apmail-spark-issues-archive=spark.apache.org@spark.apache.org Thu Sep 1 06:38:21 2016 Return-Path: X-Original-To: apmail-spark-issues-archive@minotaur.apache.org Delivered-To: apmail-spark-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 06CB61977F for ; Thu, 1 Sep 2016 06:38:21 +0000 (UTC) Received: (qmail 23355 invoked by uid 500); 1 Sep 2016 06:38:20 -0000 Delivered-To: apmail-spark-issues-archive@spark.apache.org Received: (qmail 23297 invoked by uid 500); 1 Sep 2016 06:38:20 -0000 Mailing-List: contact issues-help@spark.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list issues@spark.apache.org Received: (qmail 23288 invoked by uid 99); 1 Sep 2016 06:38:20 -0000 Received: from arcas.apache.org (HELO arcas) (140.211.11.28) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 01 Sep 2016 06:38:20 +0000 Received: from arcas.apache.org (localhost [127.0.0.1]) by arcas (Postfix) with ESMTP id 765B12C014E for ; Thu, 1 Sep 2016 06:38:20 +0000 (UTC) Date: Thu, 1 Sep 2016 06:38:20 +0000 (UTC) From: "Liang-Chi Hsieh (JIRA)" To: issues@spark.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Created] (SPARK-17357) Simplified predicates should be able to pushdown through operators MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 Liang-Chi Hsieh created SPARK-17357: --------------------------------------- Summary: Simplified predicates should be able to pushdown through operators Key: SPARK-17357 URL: https://issues.apache.org/jira/browse/SPARK-17357 Project: Spark Issue Type: Bug Components: SQL Reporter: Liang-Chi Hsieh In Optimizer, Filter operator will go through the rules PushDownPredicate, CombineFilters and BooleanSimplification. Under this rule order, it is possibly that some predicates that should be able to push down, can't be pushed down through operators. We should fix it. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org For additional commands, e-mail: issues-help@spark.apache.org