hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hive QA (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-19941) Row based Filters added via Hive Ranger policies are not pushed to druid
Date Wed, 20 Jun 2018 08:00:03 GMT

    [ https://issues.apache.org/jira/browse/HIVE-19941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16517894#comment-16517894
] 

Hive QA commented on HIVE-19941:
--------------------------------



Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12928276/HIVE-19941.patch

{color:green}SUCCESS:{color} +1 due to 2 test(s) being added or modified.

{color:red}ERROR:{color} -1 due to 1 failed/errored test(s), 14534 tests executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[druidmini_masking] (batchId=86)
{noformat}

Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/11939/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/11939/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-11939/

Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 1 tests failed
{noformat}

This message is automatically generated.

ATTACHMENT ID: 12928276 - PreCommit-HIVE-Build

> Row based Filters added via Hive Ranger policies are not pushed to druid
> ------------------------------------------------------------------------
>
>                 Key: HIVE-19941
>                 URL: https://issues.apache.org/jira/browse/HIVE-19941
>             Project: Hive
>          Issue Type: Bug
>            Reporter: Nishant Bangarwa
>            Assignee: Nishant Bangarwa
>            Priority: Major
>         Attachments: HIVE-19941.patch
>
>
> Issue is that when applying table mask we add virtual columns, however non-native tables
do not have virtual columns, we need to skip adding virtual columns when generating masking
query. 
> Stack Trace - 
> {code} 
> org.apache.hadoop.hive.ql.parse.SemanticException: Line 1:79 Invalid table alias or column
reference 'BLOCK__OFFSET__INSIDE__FILE'
> : (possible column names are: __time, yearmonth, year, month, dayofmonth, dayofweek,
weekofyear, hour, minute, second, payment_typ
> e, fare_amount, surcharge, mta_tax, tip_amount, tolls_amount, total_amount, trip_time)
>         at org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genAllExprNodeDesc(SemanticAnalyzer.java:11830)
~[hive-exec-2.1.0.2.6.
> 4.0-91.jar:2.1.0.2.6.4.0-91]
>         at org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genExprNodeDesc(SemanticAnalyzer.java:11778)
~[hive-exec-2.1.0.2.6.4.0
> -91.jar:2.1.0.2.6.4.0-91]
>         at org.apache.hadoop.hive.ql.parse.CalcitePlanner$CalcitePlannerAction.genSelectLogicalPlan(CalcitePlanner.java:3780)
~[hi
> ve-exec-2.1.0.2.6.4.0-91.jar:2.1.0.2.6.4.0-91]
>         at org.apache.hadoop.hive.ql.parse.CalcitePlanner$CalcitePlannerAction.genLogicalPlan(CalcitePlanner.java:4117)
~[hive-exe
> c-2.1.0.2.6.4.0-91.jar:2.1.0.2.6.4.0-91]
>         at org.apache.hadoop.hive.ql.parse.CalcitePlanner$CalcitePlannerAction.genLogicalPlan(CalcitePlanner.java:4016)
~[hive-exe
> c-2.1.0.2.6.4.0-91.jar:2.1.0.2.6.4.0-91]
>         at org.apache.hadoop.hive.ql.parse.CalcitePlanner$CalcitePlannerAction.genLogicalPlan(CalcitePlanner.java:4060)
~[hive-exe
> c-2.1.0.2.6.4.0-91.jar:2.1.0.2.6.4.0-91]
>         at org.apache.hadoop.hive.ql.parse.CalcitePlanner$CalcitePlannerAction.apply(CalcitePlanner.java:1340)
~[hive-exec-2.1.0.2
> .6.4.0-91.jar:2.1.0.2.6.4.0-91]
>         at org.apache.hadoop.hive.ql.parse.CalcitePlanner$CalcitePlannerAction.apply(CalcitePlanner.java:1277)
~[hive-exec-2.1.0.2
> .6.4.0-91.jar:2.1.0.2.6.4.0-91]
>         at org.apache.calcite.tools.Frameworks$1.apply(Frameworks.java:113) ~[calcite-core-1.10.0.2.6.4.0-91.jar:1.10.0.2.6.4.0-91
> ]
>         at org.apache.calcite.prepare.CalcitePrepareImpl.perform(CalcitePrepareImpl.java:997)
~[calcite-core-1.10.0.2.6.4.0-91.jar
> :1.10.0.2.6.4.0-91]
>         at org.apache.calcite.tools.Frameworks.withPrepare(Frameworks.java:149) ~[calcite-core-1.10.0.2.6.4.0-91.jar:1.10.0.2.6.4.
> 0-91]
>         at org.apache.calcite.tools.Frameworks.withPlanner(Frameworks.java:106) ~[calcite-core-1.10.0.2.6.4.0-91.jar:1.10.0.2.6.4.
> 0-91]
>         at org.apache.hadoop.hive.ql.parse.CalcitePlanner.logicalPlan(CalcitePlanner.java:1082)
~[hive-exec-2.1.0.2.6.4.0-91.jar:2
> .1.0.2.6.4.0-91]
> {code} 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message