sentry-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hadoop QA (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SENTRY-654) Calls to append_partition fail when Sentry is enabled
Date Tue, 10 Mar 2015 21:11:41 GMT

    [ https://issues.apache.org/jira/browse/SENTRY-654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14355726#comment-14355726
] 

Hadoop QA commented on SENTRY-654:
----------------------------------

Here are the results of testing the latest attachment
https://issues.apache.org/jira/secure/attachment/12703725/SENTRY-654.patch against master.

{color:red}Overall:{color} -1 due to 9 errors

{color:red}ERROR:{color} mvn test exited 1
{color:red}ERROR:{color} Failed: org.apache.sentry.tests.e2e.metastore.TestAuthorizingObjectStore
{color:red}ERROR:{color} Failed: org.apache.sentry.tests.e2e.metastore.TestAuthorizingObjectStore
{color:red}ERROR:{color} Failed: org.apache.sentry.tests.e2e.metastore.TestAuthorizingObjectStore
{color:red}ERROR:{color} Failed: org.apache.sentry.tests.e2e.metastore.TestAuthorizingObjectStore
{color:red}ERROR:{color} Failed: org.apache.sentry.tests.e2e.metastore.TestAuthorizingObjectStore
{color:red}ERROR:{color} Failed: org.apache.sentry.tests.e2e.metastore.TestMetastoreEndToEnd
{color:red}ERROR:{color} Failed: org.apache.sentry.tests.e2e.metastore.TestMetastoreEndToEnd
{color:red}ERROR:{color} Failed: org.apache.sentry.tests.e2e.metastore.TestMetastoreEndToEnd

Console output: https://builds.apache.org/job/PreCommit-SENTRY-Build/489/console

This message is automatically generated.

> Calls to append_partition fail when Sentry is enabled
> -----------------------------------------------------
>
>                 Key: SENTRY-654
>                 URL: https://issues.apache.org/jira/browse/SENTRY-654
>             Project: Sentry
>          Issue Type: Bug
>    Affects Versions: 1.4.0
>         Environment: CDH 5.3.1
>            Reporter: Richard Williams
>            Assignee: Ryan P
>         Attachments: SENTRY-654.patch
>
>
> When the Hive Metastore has org.apache.sentry.binding.metastore.MetastoreAuthzBinding
configured as a pre event listener class, calls to the metastore Thrift API's append_partition
method fail with a MetaException whose message is "java.lang.NullPointerException". In practice,
this causes LOAD DATA INPATH statements targeting particular partitions of a partitioned table
to fail. Example stack trace:
> Exception in thread "main" MetaException(message:java.lang.NullPointerException)
>         at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$append_partition_with_environment_context_result$append_partition_with_environment_context_resultStandardScheme.read(ThriftHiveMetastore.java:41079)
>         at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$append_partition_with_environment_context_result$append_partition_with_environment_context_resultStandardScheme.read(ThriftHiveMetastore.java:41038)
>         at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$append_partition_with_environment_context_result.read(ThriftHiveMetastore.java:40961)
>         at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:78)
>         at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.recv_append_partition_with_environment_context(ThriftHiveMetastore.java:1355)
>         at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.append_partition_with_environment_context(ThriftHiveMetastore.java:1339)
>         at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.appendPartition(HiveMetaStoreClient.java:494)
>         at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.appendPartition(HiveMetaStoreClient.java:488)
>         at Test.main(Test.java:31)
> The likely cause of this is that HiveMetastoreAuthzBinding's authorizeAddPartition method,
which is triggered on both add_partition calls and append_partition calls, assumes that the
added Partition object's storage descriptor is not null. However, org.apache.hadoop.hive.metastore.HiveMetaStore's
append_partition_common method creates a Partition object on the fly based on the provided
database, table, and partition values, and it doesn't initialize that object's storage descriptor
until after it has already called firePreEvent (thereby signaling the pre event listeners
to execute). 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message