sentry-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Arun Suresh (JIRA)" <>
Subject [jira] [Commented] (SENTRY-664) After Namenode is restarted, Path updates remain unsynched
Date Wed, 04 Mar 2015 19:58:39 GMT


Arun Suresh commented on SENTRY-664:

Committed :

Repository: incubator-sentry
Updated Branches:
  refs/heads/master dd9edc666 -> feb8cbee6

SENTRY-664: Fix to ensure path updates are synced after namenode restart (Reviewed by Prasad)


Branch: refs/heads/master
Commit: feb8cbee60e2d8d36667737d527c602de3e15d13
Parents: dd9edc6
Author: Arun Suresh <Arun Suresh>
Authored: Wed Mar 4 11:52:53 2015 -0800
Committer: Arun Suresh <Arun Suresh>
Committed: Wed Mar 4 11:52:53 2015 -0800

> After Namenode is restarted, Path updates remain unsynched
> ----------------------------------------------------------
>                 Key: SENTRY-664
>                 URL:
>             Project: Sentry
>          Issue Type: Bug
>    Affects Versions: 1.4.0
>            Reporter: Arun Suresh
>            Assignee: Arun Suresh
>              Labels: sentry-hdfs
>         Attachments: SENTRY-664.1.patch
> Path updates remain un-synced after a Namenode restart.
> Ideally, after a restart, the Namenode receives both the Path and Permission updates
from sentry service. These updates are ordered by a sequence Id. Also the first Path/Permission
update is supposed to be a FULL update. 
> From observing the logs, It looks like after namenode restart, the sequence of PathsUpdate
objects do not start with a FULL update (The PermissionsUpdates are fine though). Thus the
namenode remains unsynched with respect to path information.
> A workaround is to restart the metastore after the namenode has restarted. This will
ensure HMS will send a FULL update to Sentry. This will cause Sentry service will flush its
existing update queue, so the next time the namenode asks for an update, this FULL update
will be sent. 

This message was sent by Atlassian JIRA

View raw message