sentry-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Arun Suresh (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (SENTRY-555) Ensure groupName returned for dir objects within prefix but not associated with an authz object is not null
Date Mon, 01 Dec 2014 18:56:14 GMT

     [ https://issues.apache.org/jira/browse/SENTRY-555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Arun Suresh updated SENTRY-555:
-------------------------------
    Description: 
It looks like the namenode throws the following NPE and dies after a while

NameNode hitting NPE when writing to journal log: "Error: write op failed for (journal JournalAndStream(stream=EditLogFileOutputStream):
NullPointerException".

{noformat}
Error: write op failed for (journal JournalAndStream(mgr=FileJournalManager(root=/data/dfs/nn),
stream=EditLogFileOutputStream(/data/dfs/nn/current/edits_inprogress_0000000000000000001)))
java.lang.NullPointerException
	at org.apache.hadoop.io.Text.encode(Text.java:450)
	at org.apache.hadoop.io.Text.encode(Text.java:431)
	at org.apache.hadoop.io.Text.writeString(Text.java:491)
	at org.apache.hadoop.fs.permission.PermissionStatus.write(PermissionStatus.java:117)
	at org.apache.hadoop.fs.permission.PermissionStatus.write(PermissionStatus.java:97)
	at org.apache.hadoop.hdfs.server.namenode.FSEditLogOp$MkdirOp.writeFields(FSEditLogOp.java:1432)
	at org.apache.hadoop.hdfs.server.namenode.FSEditLogOp$Writer.writeOp(FSEditLogOp.java:3828)
	at org.apache.hadoop.hdfs.server.namenode.EditsDoubleBuffer$TxnBuffer.writeOp(EditsDoubleBuffer.java:149)
	at org.apache.hadoop.hdfs.server.namenode.EditsDoubleBuffer.writeOp(EditsDoubleBuffer.java:53)
	at org.apache.hadoop.hdfs.server.namenode.EditLogFileOutputStream.write(EditLogFileOutputStream.java:97)
	at org.apache.hadoop.hdfs.server.namenode.JournalSet$JournalSetOutputStream$1.apply(JournalSet.java:452)
	at org.apache.hadoop.hdfs.server.namenode.JournalSet.mapJournalsAndReportErrors(JournalSet.java:393)
	at org.apache.hadoop.hdfs.server.namenode.JournalSet.access$100(JournalSet.java:57)
	at org.apache.hadoop.hdfs.server.namenode.JournalSet$JournalSetOutputStream.write(JournalSet.java:448)
	at org.apache.hadoop.hdfs.server.namenode.FSEditLog.logEdit(FSEditLog.java:421)
	at org.apache.hadoop.hdfs.server.namenode.FSEditLog.logMkDir(FSEditLog.java:793)
	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.mkdirsRecursively(FSNamesystem.java:4171)
	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.mkdirsInternal(FSNamesystem.java:4071)
	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.mkdirsInt(FSNamesystem.java:4030)
	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.mkdirs(FSNamesystem.java:4003)
	at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.mkdirs(NameNodeRpcServer.java:786)
	at org.apache.hadoop.hdfs.server.namenode.AuthorizationProviderProxyClientProtocol.mkdirs(AuthorizationProviderProxyClientProtocol.java:297)
	at ..
{noformat}

This is due to the fact that the _groupName_ returned by the {{SentryAuthorizationProvider}}
is null at times.

> Ensure groupName returned for dir objects within prefix but not associated with an authz
object is not null
> -----------------------------------------------------------------------------------------------------------
>
>                 Key: SENTRY-555
>                 URL: https://issues.apache.org/jira/browse/SENTRY-555
>             Project: Sentry
>          Issue Type: Bug
>    Affects Versions: 1.5.0
>            Reporter: Arun Suresh
>            Assignee: Arun Suresh
>         Attachments: SENTRY-555.1.patch
>
>
> It looks like the namenode throws the following NPE and dies after a while
> NameNode hitting NPE when writing to journal log: "Error: write op failed for (journal
JournalAndStream(stream=EditLogFileOutputStream): NullPointerException".
> {noformat}
> Error: write op failed for (journal JournalAndStream(mgr=FileJournalManager(root=/data/dfs/nn),
stream=EditLogFileOutputStream(/data/dfs/nn/current/edits_inprogress_0000000000000000001)))
> java.lang.NullPointerException
> 	at org.apache.hadoop.io.Text.encode(Text.java:450)
> 	at org.apache.hadoop.io.Text.encode(Text.java:431)
> 	at org.apache.hadoop.io.Text.writeString(Text.java:491)
> 	at org.apache.hadoop.fs.permission.PermissionStatus.write(PermissionStatus.java:117)
> 	at org.apache.hadoop.fs.permission.PermissionStatus.write(PermissionStatus.java:97)
> 	at org.apache.hadoop.hdfs.server.namenode.FSEditLogOp$MkdirOp.writeFields(FSEditLogOp.java:1432)
> 	at org.apache.hadoop.hdfs.server.namenode.FSEditLogOp$Writer.writeOp(FSEditLogOp.java:3828)
> 	at org.apache.hadoop.hdfs.server.namenode.EditsDoubleBuffer$TxnBuffer.writeOp(EditsDoubleBuffer.java:149)
> 	at org.apache.hadoop.hdfs.server.namenode.EditsDoubleBuffer.writeOp(EditsDoubleBuffer.java:53)
> 	at org.apache.hadoop.hdfs.server.namenode.EditLogFileOutputStream.write(EditLogFileOutputStream.java:97)
> 	at org.apache.hadoop.hdfs.server.namenode.JournalSet$JournalSetOutputStream$1.apply(JournalSet.java:452)
> 	at org.apache.hadoop.hdfs.server.namenode.JournalSet.mapJournalsAndReportErrors(JournalSet.java:393)
> 	at org.apache.hadoop.hdfs.server.namenode.JournalSet.access$100(JournalSet.java:57)
> 	at org.apache.hadoop.hdfs.server.namenode.JournalSet$JournalSetOutputStream.write(JournalSet.java:448)
> 	at org.apache.hadoop.hdfs.server.namenode.FSEditLog.logEdit(FSEditLog.java:421)
> 	at org.apache.hadoop.hdfs.server.namenode.FSEditLog.logMkDir(FSEditLog.java:793)
> 	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.mkdirsRecursively(FSNamesystem.java:4171)
> 	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.mkdirsInternal(FSNamesystem.java:4071)
> 	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.mkdirsInt(FSNamesystem.java:4030)
> 	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.mkdirs(FSNamesystem.java:4003)
> 	at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.mkdirs(NameNodeRpcServer.java:786)
> 	at org.apache.hadoop.hdfs.server.namenode.AuthorizationProviderProxyClientProtocol.mkdirs(AuthorizationProviderProxyClientProtocol.java:297)
> 	at ..
> {noformat}
> This is due to the fact that the _groupName_ returned by the {{SentryAuthorizationProvider}}
is null at times.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message