hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Aaron T. Myers (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-7214) Hadoop /usr/bin/groups equivalent
Date Sat, 02 Apr 2011 01:56:05 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-7214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13014932#comment-13014932

Aaron T. Myers commented on HADOOP-7214:

Thanks for the comments, Allen. Responses inline.

bq. But one thing comes to mind: isn't this information already reported as part of the job
conf? Shouldn't a user be able to query their job's information (at least via the web UI...
probably should have something shell-ish) to determine this information?

Even if it were available, that might solve the problem for MR jobs, but that doesn't solve
the whole problem. Suppose user {{foo}} tries to {{chgrp}} some file to group {{bar}}, but
they get an error along the lines of "{{Error: user 'foo' does not belong to 'bar'}}." How
should the user go about seeing what groups they are a member of, and therefore what groups
they can {{chgrp}} files to? The only option at present is to {{ssh}} to the NN and run "groups".

bq. Granted, it would be nice to know prior to job submission, but we're fundamentally looking
at a debugging tool for broken environments.

I don't entirely agree that this is only for debugging a broken environment. I think I over-emphasized
the "different groups on NN vs. JT" portion of this issue in my original issue description.
Here's a better one:

A user should be able to see what groups they are a member of from the command line. For HDFS
permissions, the only groups that matter are those on the NN. For M/R permissions, the only
groups that matter are those on the JT. So, whatever we implement to show the user their group
membership should be able to query the NN and JT separately.

> Hadoop /usr/bin/groups equivalent
> ---------------------------------
>                 Key: HADOOP-7214
>                 URL: https://issues.apache.org/jira/browse/HADOOP-7214
>             Project: Hadoop Common
>          Issue Type: New Feature
>    Affects Versions: 0.23.0
>            Reporter: Aaron T. Myers
>            Assignee: Aaron T. Myers
> Since user -> groups resolution is done on the NN and JT machines, there should be
a way for users to determine what groups they're a member of from the NN's and JT's perspective.

This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

View raw message