hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Steve Loughran (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HADOOP-16277) Expose getTokenKind method in FileSystem
Date Fri, 26 Apr 2019 10:06:00 GMT

    [ https://issues.apache.org/jira/browse/HADOOP-16277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16826840#comment-16826840

Steve Loughran commented on HADOOP-16277:

I see what you are trying to do here: work out which token is needed for a specific FS. 


* with KMS in the mix, and viewFS, a filesystem may have >1 token.
* with the S3A, WASB, AFBS and GS filesystems, the DT support is a plugin point: you don't
have a single hard coded token to look for, so that hard coding you fall back to doesn't work.

What you really want is to collect all the DTs for a filesystem: but doesn't asking an FS
instance for that return the existing ones if they exist? I'd have to look through all the
existing FS implementations for that, but it seems like they ought to

> Expose getTokenKind method in FileSystem
> ----------------------------------------
>                 Key: HADOOP-16277
>                 URL: https://issues.apache.org/jira/browse/HADOOP-16277
>             Project: Hadoop Common
>          Issue Type: Improvement
>            Reporter: Venkatesh Sridharan
>            Priority: Trivial
> It would be nice to have a getTokenKind() method exposed in [FileSystem|[https://github.com/apache/hadoop-common/blob/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/fs/FileSystem.java]]
. Currently WebHdfsFileSystem class has getTokenKind() which is protected. Having it in FileSystem
makes it easier to use at runtime when the consumer doesn't know what the underlying FileSystem
implementation is. 

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org

View raw message