ranger-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Madhan Neethiraj (JIRA)" <j...@apache.org>
Subject [jira] [Comment Edited] (RANGER-1300) S3 support
Date Fri, 22 Jun 2018 16:46:00 GMT

    [ https://issues.apache.org/jira/browse/RANGER-1300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16520572#comment-16520572
] 

Madhan Neethiraj edited comment on RANGER-1300 at 6/22/18 4:45 PM:
-------------------------------------------------------------------

[~bolke] - great start! Recently Atlas community has added types for S3 - which include aws_s3_bucket,
aws_s3_pseudo_dir and aws_s3_object (ATLAS-2708); also updated Atlas hook for Hive to recognize
S3 path references in DDL/DML and populate Atlas with appropriate S3 entities (ATLAS-2760).
It might be useful to model Ranger resources to be in sync with Atlas entity-types. Please
review resource-definitions in the attached  [^ranger-servicedef-aws-s3.json] . Access-types
in this service-def only have get/put/delete of objects. Your service-def cover bucket level
as well - which is better. Let's continue to take this further. Thanks!


was (Author: madhan.neethiraj):
[~bolke] - great start! Recently Atlas community has added types for S3 - which include aws_s3_bucket,
aws_s3_pseudo_dir and aws_s3_object (ATLAS-2708); also updated Atlas hook for Hive to recognize
S3 path references in DDL/DML and populate Atlas with appropriate S3 entities (ATLAS-2760).
It might be useful to model Ranger resources to be in sync with Atlas entity-types. Please
review resource-definitions in the attached ranger-servicedef-aws-s3.json. Access-types in
this service-def only have get/put/delete of objects. Your service-def cover bucket level
as well - which is better. Let's continue to take this further. Thanks!

> S3 support
> ----------
>
>                 Key: RANGER-1300
>                 URL: https://issues.apache.org/jira/browse/RANGER-1300
>             Project: Ranger
>          Issue Type: New Feature
>          Components: plugins
>            Reporter: Jose
>            Priority: Major
>         Attachments: ranger-servicedef-aws-s3.json
>
>
> As more and more people are deploying hadoop into AWS and as S3 is used in lots of application.
It'd be nice to have S3 support built into Ranger.
> It's not a trivial task. Right now Ranger Storage support (only hdfs) runs directly in
the Namenode



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message