From dev-return-24373-apmail-ranger-dev-archive=ranger.apache.org@ranger.apache.org Tue Mar 3 12:28:19 2020 Return-Path: X-Original-To: apmail-ranger-dev-archive@www.apache.org Delivered-To: apmail-ranger-dev-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [207.244.88.153]) by minotaur.apache.org (Postfix) with SMTP id 387C219E25 for ; Tue, 3 Mar 2020 12:28:19 +0000 (UTC) Received: (qmail 60332 invoked by uid 500); 3 Mar 2020 12:28:18 -0000 Delivered-To: apmail-ranger-dev-archive@ranger.apache.org Received: (qmail 60310 invoked by uid 500); 3 Mar 2020 12:28:18 -0000 Mailing-List: contact dev-help@ranger.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@ranger.apache.org Delivered-To: mailing list dev@ranger.apache.org Received: (qmail 60290 invoked by uid 99); 3 Mar 2020 12:28:18 -0000 Received: from mailrelay1-us-west.apache.org (HELO mailrelay1-us-west.apache.org) (209.188.14.139) by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 03 Mar 2020 12:28:18 +0000 Received: from reviews.apache.org (unknown [10.41.0.12]) by mailrelay1-us-west.apache.org (ASF Mail Server at mailrelay1-us-west.apache.org) with ESMTP id 92595E0EAA; Tue, 3 Mar 2020 12:28:17 +0000 (UTC) Received: from reviews-vm2.apache.org (localhost [IPv6:::1]) by reviews.apache.org (ASF Mail Server at reviews-vm2.apache.org) with ESMTP id D5390C40150; Tue, 3 Mar 2020 12:28:16 +0000 (UTC) Content-Type: multipart/alternative; boundary="===============4597194964161330995==" MIME-Version: 1.0 Subject: Re: Review Request 72166: RANGER-2713: Remove audit fields from XXPolicyRef objects From: Pradeep Agrawal To: Pradeep Agrawal Cc: Andrew Luo , ranger Date: Tue, 03 Mar 2020 12:28:16 -0000 Message-ID: <20200303122816.44839.75315@reviews-vm2.apache.org> X-ReviewBoard-URL: https://reviews.apache.org/ Auto-Submitted: auto-generated Sender: Pradeep Agrawal X-ReviewGroup: ranger X-Auto-Response-Suppress: DR, RN, OOF, AutoReply X-ReviewRequest-URL: https://reviews.apache.org/r/72166/ X-Sender: Pradeep Agrawal References: <20200226221801.57371.33596@reviews-vm2.apache.org> In-Reply-To: <20200226221801.57371.33596@reviews-vm2.apache.org> X-ReviewBoard-Diff-For: security-admin/db/sqlserver/patches/046-drop-audit-columns-from-policy-ref-tables.sql X-ReviewBoard-Diff-For: security-admin/db/oracle/patches/046-drop-audit-columns-from-policy-ref-tables.sql X-ReviewBoard-Diff-For: security-admin/db/postgres/patches/046-drop-audit-columns-from-policy-ref-tables.sql X-ReviewBoard-Diff-For: security-admin/db/mysql/patches/046-drop-audit-columns-from-policy-ref-tables.sql X-ReviewBoard-Diff-For: security-admin/db/sqlanywhere/patches/046-drop-audit-columns-from-policy-ref-tables.sql Reply-To: Pradeep Agrawal X-ReviewRequest-Repository: ranger --===============4597194964161330995== MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 8bit ----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/72166/#review219731 ----------------------------------------------------------- >From which version upgrade case has been tested ? can you try from ranger-0.7 also if it was not tested? - Pradeep Agrawal On 二月 26, 2020, 10:18 p.m., Andrew Luo wrote: > > ----------------------------------------------------------- > This is an automatically generated e-mail. To reply, visit: > https://reviews.apache.org/r/72166/ > ----------------------------------------------------------- > > (Updated 二月 26, 2020, 10:18 p.m.) > > > Review request for ranger and Pradeep Agrawal. > > > Bugs: RANGER-2713 > https://issues.apache.org/jira/browse/RANGER-2713 > > > Repository: ranger > > > Description > ------- > > XXPolicyRef objects have fields such as create time, update time, added by user ID, updated by user ID, but there fields are entirely useless since they are all copied from the XXPolicy object. In addition, while improving performance for creation of policies with large numbers of users, we discovered that a lot of time was being spent in JPA converting these Date objects especially. After removing these fields we saw a significant performance improvement (a secondary benefit is less database space usage). > > > Diffs > ----- > > security-admin/db/mysql/optimized/current/ranger_core_db_mysql.sql 47618f6b3 > security-admin/db/mysql/patches/046-drop-audit-columns-from-policy-ref-tables.sql PRE-CREATION > security-admin/db/oracle/optimized/current/ranger_core_db_oracle.sql e59e7de61 > security-admin/db/oracle/patches/046-drop-audit-columns-from-policy-ref-tables.sql PRE-CREATION > security-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql 37ea61912 > security-admin/db/postgres/patches/046-drop-audit-columns-from-policy-ref-tables.sql PRE-CREATION > security-admin/db/sqlanywhere/optimized/current/ranger_core_db_sqlanywhere.sql bd1c47cc4 > security-admin/db/sqlanywhere/patches/046-drop-audit-columns-from-policy-ref-tables.sql PRE-CREATION > security-admin/db/sqlserver/optimized/current/ranger_core_db_sqlserver.sql 22e1746f2 > security-admin/db/sqlserver/patches/046-drop-audit-columns-from-policy-ref-tables.sql PRE-CREATION > security-admin/src/main/java/org/apache/ranger/biz/PolicyRefUpdater.java baacfa4d8 > security-admin/src/main/java/org/apache/ranger/entity/XXPolicyRefAccessType.java 6af8f99f4 > security-admin/src/main/java/org/apache/ranger/entity/XXPolicyRefCondition.java 4f4409d6a > security-admin/src/main/java/org/apache/ranger/entity/XXPolicyRefDataMaskType.java cb926740e > security-admin/src/main/java/org/apache/ranger/entity/XXPolicyRefGroup.java 32a1b9f24 > security-admin/src/main/java/org/apache/ranger/entity/XXPolicyRefResource.java 115064621 > security-admin/src/main/java/org/apache/ranger/entity/XXPolicyRefRole.java 7aee502e0 > security-admin/src/main/java/org/apache/ranger/entity/XXPolicyRefUser.java 8dfb92833 > security-admin/src/main/java/org/apache/ranger/service/XPortalUserService.java 85e457efa > security-admin/src/test/java/org/apache/ranger/biz/TestServiceDBStore.java 69c8a4cb6 > > > Diff: https://reviews.apache.org/r/72166/diff/1/ > > > Testing > ------- > > Fresh install and upgrade tested on all 5 databases (tested service and policy creation) > > Also tested user deletion on MySQL: > > 1. Created new user > 2. Logged in as new user, created a policy > 3. Logged back in as original user, delete user that created policy > 4. Verified no errors, policy is still present/correct > > Also searched the source code and JPA queries xml for other references to these fields > > > Thanks, > > Andrew Luo > > --===============4597194964161330995==--