hadoop-common-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From GitBox <...@apache.org>
Subject [GitHub] [hadoop] avijayanhwx opened a new pull request #882: HDDS-1624 : Refactor operations inside the bucket lock in OM key write.
Date Fri, 31 May 2019 20:26:18 GMT
avijayanhwx opened a new pull request #882: HDDS-1624 : Refactor operations inside the bucket
lock in OM key write.
URL: https://github.com/apache/hadoop/pull/882
 
 
   There are a few steps that are done inside the OM bucket lock that are lock invariant and
can be done outside the lock. This patch refactors those steps. It also adds an isExist API
in the metadata store so that we dont need to deserialize the byte[] to Object while doing
a simple table.get(key) != null check.
   
   On applying the patch, the OM + SCM (With dummy datanodes) write performance improves by
around 3x.
   
   Thanks to @nandakumar131  who helped with this patch.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org


Mime
View raw message