jackrabbit-oak-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Michael Dürig (JIRA) <j...@apache.org>
Subject [jira] [Updated] (OAK-4949) SegmentWriter buffers child node list changes
Date Wed, 09 Nov 2016 08:52:58 GMT

     [ https://issues.apache.org/jira/browse/OAK-4949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Michael Dürig updated OAK-4949:
    Labels: performance  (was: )

> SegmentWriter buffers child node list changes
> ---------------------------------------------
>                 Key: OAK-4949
>                 URL: https://issues.apache.org/jira/browse/OAK-4949
>             Project: Jackrabbit Oak
>          Issue Type: Improvement
>          Components: segment-tar
>            Reporter: Alex Parvulescu
>            Assignee: Alex Parvulescu
>              Labels: performance
> The {{SegmentWriter}} currently buffers the list of child nodes changed on a nodestate
update [0] (new node or updated node). This can be problematic in a scenario where there are
a large number of children added to a node (ie. unique index size seen to spike above {{10MM}}
in one case).
> To have a reference for the impact of this, at the {{SegmentWriter}} level, for a list
of map entries of almost {{3MM}} items, I saw it take up around {{245MB}} heap.
> This issue serves to track a possible improvement here in how we handle this update scenario.
> [0] https://github.com/apache/jackrabbit-oak/blob/trunk/oak-segment-tar/src/main/java/org/apache/jackrabbit/oak/segment/SegmentWriter.java#L516

This message was sent by Atlassian JIRA

View raw message