jackrabbit-oak-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chetan Mehrotra (JIRA)" <j...@apache.org>
Subject [jira] [Resolved] (OAK-7115) Store NodeState json in bytes when storing in in-memory queue
Date Wed, 03 Jan 2018 09:52:02 GMT

     [ https://issues.apache.org/jira/browse/OAK-7115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Chetan Mehrotra resolved OAK-7115.
----------------------------------
       Resolution: Fixed
    Fix Version/s:     (was: 1.10)
                   1.7.15
                   1.8

Done with 1819936. It just stores the json in bytes but does not perform any compression.
With this change the dumping time for 65M nodestates reduced from 2.632h to 2.230h i.e. saving
of 24 mins!

> Store NodeState json in bytes when storing in in-memory queue
> -------------------------------------------------------------
>
>                 Key: OAK-7115
>                 URL: https://issues.apache.org/jira/browse/OAK-7115
>             Project: Jackrabbit Oak
>          Issue Type: Improvement
>          Components: run
>            Reporter: Chetan Mehrotra
>            Assignee: Chetan Mehrotra
>            Priority: Minor
>             Fix For: 1.8, 1.7.15
>
>         Attachments: OAK-7115-v1.patch
>
>
> Currently TraverseWithSortStrategy stores the NodeStateEntry as json text in the in-memory
queue. We can save memory by storing it in byte array and probably compressed which would
allow storing more entries in-memory before sorting and saving in the file



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message