jackrabbit-oak-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Amrit Verma (Jira)" <j...@apache.org>
Subject [jira] [Resolved] (OAK-9573) Make TraverseWithSort strategy the default while indexing
Date Thu, 16 Sep 2021 12:03:00 GMT

     [ https://issues.apache.org/jira/browse/OAK-9573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Amrit Verma resolved OAK-9573.
------------------------------
    Fix Version/s: 1.42.0
       Resolution: Fixed

> Make TraverseWithSort strategy the default while indexing
> ---------------------------------------------------------
>
>                 Key: OAK-9573
>                 URL: https://issues.apache.org/jira/browse/OAK-9573
>             Project: Jackrabbit Oak
>          Issue Type: Task
>          Components: indexing
>            Reporter: Amrit Verma
>            Assignee: Amrit Verma
>            Priority: Major
>             Fix For: 1.42.0
>
>
> With the multithreaded strategy we have seen some issues in synchronization. Eg with
thread size 4 -
> All 4 running tasks got the MemoryManager's signal, which is indicated by the log lines
-
> {code:java}
> 13:54:28.397 [Service Thread] INFO  o.a.j.o.i.i.d.f.TraverseAndSortTask - TAST-NSET19
Setting dumpData to true
> 13:54:28.398 [Service Thread] INFO  o.a.j.o.i.i.d.f.TraverseAndSortTask - TAST-NSET2
Setting dumpData to true
> 13:54:28.398 [Service Thread] INFO  o.a.j.o.i.i.d.f.TraverseAndSortTask - TAST-NSET10
Setting dumpData to true
> 13:54:28.398 [Service Thread] INFO  o.a.j.o.i.i.d.f.TraverseAndSortTask - TAST-NSET1
Setting dumpData to true
> {code}
> However only three of them actually proceeded with dumping the data and notifying the
MemoryManager, which is indicated by the log lines -
> {code:java}
> 13:54:33.667 [pool-3-thread-2] INFO  o.a.j.o.i.i.d.f.TraverseAndSortTask - TAST-NSET2
Finished saving data to disk. Notifying memory listener.
> 13:54:34.588 [pool-3-thread-4] INFO  o.a.j.o.i.i.d.f.TraverseAndSortTask - TAST-NSET19
Finished saving data to disk. Notifying memory listener.
> 13:54:35.438 [pool-3-thread-3] INFO  o.a.j.o.i.i.d.f.TraverseAndSortTask - TAST-NSET10
Finished saving data to disk. Notifying memory listener.{code}
> After this newer tasks weren't able to register and process stuck in some cases.
> So we need to make traverse with sort the default strategy for now.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Mime
View raw message