jackrabbit-oak-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Amrit Verma (Jira)" <j...@apache.org>
Subject [jira] [Created] (OAK-9573) Make TraverseWithSort strategy the default while indexing
Date Sat, 11 Sep 2021 14:35:00 GMT
Amrit Verma created OAK-9573:
--------------------------------

             Summary: Make TraverseWithSort strategy the default while indexing
                 Key: OAK-9573
                 URL: https://issues.apache.org/jira/browse/OAK-9573
             Project: Jackrabbit Oak
          Issue Type: Task
          Components: indexing
            Reporter: Amrit Verma
            Assignee: Amrit Verma


With the multithreaded strategy we have seen some issues in synchronization. Eg with thread
size 4 -

All 4 running tasks got the MemoryManager's signal, which is indicated by the log lines -
{code:java}
13:54:28.397 [Service Thread] INFO  o.a.j.o.i.i.d.f.TraverseAndSortTask - TAST-NSET19 Setting
dumpData to true
13:54:28.398 [Service Thread] INFO  o.a.j.o.i.i.d.f.TraverseAndSortTask - TAST-NSET2 Setting
dumpData to true
13:54:28.398 [Service Thread] INFO  o.a.j.o.i.i.d.f.TraverseAndSortTask - TAST-NSET10 Setting
dumpData to true
13:54:28.398 [Service Thread] INFO  o.a.j.o.i.i.d.f.TraverseAndSortTask - TAST-NSET1 Setting
dumpData to true

{code}
However only three of them actually proceeded with dumping the data and notifying the MemoryManager,
which is indicated by the log lines -
{code:java}
13:54:33.667 [pool-3-thread-2] INFO  o.a.j.o.i.i.d.f.TraverseAndSortTask - TAST-NSET2 Finished
saving data to disk. Notifying memory listener.
13:54:34.588 [pool-3-thread-4] INFO  o.a.j.o.i.i.d.f.TraverseAndSortTask - TAST-NSET19 Finished
saving data to disk. Notifying memory listener.
13:54:35.438 [pool-3-thread-3] INFO  o.a.j.o.i.i.d.f.TraverseAndSortTask - TAST-NSET10 Finished
saving data to disk. Notifying memory listener.{code}
After this newer tasks weren't able to register and process stuck in some cases.

So we need to make traverse with sort the default strategy for now.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Mime
View raw message