jackrabbit-oak-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Amrit Verma (Jira)" <j...@apache.org>
Subject [jira] [Created] (OAK-9576) Multithreaded download synchronization issues
Date Thu, 16 Sep 2021 12:03:00 GMT
Amrit Verma created OAK-9576:
--------------------------------

             Summary: Multithreaded download synchronization issues
                 Key: OAK-9576
                 URL: https://issues.apache.org/jira/browse/OAK-9576
             Project: Jackrabbit Oak
          Issue Type: Bug
          Components: indexing
            Reporter: Amrit Verma
            Assignee: Amrit Verma


Multithreaded download implementation done in OAK-9434 suffers from some synchronization
issues.

Eg with thread size 4 -

All 4 running tasks got the MemoryManager's signal, which is indicated by the log lines -
{code:java}
13:54:28.397 [Service Thread] INFO  o.a.j.o.i.i.d.f.TraverseAndSortTask - TAST-NSET19 Setting
dumpData to true
13:54:28.398 [Service Thread] INFO  o.a.j.o.i.i.d.f.TraverseAndSortTask - TAST-NSET2 Setting
dumpData to true
13:54:28.398 [Service Thread] INFO  o.a.j.o.i.i.d.f.TraverseAndSortTask - TAST-NSET10 Setting
dumpData to true
13:54:28.398 [Service Thread] INFO  o.a.j.o.i.i.d.f.TraverseAndSortTask - TAST-NSET1 Setting
dumpData to true

{code}
However only three of them actually proceeded with dumping the data and notifying the MemoryManager,
which is indicated by the log lines -
{code:java}
13:54:33.667 [pool-3-thread-2] INFO  o.a.j.o.i.i.d.f.TraverseAndSortTask - TAST-NSET2 Finished
saving data to disk. Notifying memory listener.
13:54:34.588 [pool-3-thread-4] INFO  o.a.j.o.i.i.d.f.TraverseAndSortTask - TAST-NSET19 Finished
saving data to disk. Notifying memory listener.
13:54:35.438 [pool-3-thread-3] INFO  o.a.j.o.i.i.d.f.TraverseAndSortTask - TAST-NSET10 Finished
saving data to disk. Notifying memory listener.{code}
After this newer tasks weren't able to register and process stuck in some cases.

 

We need to investigate and fix such issues.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Mime
View raw message