ignite-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Alexei Scherbakov (JIRA)" <j...@apache.org>
Subject [jira] [Created] (IGNITE-10912) Huge node join request discovery message slows down node joining and corresponding PME
Date Sun, 13 Jan 2019 15:17:00 GMT
Alexei Scherbakov created IGNITE-10912:
------------------------------------------

             Summary: Huge node join request discovery message slows down node joining and
corresponding PME
                 Key: IGNITE-10912
                 URL: https://issues.apache.org/jira/browse/IGNITE-10912
             Project: Ignite
          Issue Type: Improvement
            Reporter: Alexei Scherbakov
             Fix For: 2.8


WIth large topology and large number of caches/groups node join message can reach a size >
30M due to a large amount of transferred discovery data.

It adds overhead on ring traversal and slows down "node join" PME.

Possible solution:
 # introduce pre-join message with discovery data which doesn't increment topology version.
After all nodes wil have corressponding discovery data start actual joining. Discovery data
probably should be stored off-heap(or even on disk) to avoid heap usage bursts on joining
of multiple nodes.
 # Add compression to discovery data.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message