ignite-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Pavel Kovalenko (JIRA)" <j...@apache.org>
Subject [jira] [Created] (IGNITE-9398) Reduce time on processing CustomDiscoveryMessage by discovery worker
Date Tue, 28 Aug 2018 14:34:00 GMT
Pavel Kovalenko created IGNITE-9398:

             Summary: Reduce time on processing CustomDiscoveryMessage by discovery worker
                 Key: IGNITE-9398
                 URL: https://issues.apache.org/jira/browse/IGNITE-9398
             Project: Ignite
          Issue Type: Bug
          Components: cache
    Affects Versions: 2.6, 2.5, 2.4
            Reporter: Pavel Kovalenko
             Fix For: 2.7

Processing discovery CustomMessage may take significant values of time (0.5-0.7 seconds) before
sending to next node in the topology. This significantly accumulates the total time of PME
if topology has multiple nodes.
Let X = time of processing discovery message by discovery-msg-worker on each node before sending
to next node. 
Let N = number of nodes in the topology.
Then the minimal total time of exchange will be:
T = N * X

We shouldn't make heavy actions when process discovery message. Best solution will be separated
thread that will do it, while discovery-msg-worker will just pass a message to that thread
and send a message immediately to another node in topology.

This affects both TcpDiscoverySpi and ZkDiscoverySpi.

[11:59:33,134][INFO][tcp-disco-msg-worker-#2][TcpDiscoverySpi] Enqueued message type = TcpDiscoveryCustomEventMessage
id = e4b542b6561-a38dfe31-dcfd-430b-acb3-5a531db4197e time = 0
Received activate request with BaselineTopology[id=0]
Started state transition: true
[11:59:33,752][INFO][exchange-worker-#62][time] Started exchange init [topVer=AffinityTopologyVersion
[topVer=110, minorTopVer=1], crd=true, evt=DISCOVERY_CUSTOM_EVT, evtNode=a38dfe31-dcfd-430b-acb3-5a531db4197e,
customEvt=ChangeGlobalStateMessage [id=cea542b6561-47395de6-c204-4576-a0a3-99ec53d41ac3, reqId=5b651439-7a6a-43fc-9cb0-d646c3380576,
initiatingNodeId=a38dfe31-dcfd-430b-acb3-5a531db4197e, activate=true, baselineTopology=BaselineTopology
[id=0, branchingHash=-69412111965, branchingType='New BaselineTopology', baselineNodes=[node42,
node43, node44, node45, node46, node47, node48, node49, node50, node51, node52, node53, node54,
node55, node56, node57, node58, node59, node1, node4, node5, node2, node3, node8, node9, node6,
node7, node60, node61, node62, node63, node64, node65, node66, node67, node68, node69, node70,
node71, node72, node73, node74, node75, node76, node77, node78, node79, node80, node81, node82,
node83, node84, node85, node86, node87, node88, node89, node90, node91, node92, node93, node94,
node95, node96, node97, node10, node98, node11, node99, node12, node13, node14, node15, node16,
node100, node17, node18, node19, node108, node107, node106, node105, node104, node103, node102,
node101, node109, node20, node21, node22, node23, node24, node25, node26, node27, node28,
node29, node110, node30, node31, node32, node33, node34, node35, node36, node37, node38, node39,
node40, node41]], forceChangeBaselineTopology=false, timestamp=1535101173015], allowMerge=false]
[11:59:33,753][INFO][exchange-worker-#62][GridDhtPartitionsExchangeFuture] Start activation
process [nodeId=1906b9c3-73f4-4c30-85cc-cf6b99c3bab9, client=false, topVer=AffinityTopologyVersion
[topVer=110, minorTopVer=1]]
[11:59:33,756][INFO][exchange-worker-#62][FilePageStoreManager] Resolved page store work directory:
[11:59:33,756][INFO][exchange-worker-#62][FileWriteAheadLogManager] Resolved write ahead log
work directory: /storage/ssd/avolkov/tiden/snapshots-180824-114937/test_pitr/ignite.server.1/work/db/wal/node1
[11:59:33,756][INFO][exchange-worker-#62][FileWriteAheadLogManager] Resolved write ahead log
archive directory: /storage/ssd/avolkov/tiden/snapshots-180824-114937/test_pitr/ignite.server.1/work/db/wal/archive/node1
[11:59:33,757][INFO][exchange-worker-#62][FileWriteAheadLogManager] Started write-ahead log
manager [mode=LOG_ONLY]
[11:59:33,763][INFO][tcp-disco-msg-worker-#2][TcpDiscoverySpi] Processed message type = TcpDiscoveryCustomEventMessage
id = e4b542b6561-a38dfe31-dcfd-430b-acb3-5a531db4197e time = 629

This message was sent by Atlassian JIRA

View raw message