ignite-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Alexander Belyak (JIRA)" <j...@apache.org>
Subject [jira] [Created] (IGNITE-6898) Datastreamers can lead to OOM on server side
Date Tue, 14 Nov 2017 09:19:00 GMT
Alexander Belyak created IGNITE-6898:
----------------------------------------

             Summary: Datastreamers can lead to OOM on server side
                 Key: IGNITE-6898
                 URL: https://issues.apache.org/jira/browse/IGNITE-6898
             Project: Ignite
          Issue Type: Bug
      Security Level: Public (Viewable by anyone)
          Components: general
    Affects Versions: 2.1
            Reporter: Alexander Belyak


If grid server node process many datastreamer in same time (from many clients, with many cache
backups and persistence, i.e. if processing take some time) it can lead to OutOfMemoryError
in server JVM. To fix we can:
1) specify buffer sized in bytes instead of entries
2) use pageMemory to store streamer buffers
I get this problem on 16 server node grid with 45g heap each and 15 clients with 2 datastreamer
each with this settings:
autoFlushFrequency=0
allowOverwrite=false
perNodeParallelOperations=8
perNodeBufferSize=10000
Each client have 64g heap.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message