giraph-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Khaled Ammar <khaled.am...@gmail.com>
Subject Memory overhead in Giraph-1.1.0
Date Tue, 07 Jul 2015 22:52:38 GMT
Hi all,

I wonder if any one can help me understand why giraph uses too much memory.
For example, I have a 12 GB graph (text file size), it needs 145GB to 170GB
as total heap size. I tried to count the memory required for edges and
vertices data structure, but it cannot not exceed 30 GB.

Any hints are welcome.

-- 
Thanks,
-Khaled

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message