giraph-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Alessandro Presta (JIRA)" <>
Subject [jira] [Commented] (GIRAPH-326) Writing input splits to ZooKeeper in parallel
Date Wed, 19 Sep 2012 16:47:08 GMT


Alessandro Presta commented on GIRAPH-326:

Eli: our colleague had over 3000 list entries. Each entry is 10KB, and apparently Zookeeper
can write around 20 of them per second. Hence he was getting a crash with "Forced a shutdown
hook kill of the ZooKeeper process" on the master.
> Writing input splits to ZooKeeper in parallel
> ---------------------------------------------
>                 Key: GIRAPH-326
>                 URL:
>             Project: Giraph
>          Issue Type: Improvement
>            Reporter: Maja Kabiljo
>         Attachments: GIRAPH-326.patch
> (Posting issue and the patch from a colleague)
> Writing input splits to zookeeper can take a lot of time. From his experiments: serial
2m45s, with 16 cores 15s.

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see:

View raw message