hama-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Behroz Sikander <behro...@gmail.com>
Subject Re: hama processes
Date Fri, 28 Aug 2015 14:12:45 GMT
Ok I will try it out.

No, actually I am learning alot by facing these problems. It is actually a
good thing :D

Regards,
Behroz

On Fri, Aug 28, 2015 at 5:52 AM, Edward J. Yoon <edwardyoon@apache.org>
wrote:

> > message managers. Hmmm, I will recheck my logic related to messages. Btw
>
> Serialization (like GraphJobMessage) is good idea. It stores multiple
> messages in serialized form in a single object to reduce the memory
> usage and RPC overhead.
>
> > what is the limit of these message managers ? How much data at a single
> > time they can handle ?
>
> It depends on memory.
>
> > P.S. Each day, as I am moving towards a big cluster I am running into
> > problems (alot of them :D).
>
> Haha, sorry for inconvenient and thanks for your reports.
>
> On Fri, Aug 28, 2015 at 11:25 AM, Behroz Sikander <behroz89@gmail.com>
> wrote:
> > Ok. So, I do have a memory problem. I will try to scale out.
> >
> > *>>Each task processor has two message manager, one for outgoing and one*
> >
> > *for incoming. All these are handled in memory, so it sometimesrequires
> > large memory space.*
> > So, you mean that before barrier synchronization, I have alot of data in
> > message managers. Hmmm, I will recheck my logic related to messages. Btw
> > what is the limit of these message managers ? How much data at a single
> > time they can handle ?
> >
> > P.S. Each day, as I am moving towards a big cluster I am running into
> > problems (alot of them :D).
> >
> > Regards,
> > Behroz Sikander
> >
> > On Fri, Aug 28, 2015 at 4:04 AM, Edward J. Yoon <edwardyoon@apache.org>
> > wrote:
> >
> >> > for 3 Groom child process + 2GB for Ubuntu OS). Is this correct
> >> > understanding ?
> >>
> >> and,
> >>
> >> > on a big dataset. I think these exceptions have something to do with
> >> Ubuntu
> >> > OS killing the hama process due to lack of memory. So, I was curious
> >> about
> >>
> >> Yes, you're right.
> >>
> >> Each task processor has two message manager, one for outgoing and one
> >> for incoming. All these are handled in memory, so it sometimes
> >> requires large memory space. To solve the OutOfMemory issue, you
> >> should scale-out your cluster by increasing the number of nodes and
> >> job tasks, or optimize your algorithm. Another option is
> >> disk-spillable message manager. This is not supported yet.
> >>
> >> On Fri, Aug 28, 2015 at 10:45 AM, Behroz Sikander <behroz89@gmail.com>
> >> wrote:
> >> > Hi,
> >> > Yes. According to hama-default.xml, each machine will open 3 process
> with
> >> > 2GB memory each. This means that my VMs need atleast 8GB memory (2GB
> each
> >> > for 3 Groom child process + 2GB for Ubuntu OS). Is this correct
> >> > understanding ?
> >> >
> >> > I recently ran into the following exceptions when I was trying to run
> >> hama
> >> > on a big dataset. I think these exceptions have something to do with
> >> Ubuntu
> >> > OS killing the hama process due to lack of memory. So, I was curious
> >> about
> >> > my configurations.
> >> > 'BSP task process exit with nonzero status of 137.'
> >> > 'BSP task process exit with nonzero status of 1'
> >> >
> >> >
> >> >
> >> > Regards,
> >> > Behroz
> >> >
> >> > On Fri, Aug 28, 2015 at 3:04 AM, Edward J. Yoon <
> edwardyoon@apache.org>
> >> > wrote:
> >> >
> >> >> Hi,
> >> >>
> >> >> You can change the max tasks per node by setting below property in
> >> >> hama-site.xml. :-)
> >> >>
> >> >>   <property>
> >> >>     <name>bsp.tasks.maximum</name>
> >> >>     <value>3</value>
> >> >>     <description>The maximum number of BSP tasks that will be
run
> >> >> simultaneously
> >> >>     by a groom server.</description>
> >> >>   </property>
> >> >>
> >> >>
> >> >> On Fri, Aug 28, 2015 at 5:18 AM, Behroz Sikander <behroz89@gmail.com
> >
> >> >> wrote:
> >> >> > Hi,
> >> >> > Recently, I noticed that my hama deployment is only opening 3
> >> processes
> >> >> per
> >> >> > machine. This is because of the configuration settings in the
> default
> >> >> hama
> >> >> > file.
> >> >> >
> >> >> > My questions is why 3 and why not 5 or 7 ? What criteria's should
> be
> >> >> > considered if I want to increase the value ?
> >> >> >
> >> >> > Regards,
> >> >> > Behroz
> >> >>
> >> >>
> >> >>
> >> >> --
> >> >> Best Regards, Edward J. Yoon
> >> >>
> >>
> >>
> >>
> >> --
> >> Best Regards, Edward J. Yoon
> >>
>
>
>
> --
> Best Regards, Edward J. Yoon
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message