samza-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Martin Kleppmann <mar...@kleppmann.com>
Subject Re: Adjust heap size according to memory allocated to containers
Date Mon, 30 Jun 2014 16:54:21 GMT
Hi Casey,

You can set the heap size with the task.opts setting in your job configuration: http://samza.incubator.apache.org/learn/documentation/0.7.0/jobs/configuration-table.html#task-opts

You'll also need to set yarn.container.memory.mb correspondingly:
http://samza.incubator.apache.org/learn/documentation/0.7.0/jobs/configuration-table.html#yarn-container-memory-mb

Best,
Martin

On 30 Jun 2014, at 12:05, Anh Thu Vu <vuanhthu888@gmail.com> wrote:

> Hi guys,
> 
> If I'm not wrong, the heap size is 768MB by default (default value in
> run-class.sh) and if I want to change that I can either export the
> JAVA_OPTS var on all my machines or change the default value in the
> run-class.sh.
> 
> But IMO, both options are not optimal and I think it's best that this value
> can be set to something like: 0.75*(memory allocation for the container)
> 
> What do you think? Is there currently an "easy" way to achieve something
> like that?
> 
> Casey


Mime
View raw message