samza-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Garry Turkington <g.turking...@improvedigital.com>
Subject RE: Yarn scheduling
Date Fri, 29 May 2015 23:42:22 GMT
Hi Roger,

I've seen unbalanced container assignment across hosts but never one being maxed out before
any others get any containers. So I'd look to the YARN config to start with.

I believe though there will be a risk of this type of thing until  YARN implements anti-affinity:

https://issues.apache.org/jira/browse/YARN-1042

But as said above, maxing out a host at a time does sound odd to me.

Garry

-----Original Message-----
From: Roger Hoover [mailto:roger.hoover@gmail.com] 
Sent: 29 May 2015 23:09
To: dev@samza.apache.org
Subject: Yarn scheduling

Hi,

I notice that when YARN schedules my jobs, it loads up one machine completely before scheduling
on the next.  I'm using Capacity Scheduler with a default config.

Is there a way to make it "round-robin" among the available machines?

Thanks,

Roger

-----
No virus found in this message.
Checked by AVG - www.avg.com
Version: 2014.0.4800 / Virus Database: 4311/9897 - Release Date: 05/29/15
Mime
View raw message