flink-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From ashish pok <ashish...@yahoo.com>
Subject Fw: 1.4.2 - Unable to start YARN containers with more than 1 vCores per Task Manager
Date Tue, 03 Apr 2018 12:50:36 GMT


Hi All,
 
  
 
I had been using the following command in a Lab environment successfully in 1.3 Flink version.
 
  
 
yarn-session.sh -n 4 -s 4 -jm 2048 -tm 2048 -Dyarn.containers.vcores=2 -nm infra.test3
 
  
 
As expected, I see 4 TMs with 16 slots and taking 8 vCores from YARN. In a new Prod environment,
I am using 1.4.2 version and I am only seeing 1 vCore per container with the same command.
I did check YARN config and max vCores allowed per container is configured as 48. 
 
  
 
Anyone has seen something similar or has idea on what we can look into? Might be YARN config?
 
  
 
Thanks,
 
  
 
Ashish
   
<!--#yiv6465767730 _filtered #yiv6465767730 {font-family:"Cambria Math";panose-1:2 4 5
3 5 4 6 3 2 4;} _filtered #yiv6465767730 {font-family:Calibri;panose-1:2 15 5 2 2 2 4 3 2
4;}#yiv6465767730 #yiv6465767730 p.yiv6465767730MsoNormal, #yiv6465767730 li.yiv6465767730MsoNormal,
#yiv6465767730 div.yiv6465767730MsoNormal {margin:0in;margin-bottom:.0001pt;font-size:12.0pt;font-family:"Calibri",
sans-serif;}#yiv6465767730 a:link, #yiv6465767730 span.yiv6465767730MsoHyperlink {color:#0563C1;text-decoration:underline;}#yiv6465767730
a:visited, #yiv6465767730 span.yiv6465767730MsoHyperlinkFollowed {color:#954F72;text-decoration:underline;}#yiv6465767730
span.yiv6465767730EmailStyle17 {font-family:"Calibri", sans-serif;color:windowtext;}#yiv6465767730
.yiv6465767730MsoChpDefault {font-family:"Calibri", sans-serif;} _filtered #yiv6465767730
{margin:1.0in 1.0in 1.0in 1.0in;}#yiv6465767730 div.yiv6465767730WordSection1 {}-->
Mime
View raw message