spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Battini Lakshman <>
Subject Difference between 'cores' config params: spark submit on k8s
Date Thu, 07 Mar 2019 21:53:15 GMT

I understand we need to specify the 'spark.kubernetes.driver.limit.cores'
and 'spark.kubernetes.executor.limit.cores' config parameters while
submitting spark on k8s namespace with resource quota applied.

There are also other config parameters 'spark.driver.cores' and
'spark.executor.cores' mentioned in documentation. What is the difference
between 'spark.driver.cores' and 'spark.kubernetes.driver.limit.cores'


Best Regards,
Lakshman B.

View raw message