spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From navneet sharma <>
Subject Spark job taking 10s to allocate executors and memory before submitting job
Date Wed, 27 Sep 2017 13:06:12 GMT

I am running spark job taking total 18s, in that 8 seconds for actual
processing logic(business logic) and 10s for allocating executors and
memory. How to reduce initial time.

Any ideas how to reduce time before spark job goes to submit state.


Navneet Sharma

View raw message