spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Archit Thakur <archit279tha...@gmail.com>
Subject Updation of spark metrics.
Date Tue, 12 May 2015 06:02:06 GMT
Hi,

I can see executor sends the TaskMetrics in the heartbeat every 10
sec(configurable). but in JobProgListener there is a check for task
completion. If the task is not completed, it doesn't update the metrics on
the UI.
Any specific reason for this.? I don't think there would be much of the
performance impact by removing that check? Please correct me.

Thanks & Regards,
Archit Thakur.

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message