spark-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Charles Yeh <>
Subject Getting new metrics into /api/v1
Date Wed, 04 Nov 2015 06:24:39 GMT

I'm trying to get maxCores and memoryPerExecutorMB into /api/v1 for this

I can't figure out which *getApplicationInfoList *is used by
*It's attached in SparkUI but SparkUI's doesn't have start / end times
and /api/v1/applications does.

It looks like:

   - *MasterWebUI.scala* has these fields, since it has the applications
   - *HistoryServer.scala *doesn't have these fields, since it infers them
   from logs
   - *SparkUI.scala *looks like a mock since it doesn't have end time /
   user / attempt id either

View raw message