spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Andrew Or <and...@databricks.com>
Subject Re: spark master UI does not keep detailed application history
Date Mon, 16 Jun 2014 21:10:00 GMT
Are you referring to accessing a SparkUI for an application that has
finished? First you need to enable event logging while the application is
still running. In Spark 1.0, you set this by adding a line to
$SPARK_HOME/conf/spark-defaults.conf:

spark.eventLog.enabled true

Other than that, the content served on the master UI is largely the same as
before 1.0 is introduced.


2014-06-14 16:43 GMT-07:00 wxhsdp <wxhsdp@gmail.com>:

> hi, zhen
>   i met the same problem in ec2, application details can not be accessed.
> but i can read stdout
>   and stderr. the problem has not been solved yet
>
>
>
> --
> View this message in context:
> http://apache-spark-user-list.1001560.n3.nabble.com/spark-master-UI-does-not-keep-detailed-application-history-tp7608p7635.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>

Mime
View raw message