spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Thomas Gerber <thomas.ger...@radius.com>
Subject Spark logs in standalone clusters
Date Wed, 04 Mar 2015 18:21:47 GMT
Hello,

I was wondering where all the logs files were located on a standalone
cluster:

   1. the executor logs are in the work directory on each slave machine
   (stdout/stderr)
      - I've notice that GC information is in stdout, and stage information
      in stderr
      - *Could we get more information on what is written in stdout vs
      stderr?*
   2. the master log
      - The path to the log file is shown went you launch the master,
      like /mnt/var/log/apps/spark-hadoop-org.apache.spark.deploy.master.Master-MACHINENAME.out;
      - *Could we get more information on where this path is configured?*
   3. driver logs
      - It seems they are only in the console by default (although you can
      override that in the log4j.properties file.
   4. communication manager logs?
   - *Are there any logs for the communication manager (aka the
      MapOutputTracker?)?*
   5. Any other log file?

Thanks,
Thomas

Mime
View raw message