spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Thomas Gerber <>
Subject Spark logs in standalone clusters
Date Wed, 04 Mar 2015 18:21:47 GMT

I was wondering where all the logs files were located on a standalone

   1. the executor logs are in the work directory on each slave machine
      - I've notice that GC information is in stdout, and stage information
      in stderr
      - *Could we get more information on what is written in stdout vs
   2. the master log
      - The path to the log file is shown went you launch the master,
      like /mnt/var/log/apps/spark-hadoop-org.apache.spark.deploy.master.Master-MACHINENAME.out;
      - *Could we get more information on where this path is configured?*
   3. driver logs
      - It seems they are only in the console by default (although you can
      override that in the file.
   4. communication manager logs?
   - *Are there any logs for the communication manager (aka the
   5. Any other log file?


View raw message