spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Patrick Wendell <>
Subject Re: no stdout output from worker
Date Mon, 10 Mar 2014 05:50:46 GMT
Hey Sen,

Is your code in the driver code or inside one of the tasks?

If it's in the tasks, the place you would expect these to be is in
stdout file under <spark>/<appid>/work/[stdout/stderr]. Are you seeing
at least stderr logs in that folder? If not then the tasks might not
be running on the workers machines. If you see stderr but not stdout
that's a bit of a puzzler since they both go through the same

- Patrick

On Sun, Mar 9, 2014 at 2:32 PM, Sen, Ranjan [USA] <> wrote:
> Hi
> I have some System.out.println in my Java code that is working ok in a local
> environment. But when I run the same code on a standalone  mode in a EC2
> cluster I do not see them at the worker stdout (in the worker node under
> <spark location>/work ) or at the driver console. Could you help me
> understand how do I troubleshoot?
> Thanks
> Ranjan

View raw message