spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ian Ferreira <ianferre...@hotmail.com>
Subject Re: Debugging Spark AWS S3
Date Fri, 16 May 2014 22:50:18 GMT
Did you check the executor stderr logs?

On 5/16/14, 2:37 PM, "Robert James" <srobertjames@gmail.com> wrote:

>I have Spark code which runs beautifully when MASTER=local.  When I
>run it with MASTER set to a spark ec2 cluster, the workers seem to
>run, but the results, which are supposed to be put to AWS S3, don't
>appear on S3.  I'm at a loss for how to debug this.  I don't see any
>S3 exceptions anywhere.
>
>Can anyone guide me on how I might debug this?



Mime
View raw message