spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Aniket Bhatnagar <aniket.bhatna...@gmail.com>
Subject Re: [Stream] Checkpointing | chmod: cannot access `/cygdrive/d/tmp/spark/f8e594bf-d940-41cb-ab0e-0fd3710696cb/rdd-57/.part-00001-attempt-215': No such file or directory
Date Mon, 01 Sep 2014 06:37:40 GMT
Hi everyone

It turns out that  I had chef installed and it's chmod has higher
preference than cygwin's chmod in the PATH. I fixed the environment
variable and now its working fine.


On 1 September 2014 11:48, Aniket Bhatnagar <aniket.bhatnagar@gmail.com>
wrote:

> On my local (windows) dev environment, I have been trying to get spark
> streaming running to test my real time(ish) jobs. I have set the checkpoint
> directory as /tmp/spark and have installed latest cygwin. I keep getting
> the following error:
>
> org.apache.hadoop.util.Shell$ExitCodeException: chmod: cannot access
> `/cygdrive/d/tmp/spark/f8e594bf-d940-41cb-ab0e-0fd3710696cb/rdd-57/.part-00001-attempt-215':
> No such file or directory
>
>
> Although nothing breaks but such errors are a bit annoying. Any clues on
> how to fix the issue?
>

Mime
View raw message