spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Jacek Laskowski <ja...@japila.pl>
Subject Re: java.io.FileNotFoundException
Date Mon, 04 Jul 2016 09:50:59 GMT
Hi,

You seem to be using yarn. Is this cluster or client deploy mode? Have
you seen any other exceptions before? How long did the application run
before the exception?

Pozdrawiam,
Jacek Laskowski
----
https://medium.com/@jaceklaskowski/
Mastering Apache Spark http://bit.ly/mastering-apache-spark
Follow me at https://twitter.com/jaceklaskowski


On Mon, Jul 4, 2016 at 10:57 AM, kishore kumar <akishore769@gmail.com> wrote:
> We've upgraded spark version from 1.2 to 1.6 still the same problem,
>
> Exception in thread "main" org.apache.spark.SparkException: Job aborted due
> to stage failure: Task 286 in stage
> 2397.0 failed 4 times, most recent failure: Lost task 286.3 in stage 2397.0
> (TID 314416, salve-06.domain.com): java.io.FileNotFoundException:
> /opt/mapr/tmp/h
> adoop-tmp/hadoop-mapr/nm-local-dir/usercache/user1/appcache/application_1467474162580_29353/blockmgr-bd075392-19c2-4cb8-8033-0fe54d683c8f/12/shuffle_530_286_0.inde
> x.c374502a-4cf2-4052-abcf-42977f1623d0 (No such file or directory)
>
> Kindly help me to get rid from this.
>
> On Sun, Jun 5, 2016 at 9:43 AM, kishore kumar <akishore769@gmail.com> wrote:
>>
>> Hi,
>>
>> Could anyone help me about this error ? why this error comes ?
>>
>> Thanks,
>> KishoreKuamr.
>>
>> On Fri, Jun 3, 2016 at 9:12 PM, kishore kumar <akishore769@gmail.com>
>> wrote:
>>>
>>> Hi Jeff Zhang,
>>>
>>> Thanks for response, could you explain me why this error occurs ?
>>>
>>> On Fri, Jun 3, 2016 at 6:15 PM, Jeff Zhang <zjffdu@gmail.com> wrote:
>>>>
>>>> One quick solution is to use spark 1.6.1.
>>>>
>>>> On Fri, Jun 3, 2016 at 8:35 PM, kishore kumar <akishore769@gmail.com>
>>>> wrote:
>>>>>
>>>>> Could anyone help me on this issue ?
>>>>>
>>>>> On Tue, May 31, 2016 at 8:00 PM, kishore kumar <akishore769@gmail.com>
>>>>> wrote:
>>>>>>
>>>>>> Hi,
>>>>>>
>>>>>> We installed spark1.2.1 in single node, running a job in yarn-client
>>>>>> mode on yarn which loads data into hbase and elasticsearch,
>>>>>>
>>>>>> the error which we are encountering is
>>>>>> Exception in thread "main" org.apache.spark.SparkException: Job
>>>>>> aborted due to stage failure: Task 38 in stage 26800.0 failed 4 times,
most
>>>>>> recent failure: Lost task 38.3 in stage 26800.0 (TID 4990082,
>>>>>> hdprd-c01-r04-03): java.io.FileNotFoundException:
>>>>>> /opt/mapr/tmp/hadoop-tmp/hadoop-mapr/nm-local-dir/usercache/sparkuser/appcache/application_1463194314221_211370/spark-3cc37dc7-fa3c-4b98-aa60-0acdfc79c725/28/shuffle_8553_38_0.index
>>>>>> (No such file or directory)
>>>>>>
>>>>>> any idea about this error ?
>>>>>> --
>>>>>> Thanks,
>>>>>> Kishore.
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> Thanks,
>>>>> Kishore.
>>>>
>>>>
>>>>
>>>>
>>>> --
>>>> Best Regards
>>>>
>>>> Jeff Zhang
>>>
>>>
>>>
>>>
>>> --
>>> Thanks,
>>> Kishore.
>>
>>
>>
>>
>> --
>> Thanks,
>> Kishore.
>
>
>
>
> --
> Thanks,
> Kishore.

---------------------------------------------------------------------
To unsubscribe e-mail: user-unsubscribe@spark.apache.org


Mime
View raw message