From user-return-58925-apmail-spark-user-archive=spark.apache.org@spark.apache.org Mon Jul 4 08:57:18 2016 Return-Path: X-Original-To: apmail-spark-user-archive@minotaur.apache.org Delivered-To: apmail-spark-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id C7B9819A75 for ; Mon, 4 Jul 2016 08:57:18 +0000 (UTC) Received: (qmail 37950 invoked by uid 500); 4 Jul 2016 08:57:14 -0000 Delivered-To: apmail-spark-user-archive@spark.apache.org Received: (qmail 37835 invoked by uid 500); 4 Jul 2016 08:57:13 -0000 Mailing-List: contact user-help@spark.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list user@spark.apache.org Received: (qmail 37825 invoked by uid 99); 4 Jul 2016 08:57:13 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 04 Jul 2016 08:57:13 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id 76DA4C0815 for ; Mon, 4 Jul 2016 08:57:13 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 1.448 X-Spam-Level: * X-Spam-Status: No, score=1.448 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, FREEMAIL_ENVFROM_END_DIGIT=0.25, HTML_MESSAGE=2, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H2=-0.001, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd1-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx2-lw-us.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id WPFfNT1Uur1N for ; Mon, 4 Jul 2016 08:57:12 +0000 (UTC) Received: from mail-qk0-f172.google.com (mail-qk0-f172.google.com [209.85.220.172]) by mx2-lw-us.apache.org (ASF Mail Server at mx2-lw-us.apache.org) with ESMTPS id 3258F5F1F6 for ; Mon, 4 Jul 2016 08:57:12 +0000 (UTC) Received: by mail-qk0-f172.google.com with SMTP id u124so35324038qkh.2 for ; Mon, 04 Jul 2016 01:57:12 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=8fNfGGbrWlUbqayI7CV/U9waKw8L+VkPM0d+xFMcc5g=; b=oxJDwABOxctOuUrJTCr3mNFuPrzrSvKbhvg/TtQB7vJ5s7hritZveKc/FMjoBHxcMw YwLtDrehggJME2FCQcWXTgFQPzdzRJ1opE00+uLjK1HtFhzbJMW5VWkZ+rxSfpmA2UYw EIFtgOqLawsgo8+sE6ZkC7OM3Aebqmi/FT9ONYqYkr1ipc6jMH2+sctwk7r/C+R5jE83 n0Nq1gQAg1zYeYSn1CRT0+DdWWrWfGXgWiBhd3Lgqs9bTzVRcY2k4Q8OLE/edlMra6uh K+7Rch4CLRQpzDn9HZYCrGQ9inwewYdgnDpK6LiFnhFOveugcC4+3oe0sTTjyfD/3pNo GGcA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=8fNfGGbrWlUbqayI7CV/U9waKw8L+VkPM0d+xFMcc5g=; b=kq2u/vp1dNMSb7ZP8fnGoj4A+lz28/6bOSUFDVtfpRGzLs0T087M65Eh0Qbc5SZsK+ 6PLKOlxV0IrBBZ3dS7xM7Ba0wA/4M2AU1Q5XL1MaUdYAoVdEc+ZlD3AvB0v7YGngZBSs /KKzI/CkpTJOr+en9iQ1WS4VLikixRvy6iBoFgbMyTEryvCk3Wn4VFTnqpkAvcvC0ccO Zug1PsZR9QnCUrMLH2gQM245Jrcr2EFBZUmTz+995xfqANVbGaYsXxZl6sBMPV1M5cc5 Ifqa+bIRZjdxxOd0hnxVgrRASofs9g54nHnLgse6hOH8UVDV/yTpIysxkSTrpxUSxQWP DxZQ== X-Gm-Message-State: ALyK8tK5yIoo0mbsauwOTmBTV+0e69VM+9ImQPrHbmD+vErLSso5T8OC6jwhZ7Okiilj+d8sOt6HPVprsoZDBQ== X-Received: by 10.55.197.149 with SMTP id k21mr14300638qkl.89.1467622631245; Mon, 04 Jul 2016 01:57:11 -0700 (PDT) MIME-Version: 1.0 Received: by 10.237.57.226 with HTTP; Mon, 4 Jul 2016 01:57:10 -0700 (PDT) In-Reply-To: References: From: kishore kumar Date: Mon, 4 Jul 2016 14:27:10 +0530 Message-ID: Subject: Re: java.io.FileNotFoundException To: Jeff Zhang Cc: "user@spark.apache.org" Content-Type: multipart/alternative; boundary=001a1149dc8e998f790536cb853b --001a1149dc8e998f790536cb853b Content-Type: text/plain; charset=UTF-8 We've upgraded spark version from 1.2 to 1.6 still the same problem, Exception in thread "main" org.apache.spark.SparkException: Job aborted due to stage failure: Task 286 in stage 2397.0 failed 4 times, most recent failure: Lost task 286.3 in stage 2397.0 (TID 314416, salve-06.domain.com): java.io.FileNotFoundException: /opt/mapr/tmp/h adoop-tmp/hadoop-mapr/nm-local-dir/usercache/user1/appcache/application_1467474162580_29353/blockmgr-bd075392-19c2-4cb8-8033-0fe54d683c8f/12/shuffle_530_286_0.inde x.c374502a-4cf2-4052-abcf-42977f1623d0 (No such file or directory) Kindly help me to get rid from this. On Sun, Jun 5, 2016 at 9:43 AM, kishore kumar wrote: > Hi, > > Could anyone help me about this error ? why this error comes ? > > Thanks, > KishoreKuamr. > > On Fri, Jun 3, 2016 at 9:12 PM, kishore kumar > wrote: > >> Hi Jeff Zhang, >> >> Thanks for response, could you explain me why this error occurs ? >> >> On Fri, Jun 3, 2016 at 6:15 PM, Jeff Zhang wrote: >> >>> One quick solution is to use spark 1.6.1. >>> >>> On Fri, Jun 3, 2016 at 8:35 PM, kishore kumar >>> wrote: >>> >>>> Could anyone help me on this issue ? >>>> >>>> On Tue, May 31, 2016 at 8:00 PM, kishore kumar >>>> wrote: >>>> >>>>> Hi, >>>>> >>>>> We installed spark1.2.1 in single node, running a job in yarn-client >>>>> mode on yarn which loads data into hbase and elasticsearch, >>>>> >>>>> the error which we are encountering is >>>>> Exception in thread "main" org.apache.spark.SparkException: Job >>>>> aborted due to stage failure: Task 38 in stage 26800.0 failed 4 times, most >>>>> recent failure: Lost task 38.3 in stage 26800.0 (TID 4990082, >>>>> hdprd-c01-r04-03): java.io.FileNotFoundException: >>>>> /opt/mapr/tmp/hadoop-tmp/hadoop-mapr/nm-local-dir/usercache/sparkuser/appcache/application_1463194314221_211370/spark-3cc37dc7-fa3c-4b98-aa60-0acdfc79c725/28/shuffle_8553_38_0.index >>>>> (No such file or directory) >>>>> >>>>> any idea about this error ? >>>>> -- >>>>> Thanks, >>>>> Kishore. >>>>> >>>> >>>> >>>> >>>> -- >>>> Thanks, >>>> Kishore. >>>> >>> >>> >>> >>> -- >>> Best Regards >>> >>> Jeff Zhang >>> >> >> >> >> -- >> Thanks, >> Kishore. >> > > > > -- > Thanks, > Kishore. > -- Thanks, Kishore. --001a1149dc8e998f790536cb853b Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
We've upgraded spark version from 1.2 to 1.6 still the= same problem,

Exception in thread "main" org.a= pache.spark.SparkException: Job aborted due to stage failure: Task 286 in s= tage
2397.0 failed 4 times, most recent failure: Lost task 286.3 = in stage 2397.0 (TID 314416, salve-0= 6.domain.com): java.io.FileNotFoundException: /opt/mapr/tmp/h
adoop-tmp/hadoop-mapr/nm-local-dir/usercache/user1/appcache/application_14= 67474162580_29353/blockmgr-bd075392-19c2-4cb8-8033-0fe54d683c8f/12/shuffle_= 530_286_0.inde
x.c374502a-4cf2-4052-abcf-42977f1623d0 (No such fi= le or directory)

Kindly help me to get= rid from this.

On Sun, Jun 5, 2016 at 9:43 AM, kishore kumar &= lt;akishore769@g= mail.com> wrote:
Hi,

Could anyone help me about this error ? why= this error comes ?

Thanks,
KishoreKuamr= .

On Fri, Jun 3, 2016 at 9:12 PM, kishore kumar <aki= shore769@gmail.com> wrote:
=
Hi Jeff Zhang,

Thanks for response, cou= ld you explain me why this error occurs ?=C2=A0

On Fri, Jun 3, 2016 at = 6:15 PM, Jeff Zhang <zjffdu@gmail.com> wrote:
One quick solution is to use spark 1.6.= 1.

On Fri, Jun 3, 2016 at 8:35 PM, kishore kumar <akishore769@gmail.com<= /a>> wrote:
Co= uld anyone help me on this issue ?

On Tue, May 31, 2016 at 8:00 PM, kishore k= umar <akishore769@gmail.com> wrote:
Hi,

We installed spark1.= 2.1 in single node, running a job in yarn-client mode on yarn which loads d= ata into hbase and elasticsearch,=C2=A0

the error = which we are encountering is=C2=A0=C2=A0
Exception in th= read "main" org.apache.spark.SparkException: Job aborted due to s= tage failure: Task 38 in stage 26800.0 failed 4 times, most recent failure:= Lost task 38.3 in stage 26800.0 (TID 4990082, hdprd-c01-r04-03): java.io.F= ileNotFoundException: /opt/mapr/tmp/hadoop-tmp/hadoop-mapr/nm-local-dir/use= rcache/sparkuser/appcache/application_1463194314221_211370/spark-3cc37dc7-f= a3c-4b98-aa60-0acdfc79c725/28/shuffle_8553_38_0.index (No such file or dire= ctory)

any idea about this erro= r ?
--
Thanks,
Kishore.



<= font color=3D"#888888">--
Thanks,
Kishore.



<= font color=3D"#888888">--
Best = Regards

Jeff Zhang



<= font color=3D"#888888">--
Thanks,
Kishore.



--
Thanks,
Kishore.


--
Th= anks,
Kishore.
--001a1149dc8e998f790536cb853b--