From yarn-dev-return-1036-apmail-hadoop-yarn-dev-archive=hadoop.apache.org@hadoop.apache.org Thu Feb 28 09:58:18 2013 Return-Path: X-Original-To: apmail-hadoop-yarn-dev-archive@minotaur.apache.org Delivered-To: apmail-hadoop-yarn-dev-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id D8400E636 for ; Thu, 28 Feb 2013 09:58:18 +0000 (UTC) Received: (qmail 95296 invoked by uid 500); 28 Feb 2013 09:58:18 -0000 Delivered-To: apmail-hadoop-yarn-dev-archive@hadoop.apache.org Received: (qmail 95042 invoked by uid 500); 28 Feb 2013 09:58:17 -0000 Mailing-List: contact yarn-dev-help@hadoop.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: yarn-dev@hadoop.apache.org Delivered-To: mailing list yarn-dev@hadoop.apache.org Received: (qmail 95004 invoked by uid 99); 28 Feb 2013 09:58:16 -0000 Received: from nike.apache.org (HELO nike.apache.org) (192.87.106.230) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 28 Feb 2013 09:58:16 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of sandy.ryza@cloudera.com designates 74.125.83.48 as permitted sender) Received: from [74.125.83.48] (HELO mail-ee0-f48.google.com) (74.125.83.48) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 28 Feb 2013 09:58:10 +0000 Received: by mail-ee0-f48.google.com with SMTP id t10so1309826eei.35 for ; Thu, 28 Feb 2013 01:57:50 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=mime-version:x-received:in-reply-to:references:date:message-id :subject:from:to:content-type:x-gm-message-state; bh=tNpH00ToIyV5IMLcgHMF6UAJoWa2d6s5lP1BRodCigw=; b=QTXOSaLH1Iqf5QLiU1fj3Js+4zeGnj2jZVYcVqXj8+9guqHeyD3l0r7+2q7WG4GMUA 96BmhAdY53ulal+HvnIyHqBJ4jFRApzu+89RxaYDlV0bfykjVOvaluo4c7oOzY59/NQ/ O+84x2NiiUlRrjbeWzIE4/0zMIuvEXCXhUfyccP+NYUhCplG+k4BieBce+szWJ/gI4V7 5yk1vx9ww2kR2VXhvILE7OcNAUOaRGS1EPjGNVowISqQcrg5/HV6JClEHtQBH+1+fmUm TAmuB278r4ljtPRRbMs3i1Q5uY9t5vHVCdrPgPx99EaJU87oW7JcvgQiCcHJgRD9Q+IA S+vQ== MIME-Version: 1.0 X-Received: by 10.14.216.198 with SMTP id g46mr15194594eep.30.1362045469884; Thu, 28 Feb 2013 01:57:49 -0800 (PST) Received: by 10.14.101.135 with HTTP; Thu, 28 Feb 2013 01:57:49 -0800 (PST) In-Reply-To: References: <0CFEE3DA-DD6D-47C5-8ECE-916FF26A7371@hortonworks.com> Date: Thu, 28 Feb 2013 01:57:49 -0800 Message-ID: Subject: Re: DistributedShell and YARN application not finishing From: Sandy Ryza To: yarn-dev@hadoop.apache.org Content-Type: multipart/alternative; boundary=047d7b603c1c66bd3904d6c5ec94 X-Gm-Message-State: ALoCoQnVeS4DDtkTGHYRbsGBY3ibxzLnifGMMKu1DKIW1VsDIuYYvubPOlU5qSkfOgdph/3bsRUy X-Virus-Checked: Checked by ClamAV on apache.org --047d7b603c1c66bd3904d6c5ec94 Content-Type: text/plain; charset=ISO-8859-1 Out of curiosity - what was it before? -Sandy On Thu, Feb 28, 2013 at 1:31 AM, Kapoor wrote: > It worked now. > > The changes I did was, increased the value to 8 GB > > > yarn.nodemanager.resource.memory-mb > 8192 > the amount of memory on the NodeManager in > GB > > > > On Thu, Feb 28, 2013 at 10:08 AM, Kapoor wrote: > > > Please find the link attached with this email. > > > > Link for screenshot : > > http://picpaste.com/Screenshot_from_2013-02-28_10_03_05-9H0PfXWs.png > > > > Though I am also looking into this(code debug) and found out that > > Application master is never called by RM for the respective jobs. > > > > Since I am relatively new, it would kind of you, if you suggest am I > > missing something in configuration wise. > > > > > > > > > > > > On Thu, Feb 28, 2013 at 4:51 AM, Vinod Kumar Vavilapalli < > > vinodkv@hortonworks.com> wrote: > > > >> > >> Attachments won't go through, please host it somewhere and post a link. > >> > >> Does the total memory on RM webui show a non-zero number? > >> > >> Thanks, > >> +Vinod > >> > >> On Feb 27, 2013, at 2:29 AM, Kapoor wrote: > >> > >> > Hi, > >> > > >> > I am trying to run the DistributedShell exmaple on my hadoop with YARN > >> > > >> > Below are the details: > >> > > >> > Command used > >> > > >> > ./hadoop org.apache.hadoop.yarn.applications.distributedshell.Client > >> -jar > >> > /home/impadmin/opensource/hadoop-common/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/target/hadoop-yarn-applications-distributedshell-3.0.0-SNAPSHOT.jar > >> -shell_command ls --num_containers 5 --debug > >> > > >> > I can see the application is submitted successfully but the final > >> status is UNDEFINED also application is not get into finished state. > >> > > >> > Screenshot attached > >> > > >> > Please assist > >> > >> > > > --047d7b603c1c66bd3904d6c5ec94--