From user-return-59731-apmail-spark-user-archive=spark.apache.org@spark.apache.org Wed Jul 20 11:00:39 2016 Return-Path: X-Original-To: apmail-spark-user-archive@minotaur.apache.org Delivered-To: apmail-spark-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 29DA618C90 for ; Wed, 20 Jul 2016 11:00:39 +0000 (UTC) Received: (qmail 81190 invoked by uid 500); 20 Jul 2016 11:00:29 -0000 Delivered-To: apmail-spark-user-archive@spark.apache.org Received: (qmail 81072 invoked by uid 500); 20 Jul 2016 11:00:29 -0000 Mailing-List: contact user-help@spark.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list user@spark.apache.org Received: (qmail 81062 invoked by uid 99); 20 Jul 2016 11:00:29 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd2-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 20 Jul 2016 11:00:29 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd2-us-west.apache.org (ASF Mail Server at spamd2-us-west.apache.org) with ESMTP id C24461A5498 for ; Wed, 20 Jul 2016 11:00:28 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd2-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.492 X-Spam-Level: ** X-Spam-Status: No, score=2.492 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001, URI_HEX=1.313] autolearn=disabled Authentication-Results: spamd2-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd2-us-west.apache.org [10.40.0.9]) (amavisd-new, port 10024) with ESMTP id j1rcEFXYVKLa for ; Wed, 20 Jul 2016 11:00:26 +0000 (UTC) Received: from mail-vk0-f45.google.com (mail-vk0-f45.google.com [209.85.213.45]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTPS id A4CE45FC52 for ; Wed, 20 Jul 2016 11:00:26 +0000 (UTC) Received: by mail-vk0-f45.google.com with SMTP id x130so63903426vkc.0 for ; Wed, 20 Jul 2016 04:00:26 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=41DikvMjt4qaUfu59kK1hgOkKm+vcLtqXDmeuvgTCAw=; b=NN/BMxXNhTlg3RkN4bj5QjDuHG13FNwP/bfLxuYt7iPmC6f0tWdR90SFT3Bfi5PDAq H7zRuMji9uePxDUe4l1m+Nd0tMmKBToiTRhuaGcNvJtpZPDSWMMnGLa8bzUxvxXO9HKz 9zZ4X2lN34+u3WFuj/NU2jj4fc5kw8YBNGPuxgDGMvX2nkjUFBhUGSIBOnWB4xqBzyU/ GMuebEA69c5fDPZotirs/UZcfnSGosRBsyhFudz3gC4ulPXjGOkQztbRxZ9ctzMeLiYz QKuSBeLRE9plwlxk/uCUDU7ytYVttWgx70RJvlCIBnwj9GY2gd6hZcq2GQW0wETd+f09 wKRg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=41DikvMjt4qaUfu59kK1hgOkKm+vcLtqXDmeuvgTCAw=; b=CNQMaeL7Dpgt8V3ZHFs8/HDyie5t1shEWiG0xO+d2puAwP94GzfUNvw7839fnyObxV LOgqqZxyCcBOCZwFRCdlCHUhwzeeyzG8oxZODkb2Qa9vQMfH5nXDGIUn6rTGm7OwmTfs kWLWNQl2NgQf5bNR/E6Jrvt/Hih4UIFUccFhVhfHzNuV8kEDUUv67THo+u3iDus9IYOB /+HDK1BC4BD+sO+PYCP8kpO54qDs9BlUDOIcLM2s1sSraA772wYzbEaMTKVWSWyHdKAg VahQQMmPR0j3wA80+m6lKyzh4v26VUdxgmxnzGGud1lMpKhBoWvaSi2lWmKbYG8tIcHQ dI7w== X-Gm-Message-State: ALyK8tIAH9Qnc/7sBlJXdxkUAvdPMVNGb93Tqv2o0z15LqMs9E6QzYD+Cmx1jJPW5grYaJv7V4UQ/cfmBF5CCw== X-Received: by 10.31.55.75 with SMTP id e72mr22738368vka.109.1469012425674; Wed, 20 Jul 2016 04:00:25 -0700 (PDT) MIME-Version: 1.0 Received: by 10.31.94.72 with HTTP; Wed, 20 Jul 2016 04:00:25 -0700 (PDT) In-Reply-To: <1468996555624-27364.post@n3.nabble.com> References: <1468996555624-27364.post@n3.nabble.com> From: Rabin Banerjee Date: Wed, 20 Jul 2016 16:30:25 +0530 Message-ID: Subject: Re: Running multiple Spark Jobs on Yarn( Client mode) To: vaibhavrtk Cc: user Content-Type: multipart/alternative; boundary=001a11440ca6cd921e05380f1b68 --001a11440ca6cd921e05380f1b68 Content-Type: text/plain; charset=UTF-8 Hi Vaibhav, Please check your yarn configuration and make sure you have available resources .Please try creating multiple queues ,And submit job on queues. --queue thequeue Regards, Rabin Banerjee On Wed, Jul 20, 2016 at 12:05 PM, vaibhavrtk wrote: > I have a silly question: > > Do multiple spark jobs running on yarn have any impact on each other? > e.g. If the traffic on one streaming job increases too much does it have > any > effect on second job? Will it slow it down or any other consequences? > > I have enough resources(memory,cores) for both jobs in the same cluster. > > Thanks > Vaibhav > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/Running-multiple-Spark-Jobs-on-Yarn-Client-mode-tp27364.html > Sent from the Apache Spark User List mailing list archive at Nabble.com. > > --------------------------------------------------------------------- > To unsubscribe e-mail: user-unsubscribe@spark.apache.org > > --001a11440ca6cd921e05380f1b68 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
Hi=C2=A0Vaibhav,=C2=A0Please check your yarn configurat= ion and make sure you have available resources .Please try creating multipl= e queues ,And submit job on queues.
--queue=C2=A0thequeue=C2=A0

Regards,
Rabin Banerjee

On Wed, Jul 20, 2016 at 12:05 = PM, vaibhavrtk <vaibhavrtk@gmail.com> wrote:
I have a silly question:

Do multiple spark jobs running on yarn have any impact on each other?
e.g. If the traffic on one streaming job increases too much does it have an= y
effect on second job? Will it slow it down or any other consequences?

I have enough resources(memory,cores) for both jobs in the same clus= ter.

Thanks
Vaibhav



--
View this message in context: http://apache-spark-user-list.100= 1560.n3.nabble.com/Running-multiple-Spark-Jobs-on-Yarn-Client-mode-tp27364.= html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
---------------------------------------------------------------------
To unsubscribe e-mail: user-unsubscribe@spark.apache.org


--001a11440ca6cd921e05380f1b68--