From user-return-61880-apmail-spark-user-archive=spark.apache.org@spark.apache.org Fri Aug 26 16:48:07 2016 Return-Path: X-Original-To: apmail-spark-user-archive@minotaur.apache.org Delivered-To: apmail-spark-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 994EC19F44 for ; Fri, 26 Aug 2016 16:48:07 +0000 (UTC) Received: (qmail 76512 invoked by uid 500); 26 Aug 2016 16:48:03 -0000 Delivered-To: apmail-spark-user-archive@spark.apache.org Received: (qmail 76395 invoked by uid 500); 26 Aug 2016 16:48:02 -0000 Mailing-List: contact user-help@spark.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list user@spark.apache.org Received: (qmail 76385 invoked by uid 99); 26 Aug 2016 16:48:02 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd4-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 26 Aug 2016 16:48:02 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd4-us-west.apache.org (ASF Mail Server at spamd4-us-west.apache.org) with ESMTP id 5D5F3C09ED for ; Fri, 26 Aug 2016 16:48:02 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd4-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.494 X-Spam-Level: ** X-Spam-Status: No, score=2.494 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, HTML_MESSAGE=2, NORMAL_HTTP_TO_IP=0.001, NUMERIC_HTTP_ADDR=0.001, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, SPF_PASS=-0.001, URI_HEX=1.313] autolearn=disabled Authentication-Results: spamd4-us-west.apache.org (amavisd-new); dkim=pass (1024-bit key) header.d=mesosphere.io Received: from mx2-lw-us.apache.org ([10.40.0.8]) by localhost (spamd4-us-west.apache.org [10.40.0.11]) (amavisd-new, port 10024) with ESMTP id 08FCdEIfAtZb for ; Fri, 26 Aug 2016 16:48:00 +0000 (UTC) Received: from mail-qk0-f197.google.com (mail-qk0-f197.google.com [209.85.220.197]) by mx2-lw-us.apache.org (ASF Mail Server at mx2-lw-us.apache.org) with ESMTPS id 3F6285F2F0 for ; Fri, 26 Aug 2016 16:48:00 +0000 (UTC) Received: by mail-qk0-f197.google.com with SMTP id m184so169878522qkb.2 for ; Fri, 26 Aug 2016 09:48:00 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=mesosphere.io; s=google; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=ZuT+hOQmUJp3AFjlPxJKLzGlrE9PZ9YRMy3aPOXGbTI=; b=TNoHpxe41rVD7A8HiPCuDvfTBF10Lsn2jheBrHZl/m4yFWU8gSwyuAwUxReYrzOfT1 kGGg7o3aDPRtmOqJpd42D9StKCWBZboN+k1KGEZF7kCV6YZde86jongYuUSZ0C63f7Fz qmwEwrNMsGkcAscHMgUcGksQ1XopijfCjXcuc= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=ZuT+hOQmUJp3AFjlPxJKLzGlrE9PZ9YRMy3aPOXGbTI=; b=FvZehJ2YTUn/0DjtnujFMJj9T0OVBOBtgPSsPk4S71Tw5fwIKE1EGnHWYczI7X4zhe jUPX5a+Ed5ij10WGl6OvLtrNQwDb0HXO6p5jQhk1uEDVVaipda/8I17+8Dm21aiAeL0y R/t6WedYdPo8T2XvNhJRMnNowwUpdsdTjsDUHIUr+4txve9o5UTp8lmm8UgJEZb7hsYH J/6TGSeNlEFDhJZ4CY22prFNJNMbv2kT/eaM+9Nv4W1fLIiaWWSeYmwZXvUpBdEaNXC9 Cv/xLtF9rLC6v/xAQb5D5vIks2Rnc/rxYGA49+Ib+6uw5E7w+eiv+r7WtchwzL4JWI7K v9zw== X-Gm-Message-State: AE9vXwNXeLZSS57L8wa+6/0LjUkKbifWjRRd7C4eZf7VGdY2Q6e7fsKl9y8xIlWPbw5SCNJEepnIkddnV/SuDo8j X-Received: by 10.176.6.201 with SMTP id g67mr2442295uag.128.1472230079852; Fri, 26 Aug 2016 09:47:59 -0700 (PDT) MIME-Version: 1.0 Received: by 10.103.30.193 with HTTP; Fri, 26 Aug 2016 09:47:59 -0700 (PDT) In-Reply-To: <1472225490527-27607.post@n3.nabble.com> References: <1472225490527-27607.post@n3.nabble.com> From: Michael Gummelt Date: Fri, 26 Aug 2016 09:47:59 -0700 Message-ID: Subject: Re: zookeeper mesos logging in spark To: aecc Cc: user Content-Type: multipart/alternative; boundary=94eb2c124006f00a97053afc46a5 --94eb2c124006f00a97053afc46a5 Content-Type: text/plain; charset=UTF-8 These are the libmesos logs. Maybe look here http://mesos.apache.org/documentation/latest/logging/ On Fri, Aug 26, 2016 at 8:31 AM, aecc wrote: > Hi, > > Everytime I run my spark application using mesos, I get logs in my console > in the form: > > 2016-08-26 15:25:30,949:960521(0x7f6bccff9700):ZOO_INFO@log_env > 2016-08-26 15:25:30,949:960521(0x7f6bccff9700):ZOO_INFO@log_env > 2016-08-26 15:25:30,949:960521(0x7f6bccff9700):ZOO_INFO@log_env > 2016-08-26 15:25:30,949:960521(0x7f6bccff9700):ZOO_INFO@log_env > 2016-08-26 15:25:30,949:960521(0x7f6bccff9700):ZOO_INFO@log_env > I0826 15:25:30.949254 960752 sched.cpp:222] Version: 0.28.2 > 2016-08-26 15:25:30,949:960521(0x7f6bccff9700):ZOO_INFO@log_env > 2016-08-26 15:25:30,949:960521(0x7f6bccff9700):ZOO_INFO@log_env > 2016-08-26 15:25:30,949:960521(0x7f6bccff9700):ZOO_INFO@log_env > 2016-08-26 15:25:30,949:960521(0x7f6bccff9700):ZOO_INFO@zookeep > 2016-08-26 15:25:30,951:960521(0x7f6bb4ff9700):ZOO_INFO@check_e > 2016-08-26 15:25:30,952:960521(0x7f6bb4ff9700):ZOO_INFO@check_e > I0826 15:25:30.952505 960729 group.cpp:349] Group process (grou > I0826 15:25:30.952570 960729 group.cpp:831] Syncing group opera > I0826 15:25:30.952592 960729 group.cpp:427] Trying to create pa > I0826 15:25:30.954211 960722 detector.cpp:152] Detected a new l > I0826 15:25:30.954320 960744 group.cpp:700] Trying to get '/mes > I0826 15:25:30.955345 960724 detector.cpp:479] A new leading ma > I0826 15:25:30.955451 960724 sched.cpp:326] New master detected > I0826 15:25:30.955567 960724 sched.cpp:336] No credentials prov > I0826 15:25:30.956478 960732 sched.cpp:703] Framework registere > > Anybody know how to disable them through spark-submit ? > > Cheers and many thanks > > > > -- > View this message in context: http://apache-spark-user-list. > 1001560.n3.nabble.com/zookeeper-mesos-logging-in-spark-tp27607.html > Sent from the Apache Spark User List mailing list archive at Nabble.com. > > --------------------------------------------------------------------- > To unsubscribe e-mail: user-unsubscribe@spark.apache.org > > -- Michael Gummelt Software Engineer Mesosphere --94eb2c124006f00a97053afc46a5 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
These are the libmesos logs.=C2=A0 Maybe look here http://mesos.apa= che.org/documentation/latest/logging/

On Fri, Aug 26, 2016 at 8:31 AM, aecc <alessandroaecc@gmail.com> wrote:
Hi,

Everytime I run my spark application using mesos, I get logs in my console<= br> in the form:

2016-08-26 15:25:30,949:960521(0x7f6bccff9700):ZOO_INFO@log_env 2016-08-26 15:25:30,949:960521(0x7f6bccff9700):ZOO_INFO@log_env 2016-08-26 15:25:30,949:960521(0x7f6bccff9700):ZOO_INFO@log_env 2016-08-26 15:25:30,949:960521(0x7f6bccff9700):ZOO_INFO@log_env 2016-08-26 15:25:30,949:960521(0x7f6bccff9700):ZOO_INFO@log_env I0826 15:25:30.949254 960752 sched.cpp:222] Version: 0.28.2
2016-08-26 15:25:30,949:960521(0x7f6bccff9700):ZOO_INFO@log_env 2016-08-26 15:25:30,949:960521(0x7f6bccff9700):ZOO_INFO@log_env 2016-08-26 15:25:30,949:960521(0x7f6bccff9700):ZOO_INFO@log_env 2016-08-26 15:25:30,949:960521(0x7f6bccff9700):ZOO_INFO@zookeep 2016-08-26 15:25:30,951:960521(0x7f6bb4ff9700):ZOO_INFO@check_e 2016-08-26 15:25:30,952:960521(0x7f6bb4ff9700):ZOO_INFO@check_e I0826 15:25:30.952505 960729 group.cpp:349] Group process (grou
I0826 15:25:30.952570 960729 group.cpp:831] Syncing group opera
I0826 15:25:30.952592 960729 group.cpp:427] Trying to create pa
I0826 15:25:30.954211 960722 detector.cpp:152] Detected a new l
I0826 15:25:30.954320 960744 group.cpp:700] Trying to get '/mes
I0826 15:25:30.955345 960724 detector.cpp:479] A new leading ma
I0826 15:25:30.955451 960724 sched.cpp:326] New master detected
I0826 15:25:30.955567 960724 sched.cpp:336] No credentials prov
I0826 15:25:30.956478 960732 sched.cpp:703] Framework registere

Anybody know how to disable them through spark-submit ?

Cheers and many thanks



--
View this message in context: http://apache-spark-user-list.1001560.n3.na= bble.com/zookeeper-mesos-logging-in-spark-tp27607.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
-----------------------------------------------------------------= ----
To unsubscribe e-mail: user-unsubscribe@spark.apache.org




--
Michael Gummelt
Software Engineer
Mesosphere
--94eb2c124006f00a97053afc46a5--