From user-return-10209-apmail-drill-user-archive=drill.apache.org@drill.apache.org Wed Mar 13 06:03:52 2019 Return-Path: X-Original-To: apmail-drill-user-archive@www.apache.org Delivered-To: apmail-drill-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id F0FD618A1B for ; Wed, 13 Mar 2019 06:03:52 +0000 (UTC) Received: (qmail 8005 invoked by uid 500); 13 Mar 2019 06:03:52 -0000 Delivered-To: apmail-drill-user-archive@drill.apache.org Received: (qmail 7927 invoked by uid 500); 13 Mar 2019 06:03:52 -0000 Mailing-List: contact user-help@drill.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@drill.apache.org Delivered-To: mailing list user@drill.apache.org Received: (qmail 7909 invoked by uid 99); 13 Mar 2019 06:03:51 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Wed, 13 Mar 2019 06:03:51 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id 295A2C9673 for ; Wed, 13 Mar 2019 06:03:51 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 2.048 X-Spam-Level: ** X-Spam-Status: No, score=2.048 tagged_above=-999 required=6.31 tests=[DKIMWL_WL_MED=-0.001, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_ENVFROM_END_DIGIT=0.25, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd1-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=yahoo.com Received: from mx1-lw-us.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id AApDD5err1I6 for ; Wed, 13 Mar 2019 06:03:49 +0000 (UTC) Received: from sonic304-20.consmr.mail.ne1.yahoo.com (sonic304-20.consmr.mail.ne1.yahoo.com [66.163.191.146]) by mx1-lw-us.apache.org (ASF Mail Server at mx1-lw-us.apache.org) with ESMTPS id 19F3E5F19A for ; Wed, 13 Mar 2019 06:03:43 +0000 (UTC) X-YMail-OSG: y6ROl1oVM1l_W.vzBtmHncrv7QtRsyd1DjwnfJ_433agwxNRCtkqz3v0mjMDmUS JZRiAjBSsG3Ha19aP9Fl.X70dFDYnzILuDEjqT05jwezyOECQitUZm59eGX.q4QrRtjpQ8BlBHIo k5RfG1QZT1PUHEWH3AmKs0Fmg08oJ8G5GqzoMajHCMj6GwgmqYmifbKeoYti5A2otjLRUnfOyIvT mz4wVGJUXqoMOdJIcDNDB1e_Sd.8YpjUPIA5LFeWNFNhUvqwaLRFamqQd83u.rGTdNO_Npnd9Dgf fm8WU4I66lB8mAhyWDri6yg7VF3hkkPOVZdT.iSmKNrRWmS1FR7BipXDQYwYcEGB4aqx7BrnNqp5 PKiK2OkMAOwcxin9yperzTA.bIZppCCW8alLtdc3I0QFW2nd3byu.i.19DRl9TIsWxlEJf0biY0Q ktFjgv.Z6l9GE3j2qGbi0sXAoTVkyLijUx03kGdO8Z73oysAu3MP3fm7c7F64Y40h2voleGmpS43 DfeFvmApo5qsxmFfuXi40lEKvbuyw.aX5eHB5rbNCLSSbzb_4t7kGRjvM5_L3wjxOP2cWIHDC6Ep gQZtcfQkrXkHBygODIgA26jqUL93JRf2Zmuhfjv7ipA9yEHVkEsOT_KIadKJLQ2p_dxVGo7sucb_ G5DPygt299P.qb9YWuy9l3b__DqjOriuuB.J5BPhIN3hlW8phejsftGbJPuK8ENSHSH54sjgd6ug .BmZWNceWs9gFS7JsWVefmQptl4bhtvmhRAPVdIwH0uy8oHZH9HBUkw7sNoIOxet02T2WrAS2Thl 2EIVXhzH7r7y9zFAoDoUOWbwDax9nXDWoAnYPeZ6_FKjG_Fjcb8GB_rOGiKaSYSe7otRT_MnX0I2 v7c9PrwSYUtk_adzeb5v73GfOvNrsERBQ3vBaVWtoZtxNYxH2w6tgHuBdw_P0xH44BScMZH4uw8i _CTG3r8W55HrPO_JAmJQXWu1QoU2ZaQb8v8EsGBan8i4HCGPdBtD56Rxa7U6rD2e9xRhYuxwEdTu c2B6RGQcqjF_xuodd1grV7ecELzOGAgMroLjbNN5PJLS2bQN58RXUnVwg7IvzFloBTeloNqMhKW0 Q1gZc1iwR8cL2zDRjZtV2feKSK17UakIrtYsZnj_z2cfhfmcAFzqYVfbPUz_ubFIfi9vkZ.o5sNR n1gTr.ot6M.Jw85tiQh4- Received: from sonic.gate.mail.ne1.yahoo.com by sonic304.consmr.mail.ne1.yahoo.com with HTTP; Wed, 13 Mar 2019 06:03:42 +0000 Date: Wed, 13 Mar 2019 06:03:25 +0000 (UTC) From: Paul Rogers To: user@drill.apache.org Message-ID: <969772680.4657731.1552457005407@mail.yahoo.com> In-Reply-To: References: <7ccf3433-4603-4fe8-a947-1558f925b110@getmailbird.com> Subject: Re: Update planner/configuration keys MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="----=_Part_4657729_52682172.1552457005405" X-Mailer: WebService/1.1.13212 YMailNorrin Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_2) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/12.0.2 Safari/605.1.15 ------=_Part_4657729_52682172.1552457005405 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Hi Kunal and Praveen, ALTER SYSTEM sets an option value persistently in Zookeeper, which makes th= e value permanent within that one cluster. Sounds like you want to persist values in an embedded Drillbit. In this cas= e, there is no Zookeeper. System options get written to the file system, bu= t I don't know if they are persistent. Any embedded Drill users know how th= is works? One solution is to start Drill as a server, even if it runs on only one nod= e. I don't know, however, if the Drill server mode is supported on Windows.= Any Windows users know this? Finally, Kunal is correct. Since about a 18 months ago, the value for syste= m/session options are defined in Drill's config system. See [1]. Although Drill does not encourage this usage, you can customize these value= s in your drill-override.conf as Kunal suggests. You can try this as a work= around for the fact that you are 1) using Embedded Drill, 2) on Windows. But, Drill is really a distributed tool, so you'd really want to run Drill = on Linux as a server, then allow the options to persist in Zookeeper. Thanks, - Paul [1]=C2=A0https://github.com/apache/drill/blob/master/exec/java-exec/src/mai= n/resources/drill-module.conf#L454 =20 On Tuesday, March 12, 2019, 11:31:59 AM PDT, Kunal Khatua wrote: =20 =20 That is correct... you'll need to run these on the command prompt for the very first time. Like profiles, I believe, the ALTER SYSTEM commands also have a permanent effect. I'm not sure if there is a way for a user to provide a pre-configured set of parameters to use during startup. You could see if setting these values in DRILL_HOME/conf/drill-override.conf helps. A lot of the values you want are originally set as defaults from an embedded file "drill-module.conf" , and drill-override.conf , well... overrides some of those values. If this doesn't work, you can file an improvement/newFeature JIRA for this, considering this is a nice feature to have. ~ Kunal On Tue, Mar 12, 2019 at 3:18 AM PRAVEEN DEVERACHETTY wrote: > Hi Kunal, But where should i keep those statements? is there any drill > startup script that i can run these alter staements? i think these script= s > only on the drill command prompt right? > > Thanks, > Praveen > > On Tue, Mar 12, 2019 at 1:02 PM Kunal Khatua wrote: > > > Executing an "alter system set param=3Dvalue" usually persists the valu= e. > > Not sure if that works for an embedded mode. > > Could you try and let us know if that works? > > On 3/11/2019 11:19:13 AM, PRAVEEN DEVERACHETTY > > wrote: > > I am using apache drill on windows platform. My requirement is to udpat= e > > the following parameters during apache drill startup. These parameter > > vaules may differ in each apache drill nodes. can you share me an examp= le > > of how to update these in windows. I know another option is to run on > webUI > > or postman? i dont want to do it post installation of apache drill. i > want > > these changes to be reflected during apache drill startup. > > > > *planner.cpu_load_average - 0.7* > > *exec.queue.enable - true* > > *exec.queue.large - 2* > > *exec.queue.memory_ratio - 10.0* > > *exec.queue.memory_reserve_ratio - 0.2* > > *exec.queue.small - 4* > > > > Thanks, > > praveen > > > =20 ------=_Part_4657729_52682172.1552457005405--