drill-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Divya Gehlot <divya.htco...@gmail.com>
Subject Re: How to Start Drill Service From Linux Non-root user
Date Fri, 01 Jun 2018 02:02:47 GMT
Then it's not the Drill issue .
If you are using the mapr cluster then MapR File system is MapRFS and if
your workspace is part of MapRFs then you need to use connect :maprfs://
rather than file://
Can you verify ?

On 31 May 2018 at 22:06, Surneni Tilak <surneni.tilak@ericsson.com> wrote:

> I am able to create table in tmp work space.
>
> Best regards,
> _________________________
> Tilak Surneni
>
> -----Original Message-----
> From: Divya Gehlot [mailto:divya.htconex@gmail.com]
> Sent: Thursday, May 31, 2018 3:58 PM
> To: user@drill.apache.org
> Subject: Re: How to Start Drill Service From Linux Non-root user
>
> can you try creating table in tmp workspace ?
>
> On 31 May 2018 at 20:51, Surneni Tilak <surneni.tilak@ericsson.com> wrote:
>
> > Hi Divya,
> >
> > I am getting below error message.
> >
> > org.apache.drill.common.exceptions.UserRemoteException: SYSTEM ERROR:
> > IOException: Mkdirs failed to create /mapr/nscprod01.ericsson.com/
> > NSC-TEST/stk/tpcdsView/web_returns (exists=false,
> > cwd=file:/usr/local/drill/bin)
> >
> >
> > Best regards,
> > _________________________
> > Tilak Surneni
> >
> > -----Original Message-----
> > From: Divya Gehlot [mailto:divya.htconex@gmail.com]
> > Sent: Thursday, May 31, 2018 12:45 PM
> > To: user@drill.apache.org
> > Subject: Re: How to Start Drill Service From Linux Non-root user
> >
> > It worked for me as I am also non root user and login drill through AD .
> > And able to write whereever I would like to on data disk just to need
> > give permission to that directory .
> > It’s sounds strange that it doesn’t work for you .
> >
> > Thanks,
> > Divya
> >
> > On Thu, 31 May 2018 at 6:03 PM, Surneni Tilak
> > <surneni.tilak@ericsson.com>
> > wrote:
> >
> > > Hi Divya,
> > >
> > > I am writing to local file system, So I should use file:/// ; But I
> > > tried the option that you have mentioned it's not working.
> > >
> > >
> > >
> > > Best regards,
> > > _________________________
> > > Tilak Surneni
> > >
> > > -----Original Message-----
> > > From: Divya Gehlot [mailto:divya.htconex@gmail.com]
> > > Sent: Thursday, May 31, 2018 11:15 AM
> > > To: user@drill.apache.org
> > > Subject: Re: How to Start Drill Service From Linux Non-root user
> > >
> > > From the plugin information it looks like you are using mapr cluster .
> > > Can you change below :
> > > "connection": "maprfs:///",
> > >
> > > Everything else looks good.
> > >
> > >
> > > Thanks,
> > > Divya
> > >
> > >
> > > On 31 May 2018 at 16:42, Surneni Tilak <surneni.tilak@ericsson.com>
> > wrote:
> > >
> > > > Hi Sorabh,
> > > >
> > > > Please find the attached storage plugin information. I am changing
> > > > my workspace correctly which I have verified from web UI before
> > > > running my query.
> > > > I am using the workspace tpcdsView as mentioned in the storage
> > > > plugin; where I would like to create the table and the Query user
> > > > has write permissions to this path. Here I am trying to write to
> > > > NFS
> > mount path.
> > > >
> > > > Query that I am running:
> > > >
> > > > create table stk.tpcdsView.`web_returns` as select * from
> > > > stk.`/mapr/
> > > > nscprod01.ericsson.com/NSC-TEST/stk/tpcdsView/web_returns_csv1000`
> > > <http://nscprod01.ericsson.com/NSC-TEST/stk/tpcdsView/web_returns_cs
> > > v1
> > > 000>
> > > > limit 20;
> > > >
> > > > Best regards,
> > > > _________________________
> > > > Tilak Surneni
> > > >
> > > >
> > > > -----Original Message-----
> > > > From: Sorabh Hamirwasia [mailto:shamirwasia@mapr.com]
> > > > Sent: Wednesday, May 30, 2018 10:47 PM
> > > > To: user@drill.apache.org
> > > > Subject: Re: How to Start Drill Service From Linux Non-root user
> > > >
> > > > Hi Surneni,
> > > >
> > > > Can you please share few informations:
> > > >
> > > > 1) Please share the query and filesystem storage plugin
> configuration.
> > > >
> > > > 2) What is your current workspace while executing the query ?
> > > >
> > > >
> > > > Thanks,
> > > > Sorabh
> > > >
> > > > ________________________________
> > > > From: Surneni Tilak <surneni.tilak@ericsson.com>
> > > > Sent: Wednesday, May 30, 2018 2:05:22 AM
> > > > To: user@drill.apache.org
> > > > Subject: RE: How to Start Drill Service From Linux Non-root user
> > > >
> > > > Hi Sorabh,
> > > >
> > > > Thanks for your response. I am asking about running queries as
> > > > Query user and I have enabled user impersonation. But when I am
> > > > trying to create a table from query user in the path where the
> > > > query user has full
> > > permissions
> > > > it's not getting created and facing the below error.   So I would
> like
> > to
> > > > know while creating tables will drill try to create the tables as
> > > > process user or logged in user ?
> > > >
> > > > Error Message While creating Table:
> > > >
> > > > org.apache.drill.common.exceptions.UserRemoteException: SYSTEM
> ERROR:
> > > > IOException: Mkdirs failed to create
> > > > /mapr/my.dev.cluster/data/stk/tpcdsParquet/web_returns
> > > > (exists=false, cwd=file:/usr/local/drill/bin)
> > > >
> > > > When I browsed regarding the above error message I found other
> > > > people got similar kind of error message because of space issue,
> > > > So I tried to write only few records even then same error is
> repeating.
> > Please help.
> > > >
> > > >
> > > >
> > > > Best regards,
> > > > _________________________
> > > > Tilak Surneni
> > > >
> > > >
> > > > -----Original Message-----
> > > > From: Sorabh Hamirwasia [mailto:shamirwasia@mapr.com]
> > > > Sent: Wednesday, May 30, 2018 12:32 AM
> > > > To: user@drill.apache.org
> > > > Subject: Re: How to Start Drill Service From Linux Non-root user
> > > >
> > > > Hi Surneni,
> > > >
> > > > With respect to using the service specific to a particular user
> > > > other than root, do you mean executing queries as a query user
> > > > rather than Drill process user ? If yes then you need to enable
> > > > impersonation for that on Drillbit side [1]. Later when you
> > > > connect using client tool (like sqlline) provide the username with
> > > > which you want Drill to execute query using user (like
> > > > user=testUser) parameter in connection
> > > url.
> > > >
> > > >
> > > > [1]: https://urldefense.proofpoint.com/v2/url?u=https-3A__drill.
> > > > apache.org_docs_configuring-2Duser-2Dimpersonation_&d=DwIFAg&c=
> > > > cskdkSMqhcnjZxdQVpwTXg&r=gRpEl0WzXE3EMrwj0KFbZXGXRyadOt
> > > > hF2jlYxvhTlQg&m=VrfIufa_MkFm_STgyQ6vmPg4Q2t7qg5XJAbl0P81aEc&s=
> > > > TDtmyeNYPwL2neemZUvA5egF9btnkoH5_jJUoqfu7zQ&e=
> > > >
> > > >
> > > >
> > > > Thanks,
> > > > Sorabh
> > > >
> > > > ________________________________
> > > > From: Surneni Tilak <surneni.tilak@ericsson.com>
> > > > Sent: Thursday, May 24, 2018 3:01:02 AM
> > > > To: user@drill.apache.org
> > > > Subject: How to Start Drill Service From Linux Non-root user
> > > >
> > > > Hi Team,
> > > >
> > > > May I know how to start drill service from a user which should not
> > > > be root. What are the privileges that a non-root user should
> > > > fulfill to start drill service. If I start the service as a root
> > > > user then how to use the service specific to a particular user other
> than root.
> > > >
> > > > Best regards,
> > > >
> > > > Tilak
> > > >
> > > >
> > >
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message