drill-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Charles Givre <cgi...@gmail.com>
Subject Re: S3 Connection Issues
Date Thu, 19 Oct 2017 04:18:25 GMT
Hi Padma, 
The bucket is is us-west-2.  I also discovered that some of the variable names in the documentation
on the main Drill site are incorrect.  Do I need to specify the region in the configuration
somewhere?  

As an update, after discovering that the variable names are incorrect and that I didn’t
have Jets3t installed properly, I’m now getting the following error:

jdbc:drill:zk=local> show databases;
Error: RESOURCE ERROR: Failed to create schema tree.


[Error Id: e6012aa2-c775-46b9-b3ee-0af7d0b0871d on charless-mbp-2.fios-router.home:31010]

  (org.apache.hadoop.fs.s3.S3Exception) org.jets3t.service.S3ServiceException: Service Error
Message. -- ResponseCode: 403, ResponseStatus: Forbidden, XML Error Message: <?xml version="1.0"
encoding="UTF-8"?><Error><Code>SignatureDoesNotMatch</Code><Message>The
request signature we calculated does not match the signature you provided. Check your key
and signing method.</Message></Error>
    org.apache.hadoop.fs.s3.Jets3tFileSystemStore.get():175
    org.apache.hadoop.fs.s3.Jets3tFileSystemStore.retrieveINode():221

Thanks, 
— C


> On Oct 19, 2017, at 00:14, Padma Penumarthy <ppenumarthy@mapr.com> wrote:
> 
> Which AWS region are you trying to connect to ? 
> We have a  problem connecting to regions which support only v4 signature
> since the version of hadoop we include in Drill is old. 
> Last time I tried, using Hadoop 2.8.1 worked for me.
> 
> Thanks
> Padma
> 
> 
>> On Oct 18, 2017, at 8:14 PM, Charles Givre <cgivre@gmail.com> wrote:
>> 
>> Hello all, 
>> I’m trying to use Drill to query data in an S3 bucket and running into some issues
which I can’t seem to fix.  I followed the various instructions online to set up Drill with
S3, and put my keys in both the conf-site.xml and in the plugin config, but every time I attempt
to do anything I get the following errors:
>> 
>> 
>> jdbc:drill:zk=local> show databases;
>> Error: SYSTEM ERROR: AmazonS3Exception: Status Code: 403, AWS Service: Amazon S3,
AWS Request ID: 56D1999BD1E62DEB, AWS Error Code: null, AWS Error Message: Forbidden
>> 
>> 
>> [Error Id: 65d0bb52-a923-4e98-8ab1-65678169140e on charless-mbp-2.fios-router.home:31010]
(state=,code=0)
>> 0: jdbc:drill:zk=local> show databases;
>> Error: SYSTEM ERROR: AmazonS3Exception: Status Code: 403, AWS Service: Amazon S3,
AWS Request ID: 4D2CBA8D42A9ECA0, AWS Error Code: null, AWS Error Message: Forbidden
>> 
>> 
>> [Error Id: 25a2d008-2f4d-4433-a809-b91ae063e61a on charless-mbp-2.fios-router.home:31010]
(state=,code=0)
>> 0: jdbc:drill:zk=local> show files in s3.root;
>> Error: SYSTEM ERROR: AmazonS3Exception: Status Code: 403, AWS Service: Amazon S3,
AWS Request ID: 2C635944EDE591F0, AWS Error Code: null, AWS Error Message: Forbidden
>> 
>> 
>> [Error Id: 02e136f5-68c0-4b47-9175-a9935bda5e1c on charless-mbp-2.fios-router.home:31010]
(state=,code=0)
>> 0: jdbc:drill:zk=local> show schemas;
>> Error: SYSTEM ERROR: AmazonS3Exception: Status Code: 403, AWS Service: Amazon S3,
AWS Request ID: 646EB5B2EBCF7CD2, AWS Error Code: null, AWS Error Message: Forbidden
>> 
>> 
>> [Error Id: 954aaffe-616a-4f40-9ba5-d4b7c04fe238 on charless-mbp-2.fios-router.home:31010]
(state=,code=0)
>> 
>> I have verified that the keys are correct but using the AWS CLI and downloaded some
of the files, but I’m kind of at a loss as to how to debug.  Any suggestions?
>> Thanks in advance,
>> — C
> 


Mime
View raw message