drill-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Daniil Osipov <daniil.osi...@shazam.com>
Subject Re: S3 Access errors
Date Mon, 02 Mar 2015 18:59:44 GMT
Thanks Sudhakar, I'll give this a try. Can you point me to some
documentation about extension/type handling? The actual files I'm trying to
query are compressed JSON, and have an extension .gz


On Mon, Mar 2, 2015 at 10:49 AM, Sudhakar Thota <sthota@maprtech.com> wrote:

> Daniil,
>
> Please try doing these 2 things and check one more time again.
>
> 1. Name that file to clean.json.
> 2. Issue this statement before you run your query.
>
> alter system set `store.json.all_text_mode` = true
>
>
> Thanks
> Sudhakar Thota
> sthota@maprtech.com
> www.mapr.com
> Now Available - Free Hadoop On-Demand Training
>
> On Mar 2, 2015, at 10:03 AM, Daniil Osipov <daniil.osipov@shazam.com>
> wrote:
>
> > I'm continuing exploration of accessing files on S3, and running into
> this
> > issue:
> > 0: jdbc:drill:> *SELECT COUNT(1) FROM
> > s3n.root.`/dev/dan/cleaned_1210/clean.txt`;*
> > *Query failed: Query failed: Failure validating SQL.
> > org.eigenbase.util.EigenbaseContextException: From line 1, column 22 to
> > line 1, column 24: Table 's3n.root./dev/dan/cleaned_1210/clean.txt' not
> > found*
> >
> > *Error: exception while executing query: Failure while executing query.
> > (state=,code=0)*
> >
> > At the same time:
> > 0: jdbc:drill:> *show files from s3n.`dev/dan/cleaned_1210/clean.txt`;*
> >
> *+------------+-------------+------------+------------+------------+------------+-------------+------------+------------------+*
> > *|    name    | isDirectory |   isFile   |   length   |   owner    |
> > group    | permissions | accessTime | modificationTime |*
> >
> *+------------+-------------+------------+------------+------------+------------+-------------+------------+------------------+*
> > *| clean.txt  | false       | true       | 1313500    |            |
> >     | rw-rw-rw-   | 1970-01-01 00:00:00.0 | 2014-12-10 23:51:59.0 |*
> >
> *+------------+-------------+------------+------------+------------+------------+-------------+------------+------------------+*
> > *1 row selected (0.53 seconds)*
> >
> > My storage config is below. Any suggestions on what could be wrong, or
> how
> > to debug this error?
> >
> > {
> >  "type": "file",
> >  "enabled": true,
> >  "connection": "s3n://bucket-name",
> >  "workspaces": {
> >    "root": {
> >      "location": "/",
> >      "writable": false,
> >      "defaultInputFormat": null
> >    },
> >    "tmp": {
> >      "location": "file:///tmp",
> >      "writable": true,
> >      "defaultInputFormat": null
> >    }
> >  },
> >  "formats": {
> >    "psv": {
> >      "type": "text",
> >      "extensions": [
> >        "tbl"
> >      ],
> >      "delimiter": "|"
> >    },
> >    "csv": {
> >      "type": "text",
> >      "extensions": [
> >        "csv"
> >      ],
> >      "delimiter": ","
> >    },
> >    "tsv": {
> >      "type": "text",
> >      "extensions": [
> >        "tsv"
> >      ],
> >      "delimiter": "\t"
> >    },
> >    "parquet": {
> >      "type": "parquet"
> >    },
> >    "json": {
> >      "type": "json"
> >    }
> >  }
> > }
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message