drill-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Divya Gehlot <divya.htco...@gmail.com>
Subject Re: UnsupportedOperationException: Unsupported type LIST
Date Tue, 12 Jun 2018 09:49:33 GMT
Hi,
Pasting the stack trace here https://pastebin.com/RCK0SrV
<https://pastebin.com/RCK0SrV2>
Yes Kunal , its the similar issue as mentioned in JIRA .
Any workaround to create parquet file from JSON file having values as
ArrayList  ?

Thanks,
Divya

On Tue, 12 Jun 2018 at 11:48, Paul Rogers <par0328@yahoo.com.invalid> wrote:

> Hi Divya,
>
> Drill will use a (non-repeated) List if it sees a 2D or higher array.
> Looks like the "Coordinates" field is a 2D array, so Drill will use a List.
>
>
> That the List type is unsupported means that, somewhere else in Drill,
> there is an operator that does not support the List type. That is actually
> not very surprising; the List type was a late addition that is not fully
> supported everywhere.
>
> Can you tell from the stack trace in the Drill log which operator is
> failing?
>
> Thanks,
>
> - Paul
>
>
>
>     On Monday, June 11, 2018, 10:31:57 AM PDT, Kunal Khatua <
> kunal@apache.org> wrote:
>
>  I'm wondering if this JIRA is related the issue you are facing:
> https://issues.apache.org/jira/browse/DRILL-2241
> On 6/11/2018 9:44:32 AM, Kunal Khatua <kunal@apache.org> wrote:
> Can you share the stack trace as well?
>
>
> On 6/11/2018 3:12:07 AM, Divya Gehlot <divya.htconex@gmail.com> wrote:
> Hi ,
> I am trying to convert the complex json format to Parquet and I am getting
> below erro :
> SYSTEM ERROR: UnsupportedOperationException: Unsupported type LIST
>
> Fragment 0:0
>
> JSON File format as below :
> {
> "results":[
> {
> "_id":"5b1a3374fb4365076b4d48a8",
> "Session":"5b1a3369000000001200080d",
> "Gateway":"02422d207f0b",
> "Device":234,
> "Client":0,
> "Category":2555,
> "LastUpdate":1528443567,
> "Coordinates":[
> [
> 0,
> 0,
> 0
> ],
> [
> 25.42,
> 37.29,
> 10
> ],
> [
> 25.42,
> 37.29,
> 10
> ],
> [
> 25.42,
> 37.29,
> 10
> ],
> [
> 25.42,
> 37.29,
> 19
> ],
> [
> 25.43,
> 37.3,
> 37
> ],
> [
> 25.43,
> 37.3,
> 46
> ],
> [
> 25.43,
> 37.3,
> 46
> ]
> ],
> "Start":1528443753,
> "End":1528443878,
> "Plan":{
> "id":11,
> "name":"Level 49"
> }
> },
> {
> "_id":"5b1a3170fb4365076b4",
> "Session":"5b1a315e0000000012000",
> "Gateway":"02422d207f0b",
> "Device":153,
> "Client":0,
> "Category":0,
> "LastUpdate":1528443869,
> "Coordinates":[
> [
> 0,
> 0,
> 0
> ],
> [
> 28.48,
> 38.88,
> 11
> ],
> [
> 28.48,
> 38.88,
> 22
> ],
> [
> 28.49,
> 38.89,
> 34
> ],
> [
> 28.49,
> 38.89,
> 47
> ],
> [
> 28.49,
> 38.89,
> 48
> ],
> [
> 0,
> 0,
> 0
> ],
> [
> 26.54,
> 32.83,
> 11
> ],
> [
> 26.54,
> 32.83,
> 23
> ],
> [
> 26.54,
> 32.83,
> 23
> ],
> [
> 26.54,
> 32.83,
> 10
> ],
> [
> 26.54,
> 32.83,
> 21
> ],
> [
> 26.55,
> 32.84,
> 30
> ],
> [
> 26.55,
> 32.84,
> 40
> ],
> [
> 26.55,
> 32.84,
> 51
> ],
> [
> 26.55,
> 32.84,
> 61
> ],
> [
> 26.55,
> 32.84,
> 72
> ],
> [
> 26.55,
> 32.84,
> 83
> ],
> [
> 26.55,
> 32.84,
> 83
> ],
> [
> 0,
> 0,
> 1
> ],
> [
> 28.48,
> 38.88,
> 11
> ],
> [
> 28.48,
> 38.88,
> 11
> ],
> [
> 28.48,
> 38.88,
> 20
> ],
> [
> 26.54,
> 32.83,
> 28
> ],
> [
> 27.19,
> 34.85,
> 37
> ],
> [
> 26.55,
> 32.84,
> 47
> ],
> [
> 27.19,
> 34.85,
> 58
> ],
> [
> 27.19,
> 34.85,
> 68
> ],
> [
> 27.19,
> 34.85,
> 78
> ],
> [
> 26.55,
> 32.84,
> 87
> ],
> [
> 26.55,
> 32.84,
> 97
> ],
> [
> 26.55,
> 32.84,
> 106
> ],
> [
> 26.55,
> 32.84,
> 107
> ],
> [
> 26.54,
> 32.83,
> 10
> ],
> [
> 26.54,
> 32.83,
> 21
> ],
> [
> 26.54,
> 32.83,
> 21
> ],
> [
> 0,
> 0,
> 0
> ],
> [
> 26.54,
> 32.83,
> 9
> ],
> [
> 26.54,
> 32.83,
> 18
> ],
> [
> 26.55,
> 32.84,
> 27
> ],
> [
> 26.55,
> 32.84,
> 27
> ]
> ],
> "Start":1528443230,
> "End":1528443869,
> "Plan":{
> "id":11,
> "name":"Level 49"
> }
> }
> ],
> "total":46
> }
>
>
> Appreciate the help !
>
> Thanks,
> Divya
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message