drill-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hanifi Gunes (JIRA)" <j...@apache.org>
Subject [jira] [Created] (DRILL-1536) Selecting a null valued field fails on json input format with an irrelevant error message
Date Tue, 14 Oct 2014 22:10:34 GMT
Hanifi Gunes created DRILL-1536:
-----------------------------------

             Summary: Selecting a null valued field fails on json input format with an irrelevant
error message
                 Key: DRILL-1536
                 URL: https://issues.apache.org/jira/browse/DRILL-1536
             Project: Apache Drill
          Issue Type: Bug
            Reporter: Hanifi Gunes


Running 
{code:sql}
select t.id from dfs.`data/simple.json` t;
{code}

against

{panel:title=simple.json}
\{"id":null\}
{panel}

throws
{panel}
org.apache.drill.common.exceptions.DrillRuntimeException: Record is too big to fit into allocated
ValueVector
	at org.apache.drill.exec.store.easy.json.JSONRecordReader2.next(JSONRecordReader2.java:121)
	at org.apache.drill.exec.physical.impl.ScanBatch.next(ScanBatch.java:158)
	at org.apache.drill.exec.physical.impl.validate.IteratorValidatorBatchIterator.next(IteratorValidatorBatchIterator.java:117)
	at org.apache.drill.exec.physical.impl.producer.ProducerConsumerBatch$Producer.run(ProducerConsumerBatch.java:128)
	at java.lang.Thread.run(Thread.java:745)
{panel}

We need to make sure a value vector for the field `id` is allocated before attempting to manipulate
the vector. Currently JsonReader does nothing beyond a bound check when encountered with a
null value. We should implement proper null value handling.

Also the above error message should precisely reflect the root cause of the problem. Thrown
exception in this case is irrelevant and misleading.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message