drill-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jacques Nadeau (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (DRILL-19) Build a JSON scanner that does schema discovery
Date Fri, 11 Jan 2013 00:46:12 GMT

    [ https://issues.apache.org/jira/browse/DRILL-19?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13550627#comment-13550627
] 

Jacques Nadeau commented on DRILL-19:
-------------------------------------

Timothy is working at https://github.com/tnachen/incubator-drill/tree/executor-java

Few thoughts/questions as I go through this.
-You should update intellij to use a template that doesn't have any header information other
than the Apache license.  Then you won't have to go back through and fix things.
-Do you have an easy way to output the found schema so we can see it?
-Talk to me a little about your concept of RecordBatch.  It seems like individual operators
should be unaware of batches.  

My thoughts were along the lines of 
class PhysicalOperatorIterator{
enum NextOutcome {NONE_LEFT, INCREMENTED_SCHEMA_UNCHANGED, INCREMENTED_SCHEMA_CHANGED}
  public Record getRecordPointer(); // called once
  public RESPONSE_TYPE getNext(); // changes the meaning of the pointer
}

class Record{
  public Value getValue(int fieldIndex);
                
> Build a JSON scanner that does schema discovery
> -----------------------------------------------
>
>                 Key: DRILL-19
>                 URL: https://issues.apache.org/jira/browse/DRILL-19
>             Project: Apache Drill
>          Issue Type: New Feature
>            Reporter: Jacques Nadeau
>            Assignee: Timothy Chen
>


--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message