drill-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Timothy Chen (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (DRILL-19) Build a JSON scanner that does schema discovery
Date Thu, 17 Jan 2013 17:38:12 GMT

    [ https://issues.apache.org/jira/browse/DRILL-19?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13556395#comment-13556395
] 

Timothy Chen commented on DRILL-19:
-----------------------------------

Currently the only Entry point is to create a ScanJson object with the json resource path
and call the PhysicalOperatorIterator to get records (including schema and data) back.

I can expose a main method similiar to what you did to have it being called through command
line. 

For Protobuf/Iterator interface, I'll look into the Descriptor and interface and do the conversion.

Sounds good about the in-memory format, let me know when you defined how it looks and we can
convert this as well.
                
> Build a JSON scanner that does schema discovery
> -----------------------------------------------
>
>                 Key: DRILL-19
>                 URL: https://issues.apache.org/jira/browse/DRILL-19
>             Project: Apache Drill
>          Issue Type: New Feature
>            Reporter: Jacques Nadeau
>            Assignee: Timothy Chen
>
> Build a JSON scanner that reads a file and converts it into two parts: a stream of records
and a schema which reflects the schema of the records.  

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Mime
View raw message