drill-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Timothy Chen (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (DRILL-19) Build a JSON scanner that does schema discovery
Date Thu, 17 Jan 2013 17:38:12 GMT

    [ https://issues.apache.org/jira/browse/DRILL-19?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13556395#comment-13556395

Timothy Chen commented on DRILL-19:

Currently the only Entry point is to create a ScanJson object with the json resource path
and call the PhysicalOperatorIterator to get records (including schema and data) back.

I can expose a main method similiar to what you did to have it being called through command

For Protobuf/Iterator interface, I'll look into the Descriptor and interface and do the conversion.

Sounds good about the in-memory format, let me know when you defined how it looks and we can
convert this as well.
> Build a JSON scanner that does schema discovery
> -----------------------------------------------
>                 Key: DRILL-19
>                 URL: https://issues.apache.org/jira/browse/DRILL-19
>             Project: Apache Drill
>          Issue Type: New Feature
>            Reporter: Jacques Nadeau
>            Assignee: Timothy Chen
> Build a JSON scanner that reads a file and converts it into two parts: a stream of records
and a schema which reflects the schema of the records.  

This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

View raw message