sqoop-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Pratik Khadloya (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SQOOP-1450) Copy the avro schema file to hdfs for AVRO based import
Date Tue, 19 Aug 2014 20:05:19 GMT

    [ https://issues.apache.org/jira/browse/SQOOP-1450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14102744#comment-14102744

Pratik Khadloya commented on SQOOP-1450:

But i think its hard to get programmatic access to the schema at that location.

> Copy the avro schema file to hdfs for AVRO based import
> -------------------------------------------------------
>                 Key: SQOOP-1450
>                 URL: https://issues.apache.org/jira/browse/SQOOP-1450
>             Project: Sqoop
>          Issue Type: New Feature
>    Affects Versions: 1.4.5
>            Reporter: Pratik Khadloya
>            Assignee: Pratik Khadloya
>            Priority: Critical
>              Labels: newbie
> Currently sqoop imports the avro file directly to hdfs.
> The schema of the avro files is very important to have. Currently the only way to get
the schema from the avro file is to follow the steps listed in http://dev.gbif.org/wiki/display/DEV/Sqoop+to+Hive+using+Avro
> Apart from being able to programmatically use the schema,it also enables us to convert
the avro file to Parquet too using the avro2parquet converter.

This message was sent by Atlassian JIRA

View raw message