sqoop-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Gwen Shapira (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SQOOP-1450) Copy the avro schema file to hdfs for AVRO based import
Date Wed, 20 Aug 2014 02:37:18 GMT

    [ https://issues.apache.org/jira/browse/SQOOP-1450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14103282#comment-14103282

Gwen Shapira commented on SQOOP-1450:

Since yesterday (SQOOP-1390 ) Sqoop supports Parquet directly. So no need for Avro2Parquet

> Copy the avro schema file to hdfs for AVRO based import
> -------------------------------------------------------
>                 Key: SQOOP-1450
>                 URL: https://issues.apache.org/jira/browse/SQOOP-1450
>             Project: Sqoop
>          Issue Type: New Feature
>    Affects Versions: 1.4.5
>            Reporter: Pratik Khadloya
>            Assignee: Pratik Khadloya
>            Priority: Critical
>              Labels: newbie
> Currently sqoop imports the avro file directly to hdfs.
> The schema of the avro files is very important to have. Currently the only way to get
the schema from the avro file is to follow the steps listed in http://dev.gbif.org/wiki/display/DEV/Sqoop+to+Hive+using+Avro
> Apart from being able to programmatically use the schema,it also enables us to convert
the avro file to Parquet too using the avro2parquet converter.

This message was sent by Atlassian JIRA

View raw message