sqoop-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hudson (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SQOOP-3382) Add parquet numeric support for Parquet in hdfs import
Date Wed, 14 Nov 2018 11:12:00 GMT

    [ https://issues.apache.org/jira/browse/SQOOP-3382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16686375#comment-16686375
] 

Hudson commented on SQOOP-3382:
-------------------------------

FAILURE: Integrated in Jenkins build Sqoop-hadoop200 #1226 (See [https://builds.apache.org/job/Sqoop-hadoop200/1226/])
SQOOP-3382: Add parquet numeric support for Parquet in hdfs import (vasas: [https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=00a02dec2f7507f813ee4899096c470ba1112a9e])
* (edit) src/test/org/apache/sqoop/util/ParquetReader.java
* (edit) src/java/org/apache/sqoop/config/ConfigurationConstants.java
* (add) src/test/org/apache/sqoop/importjob/configuration/PostgresqlImportJobTestConfigurationForNumeric.java
* (edit) src/java/org/apache/sqoop/mapreduce/ParquetImportMapper.java
* (delete) src/test/org/apache/sqoop/importjob/avro/configuration/OracleImportJobTestConfiguration.java
* (delete) src/test/org/apache/sqoop/importjob/avro/configuration/PostgresqlImportJobTestConfigurationForNumeric.java
* (edit) src/test/org/apache/sqoop/importjob/configuration/GenericImportJobSplitByTestConfiguration.java
* (add) src/test/org/apache/sqoop/importjob/configuration/ParquetTestConfiguration.java
* (delete) src/test/org/apache/sqoop/importjob/avro/configuration/OracleImportJobTestConfigurationForNumber.java
* (add) src/test/org/apache/sqoop/importjob/configuration/MSSQLServerImportJobTestConfiguration.java
* (delete) src/test/org/apache/sqoop/importjob/avro/configuration/MySQLImportJobTestConfiguration.java
* (add) src/test/org/apache/sqoop/importjob/configuration/AvroTestConfiguration.java
* (delete) src/test/org/apache/sqoop/importjob/ImportJobTestConfiguration.java
* (delete) src/test/org/apache/sqoop/importjob/avro/configuration/PostgresqlImportJobTestConfigurationPaddingShouldSucceed.java
* (add) src/test/org/apache/sqoop/importjob/configuration/OracleImportJobTestConfigurationForNumber.java
* (add) src/test/org/apache/sqoop/importjob/NumericTypesImportTest.java
* (edit) src/java/org/apache/sqoop/orm/AvroSchemaGenerator.java
* (add) src/test/org/apache/sqoop/importjob/configuration/PostgresqlImportJobTestConfigurationPaddingShouldSucceed.java
* (add) src/test/org/apache/sqoop/importjob/configuration/ImportJobTestConfiguration.java
* (delete) src/test/org/apache/sqoop/importjob/avro/configuration/MSSQLServerImportJobTestConfiguration.java
* (add) src/test/org/apache/sqoop/importjob/configuration/OracleImportJobTestConfiguration.java
* (edit) src/test/org/apache/sqoop/importjob/SplitByImportTest.java
* (edit) src/java/org/apache/sqoop/mapreduce/parquet/hadoop/HadoopParquetImportJobConfigurator.java
* (delete) src/test/org/apache/sqoop/importjob/avro/AvroImportForNumericTypesTest.java
* (add) src/test/org/apache/sqoop/importjob/configuration/MySQLImportJobTestConfiguration.java


> Add parquet numeric support for Parquet in hdfs import
> ------------------------------------------------------
>
>                 Key: SQOOP-3382
>                 URL: https://issues.apache.org/jira/browse/SQOOP-3382
>             Project: Sqoop
>          Issue Type: Sub-task
>    Affects Versions: 1.4.7
>            Reporter: Fero Szabo
>            Assignee: Fero Szabo
>            Priority: Major
>             Fix For: 3.0.0
>
>
> The current Avro numeric tests are suitable to be used as Parquet tests, with very minor
modifications, as parquet can be written with the same input and nearly the same args. Since
we are writing Parquet with it's Avro support, it would be good to cover this code with the
same, or similar tests (including the edge cases related to padding, missing scale and precision
cases).
> Differences are:
>  * the expected output, since stored in a parquet file is different.
>  * input arguements



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message