sqoop-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "liviu (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SQOOP-3191) import as avro file is missing from sqoop import-mainframe
Date Wed, 31 May 2017 08:35:04 GMT

    [ https://issues.apache.org/jira/browse/SQOOP-3191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16030837#comment-16030837

liviu commented on SQOOP-3191:

Hi [~chris.teoh@gmail.com],

We want to import mainframe datasets in HDFS as avro files

The import as textfile works fine using below command:
sqoop import-mainframe --connect **** --username **** --password **** --dataset "****" --verbose
--target-dir /user/****

but when I try to add "--as-avrodatfile" option in order to import them in avro format I receive
that "Unrecognized argument" error; below the command used (the only difference is the --as-avrodatfile
option added)
sqoop import-mainframe --connect **** --username **** --password **** --as-avrodatafile --dataset
"****" --verbose --target-dir /user/****


> import as avro file is missing from sqoop import-mainframe
> ----------------------------------------------------------
>                 Key: SQOOP-3191
>                 URL: https://issues.apache.org/jira/browse/SQOOP-3191
>             Project: Sqoop
>          Issue Type: Bug
>          Components: build
>    Affects Versions: 1.4.6
>            Reporter: liviu
> In documentation is stated that sqoop import-mainframe can import files to formats avro/parquet

> When I add the option --as-avrodatafile I receive an "Unrecognized argument" error:
> {code}
> 17/05/31 08:25:35 ERROR tool.BaseSqoopTool: Error parsing arguments for import-mainframe:
> 17/05/31 08:25:35 ERROR tool.BaseSqoopTool: Unrecognized argument: --as-avrodatafile
> {code}
> Also, the help is listing only the -as-textfile option (no avro/parquet options)
> {code}
> sqoop help import-mainframe
> Warning: /opt/cloudera/parcels/CDH-5.8.2-1.cdh5.8.2.p0.3/bin/../lib/sqoop/../accumulo
does not exist! Accumulo imports will fail.
> Please set $ACCUMULO_HOME to the root of your Accumulo installation.
> 17/05/31 08:29:54 INFO sqoop.Sqoop: Running Sqoop version: 1.4.6-cdh5.8.2
> ...........
> Import mainframe control arguments:
>    --as-textfile                                              Imports data
>                                                               as plain
>                                                               text
>                                                               (default)
>    --compression-codec <codec>                                Compression
>                                                               codec to use
>                                                               for import
>    --dataset <Dataset name>                                   Datasets to
> {code}
> So, is this a bug in sqoop application or the documentation is wrong and import as avro/parquet
is not supported by sqoop import-mainframe?
> Thanks,

This message was sent by Atlassian JIRA

View raw message