sqoop-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chris Teoh (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SQOOP-3191) import as avro file is missing from sqoop import-mainframe
Date Wed, 31 May 2017 08:04:04 GMT

    [ https://issues.apache.org/jira/browse/SQOOP-3191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16030808#comment-16030808
] 

Chris Teoh commented on SQOOP-3191:
-----------------------------------

Thanks for finding this [~eliviu]

I have only used the mainframe module to export datasets as plain text as it is not querying
the DB2 database directly. It is most likely a documentation bug but I'd like to know what
your use case is to see if it is.

Kind Regards
Chris

> import as avro file is missing from sqoop import-mainframe
> ----------------------------------------------------------
>
>                 Key: SQOOP-3191
>                 URL: https://issues.apache.org/jira/browse/SQOOP-3191
>             Project: Sqoop
>          Issue Type: Bug
>          Components: build
>    Affects Versions: 1.4.6
>            Reporter: liviu
>
> In documentation is stated that sqoop import-mainframe can import files to formats avro/parquet

> When I add the option --as-avrodatafile I receive an "Unrecognized argument" error:
> {code}
> 17/05/31 08:25:35 ERROR tool.BaseSqoopTool: Error parsing arguments for import-mainframe:
> 17/05/31 08:25:35 ERROR tool.BaseSqoopTool: Unrecognized argument: --as-avrodatafile
> {code}
> Also, the help is listing only the -as-textfile option (no avro/parquet options)
> {code}
> sqoop help import-mainframe
> Warning: /opt/cloudera/parcels/CDH-5.8.2-1.cdh5.8.2.p0.3/bin/../lib/sqoop/../accumulo
does not exist! Accumulo imports will fail.
> Please set $ACCUMULO_HOME to the root of your Accumulo installation.
> 17/05/31 08:29:54 INFO sqoop.Sqoop: Running Sqoop version: 1.4.6-cdh5.8.2
> ...........
> Import mainframe control arguments:
>    --as-textfile                                              Imports data
>                                                               as plain
>                                                               text
>                                                               (default)
>    --compression-codec <codec>                                Compression
>                                                               codec to use
>                                                               for import
>    --dataset <Dataset name>                                   Datasets to
> {code}
> So, is this a bug in sqoop application or the documentation is wrong and import as avro/parquet
is not supported by sqoop import-mainframe?
> Thanks,



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message