sqoop-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Ron Gonzalez (JIRA)" <j...@apache.org>
Subject [jira] [Created] (SQOOP-2453) Running sqoop with --as-parquet option always fails the container with a memory usage error
Date Thu, 30 Jul 2015 04:58:04 GMT
Ron Gonzalez created SQOOP-2453:
-----------------------------------

             Summary: Running sqoop with --as-parquet option always fails the container with
a memory usage error
                 Key: SQOOP-2453
                 URL: https://issues.apache.org/jira/browse/SQOOP-2453
             Project: Sqoop
          Issue Type: Bug
    Affects Versions: 1.99.6
         Environment: Ubuntu Linux 64 bit
            Reporter: Ron Gonzalez


I tried invoking sqoop with the --as-parquet option. The default container size with the --as-avro
option could handle any sized data load, but with the parquet option, it always fails with
Yarn killing the mapper containers. I've increased the container size to 2 GB to no avail.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message