sqoop-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Veena Basavaraj (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (SQOOP-2039) Sqoop2: KiteConnector To side need to convert JODA to AvroDate, BigDecimal to Avro Decimal type
Date Thu, 22 Jan 2015 19:36:34 GMT

     [ https://issues.apache.org/jira/browse/SQOOP-2039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Veena Basavaraj updated SQOOP-2039:
-----------------------------------
    Description: 
as the description says KiteLoader needs to handle the date time/ decimal cases  to Avro types
before loading, since kite uses avro in memory

{code}

    DataReader reader = context.getDataReader();
    Object[] array;
    boolean success = false;

    try {
      while ((array = reader.readArrayRecord()) != null) {
        executor.writeRecord(array);
        rowsWritten++;
      }
      LOG.info(rowsWritten + " data record(s) have been written into dataset.");
      success = true;
    } finally {
      executor.closeWriter();

{code}

  was:
as the description says KiteLoader needs to handle the date time/ decimal cases 

{code}

    DataReader reader = context.getDataReader();
    Object[] array;
    boolean success = false;

    try {
      while ((array = reader.readArrayRecord()) != null) {
        executor.writeRecord(array);
        rowsWritten++;
      }
      LOG.info(rowsWritten + " data record(s) have been written into dataset.");
      success = true;
    } finally {
      executor.closeWriter();

{code}

        Summary: Sqoop2: KiteConnector To side need to convert  JODA to AvroDate,  BigDecimal
to Avro Decimal type  (was: Sqoop2: KiteConnector To side need to convert  JODA to Avro /Parquet
Date,  BigDecimal to Avro Decimal type)

> Sqoop2: KiteConnector To side need to convert  JODA to AvroDate,  BigDecimal to Avro
Decimal type
> -------------------------------------------------------------------------------------------------
>
>                 Key: SQOOP-2039
>                 URL: https://issues.apache.org/jira/browse/SQOOP-2039
>             Project: Sqoop
>          Issue Type: Bug
>            Reporter: Veena Basavaraj
>            Assignee: Qian Xu
>             Fix For: 1.99.6
>
>
> as the description says KiteLoader needs to handle the date time/ decimal cases  to Avro
types before loading, since kite uses avro in memory
> {code}
>     DataReader reader = context.getDataReader();
>     Object[] array;
>     boolean success = false;
>     try {
>       while ((array = reader.readArrayRecord()) != null) {
>         executor.writeRecord(array);
>         rowsWritten++;
>       }
>       LOG.info(rowsWritten + " data record(s) have been written into dataset.");
>       success = true;
>     } finally {
>       executor.closeWriter();
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message