sqoop-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Veena Basavaraj (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (SQOOP-2035) Sqoop2: KiteConnector need to send BigDecimal for decimal type in Object array
Date Thu, 22 Jan 2015 19:11:35 GMT

     [ https://issues.apache.org/jira/browse/SQOOP-2035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Veena Basavaraj updated SQOOP-2035:
-----------------------------------
    Description: 
At this point, we do not see the Kite Connector sending BigDecimal for objects that are Sqoop
Decimal type, as we prescribe JODA for date objects, we need BigDecimal for decimal objects.

code to be fixed
{code}

  @Override
  public void extract(ExtractorContext context, LinkConfiguration linkConfig,
      FromJobConfiguration fromJobConfig, KiteDatasetPartition partition) {
    String uri = partition.getUri();
    LOG.info("Loading data from " + uri);

    KiteDatasetExecutor executor = getExecutor(uri);
    DataWriter writer = context.getDataWriter();
    Object[] array;
    rowsRead = 0L;

    try {
      while ((array = executor.readRecord()) != null) {
        // TODO: SQOOP-1616 will cover more column data types. Use schema and do data type
conversion (e.g. datatime).
        writer.writeArrayRecord(array);
        rowsRead++;
      }
    } finally {
      executor.closeReader();
    }
  }

{code}


  was:
At this point, we do not see the JDBC Connector sending BigDecimal for objects that are Sqoop
Decimal type, as we prescribe JODA for date objects, we need BigDecimal for decimal objects.

code to be fixed
{code}

  @Override
  public void extract(ExtractorContext context, LinkConfiguration linkConfig,
      FromJobConfiguration fromJobConfig, KiteDatasetPartition partition) {
    String uri = partition.getUri();
    LOG.info("Loading data from " + uri);

    KiteDatasetExecutor executor = getExecutor(uri);
    DataWriter writer = context.getDataWriter();
    Object[] array;
    rowsRead = 0L;

    try {
      while ((array = executor.readRecord()) != null) {
        // TODO: SQOOP-1616 will cover more column data types. Use schema and do data type
conversion (e.g. datatime).
        writer.writeArrayRecord(array);
        rowsRead++;
      }
    } finally {
      executor.closeReader();
    }
  }

{code}



>  Sqoop2: KiteConnector need to send BigDecimal for decimal type in Object array
> -------------------------------------------------------------------------------
>
>                 Key: SQOOP-2035
>                 URL: https://issues.apache.org/jira/browse/SQOOP-2035
>             Project: Sqoop
>          Issue Type: Bug
>            Reporter: Veena Basavaraj
>            Assignee: Veena Basavaraj
>             Fix For: 1.99.5
>
>
> At this point, we do not see the Kite Connector sending BigDecimal for objects that are
Sqoop Decimal type, as we prescribe JODA for date objects, we need BigDecimal for decimal
objects.
> code to be fixed
> {code}
>   @Override
>   public void extract(ExtractorContext context, LinkConfiguration linkConfig,
>       FromJobConfiguration fromJobConfig, KiteDatasetPartition partition) {
>     String uri = partition.getUri();
>     LOG.info("Loading data from " + uri);
>     KiteDatasetExecutor executor = getExecutor(uri);
>     DataWriter writer = context.getDataWriter();
>     Object[] array;
>     rowsRead = 0L;
>     try {
>       while ((array = executor.readRecord()) != null) {
>         // TODO: SQOOP-1616 will cover more column data types. Use schema and do data
type conversion (e.g. datatime).
>         writer.writeArrayRecord(array);
>         rowsRead++;
>       }
>     } finally {
>       executor.closeReader();
>     }
>   }
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message