sqoop-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Veena Basavaraj (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (SQOOP-1993) Add To support in KiteConnector to write to Hbase
Date Thu, 22 Jan 2015 17:53:34 GMT

     [ https://issues.apache.org/jira/browse/SQOOP-1993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel

Veena Basavaraj updated SQOOP-1993:
    Fix Version/s:     (was: 1.99.5)

> Add To support in KiteConnector to write to Hbase
> -------------------------------------------------
>                 Key: SQOOP-1993
>                 URL: https://issues.apache.org/jira/browse/SQOOP-1993
>             Project: Sqoop
>          Issue Type: Sub-task
>          Components: connectors
>            Reporter: Veena Basavaraj
>            Assignee: Veena Basavaraj
>             Fix For: 1.99.6
> This might need more details to flush out since Hbase writing and HDFS writing are different
> {quote}
>  Ryan:  The problem was mainly durability, if I remember correctly
> There are different durability models between Kite HBase and Kite HDFS
> HDFS writes entire files and commits them so retries work like standard OutputFormat
> but, HBase needs to do something different
>  me:  sure thats still an implementation details undernath
>  Ryan:  IIRC, the connector API basically wants to signal when everything should be committed,
all at once
> that seems difficult to implement with HBase
> If you know more about Sqoop and think it can be done, I'm all for making the changes
to enable it from the Kite side
> {quote}

This message was sent by Atlassian JIRA

View raw message