sqoop-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Veena Basavaraj (JIRA)" <j...@apache.org>
Subject [jira] [Created] (SQOOP-1993) Add To support in KiteConnector to write to Hbase
Date Fri, 09 Jan 2015 18:18:34 GMT
Veena Basavaraj created SQOOP-1993:

             Summary: Add To support in KiteConnector to write to Hbase
                 Key: SQOOP-1993
                 URL: https://issues.apache.org/jira/browse/SQOOP-1993
             Project: Sqoop
          Issue Type: Sub-task
            Reporter: Veena Basavaraj

This might need more details to flush out since Hbase writing and HDFS writing are different

 Ryan:  The problem was mainly durability, if I remember correctly
There are different durability models between Kite HBase and Kite HDFS
HDFS writes entire files and commits them so retries work like standard OutputFormat commiters
but, HBase needs to do something different
 me:  sure thats still an implementation details undernath
 Ryan:  IIRC, the connector API basically wants to signal when everything should be committed,
all at once
that seems difficult to implement with HBase
If you know more about Sqoop and think it can be done, I'm all for making the changes to enable
it from the Kite side


This message was sent by Atlassian JIRA

View raw message