sqoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Buntu Dev <buntu...@gmail.com>
Subject Re: "change data capture" or CDC support in the MySQL connector
Date Thu, 08 Dec 2016 01:42:44 GMT
I'm interested in this as well and would like to sqoop to a hadoop cluster
as a Hive table. How does one handle the updates on the table using the
incremental imports?

On Wed, Dec 7, 2016 at 5:29 PM, wenxing zheng <wenxing.zheng@gmail.com>
wrote:

> Thanks to Bogi. Is it available in the Sqoop2?
>
> On Thu, Dec 8, 2016 at 4:16 AM, Boglarka Egyed <bogi@cloudera.com> wrote:
>
>> Hi Wenxing,
>>
>> Yes, Sqoop is capable to support CDC, it can be performed by
>> "incremental" imports.
>>
>> Please see the user guide for details: https://sqoop.apache.
>> org/docs/1.4.6/SqoopUserGuide.html#_incremental_imports
>>
>> Cheers,
>> Bogi
>>
>> On Wed, Dec 7, 2016 at 12:21 PM, wenxing zheng <wenxing.zheng@gmail.com>
>> wrote:
>>
>>> Dear all,
>>>
>>> I am new to the Sqoop, and would like to know whether the architecture
>>> of Sqoop is able to support "change data capture"? or can I say that the
>>> "Generic JDBC Connector" is only for bulk data transferring?
>>>
>>> Appreciated for any hints
>>>
>>> Thanks, Wenxing
>>>
>>
>>
>

Mime
View raw message