sqoop-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From wenxing zheng <wenxing.zh...@gmail.com>
Subject Re: "change data capture" or CDC support in the MySQL connector
Date Thu, 08 Dec 2016 01:56:04 GMT
And another important case is how the incremental imports can cope with the
"DELETION" on the source.

Thanks again,

On Thu, Dec 8, 2016 at 9:42 AM, Buntu Dev <buntudev@gmail.com> wrote:

> I'm interested in this as well and would like to sqoop to a hadoop cluster
> as a Hive table. How does one handle the updates on the table using the
> incremental imports?
>
> On Wed, Dec 7, 2016 at 5:29 PM, wenxing zheng <wenxing.zheng@gmail.com>
> wrote:
>
>> Thanks to Bogi. Is it available in the Sqoop2?
>>
>> On Thu, Dec 8, 2016 at 4:16 AM, Boglarka Egyed <bogi@cloudera.com> wrote:
>>
>>> Hi Wenxing,
>>>
>>> Yes, Sqoop is capable to support CDC, it can be performed by
>>> "incremental" imports.
>>>
>>> Please see the user guide for details: https://sqoop.apache.
>>> org/docs/1.4.6/SqoopUserGuide.html#_incremental_imports
>>>
>>> Cheers,
>>> Bogi
>>>
>>> On Wed, Dec 7, 2016 at 12:21 PM, wenxing zheng <wenxing.zheng@gmail.com>
>>> wrote:
>>>
>>>> Dear all,
>>>>
>>>> I am new to the Sqoop, and would like to know whether the architecture
>>>> of Sqoop is able to support "change data capture"? or can I say that the
>>>> "Generic JDBC Connector" is only for bulk data transferring?
>>>>
>>>> Appreciated for any hints
>>>>
>>>> Thanks, Wenxing
>>>>
>>>
>>>
>>
>

Mime
View raw message