hbase-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Leon Bein <leon.b...@student.hpi.de>
Subject Topic: CDC for Flink Source
Date Fri, 04 Dec 2020 15:08:51 GMT
Hi @all,

we are currently developing an HBase source for Flink with the new API 
(FLIP-27 
<https://cwiki.apache.org/confluence/display/FLINK/FLIP-27%3A+Refactor+Source+Interface>).
For this, we try to implement change data capturing on HBase.

What are your opinions on which approach to pursue?
Options that we found so far include

  * using Coprocessors, e.g. RegionObserver
  * reading the WAL e.g. with ProtobufLogReader (which is marked as
    LimitedPrivate)
  * and using ReplicationEndpoint (which also seem to be more internal).

Best regards,
Leon Bein

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message