kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From David Morales <dmora...@stratio.com>
Subject Re: framework to load streamed data from kafka into relational database
Date Tue, 10 Mar 2015 08:20:29 GMT
I suggest you to use Apache Flume, we have a custom JDBC sink at our Flume
distribution

https://github.com/Stratio/flume-ingestion/tree/develop/stratio-sinks/stratio-jdbc-sink




Regards.



2015-03-10 8:23 GMT+01:00 Joe Stein <joe.stein@stealth.ly>:

> If you wanted to use Go you could code a simple worker strategy
>
> https://github.com/stealthly/go_kafka_client/blob/master/consumers/consumers.go#L162-L170
>  with https://godoc.org/golang.org/x/tools/oracle to-do it and have at
> least once insert/update guarantee.
>
> Not sure if you have language requirements or were looking for something
> higher level like Sqoop or NiFi (neither which I think support both yet) or
> something.
>
> ~ Joe Stein
> - - - - - - - - - - - - - - - - -
>
>   http://www.stealth.ly
> - - - - - - - - - - - - - - - - -
>
> On Tue, Mar 10, 2015 at 3:14 AM, Vadim Keylis <vkeylis2009@gmail.com>
> wrote:
>
> > Good evening. Can someone suggest existing framework that allows to
> > reliably load data from kafka into relation database like Oracle in real
> > time?
> >
> > Thanks so much in advance,
> > Vadim
> >
>



-- 

David Morales de Frías  ::  +34 607 010 411 :: @dmoralesdf
<https://twitter.com/dmoralesdf>


<http://www.stratio.com/>
Vía de las dos Castillas, 33, Ática 4, 3ª Planta
28224 Pozuelo de Alarcón, Madrid
Tel: +34 91 828 6473 // www.stratio.com // *@stratiobd
<https://twitter.com/StratioBD>*

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message