kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Boris Lublinsky <boris.lublin...@lightbend.com>
Subject Re: Http streaming using Kafka+Akka
Date Wed, 11 Jul 2018 15:06:00 GMT
Yes, reactive Kafka

Boris Lublinsky
FDP Architect
boris.lublinsky@lightbend.com
https://www.lightbend.com/

> On Jul 11, 2018, at 9:46 AM, Pulkit Manchanda <pulkit.lpu@gmail.com> wrote:
> 
> Thanks Boris.
> Are you using Alpakka for kafka -Akka integration?
> 
> On Wed, Jul 11, 2018 at 9:56 AM, Boris Lublinsky <
> boris.lublinsky@lightbend.com> wrote:
> 
>> This works fine, we (Lightbend) are using this approach all over the place
>> 
>> Boris Lublinsky
>> FDP Architect
>> boris.lublinsky@lightbend.com
>> https://www.lightbend.com/
>> 
>>> On Jul 11, 2018, at 8:53 AM, Pulkit Manchanda <pulkit.lpu@gmail.com>
>> wrote:
>>> 
>>> Hi All,
>>> 
>>> I want to build a datapipeline with the following design. Can please
>> anyone
>>> advice me that is it feasible to do? Or there are better options.
>>> 
>>> 
>>> HTTP Streams --> (HTTP stream consumer)(using AKKA HTTP Streaming) -->
>> (kafka
>>> Stream Producer)(using Kafka Streaming) --> (Kafka Stream
>> Consumer)(using Spark
>>> structured streaming)
>>> 
>>> 
>>> DPContext --> (Kafka Stream Producer)(using Spark structured
>>> streaming) --> (Kafka
>>> Stream Consumer)(using AKKA Streaming) -->(HTTP stream Producer)(using
>> AKKA
>>> HTTP Streaming) --> HTTP Streams
>>> 
>>> Thanks
>>> Pulkit
>> 
>> 


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message