kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Boris Lublinsky <boris.lublin...@lightbend.com>
Subject Re: Http streaming using Kafka+Akka
Date Wed, 11 Jul 2018 13:56:54 GMT
This works fine, we (Lightbend) are using this approach all over the place

Boris Lublinsky
FDP Architect
boris.lublinsky@lightbend.com
https://www.lightbend.com/

> On Jul 11, 2018, at 8:53 AM, Pulkit Manchanda <pulkit.lpu@gmail.com> wrote:
> 
> Hi All,
> 
> I want to build a datapipeline with the following design. Can please anyone
> advice me that is it feasible to do? Or there are better options.
> 
> 
> HTTP Streams --> (HTTP stream consumer)(using AKKA HTTP Streaming) --> (kafka
> Stream Producer)(using Kafka Streaming) --> (Kafka Stream Consumer)(using Spark
> structured streaming)
> 
> 
> DPContext --> (Kafka Stream Producer)(using Spark structured
> streaming) --> (Kafka
> Stream Consumer)(using AKKA Streaming) -->(HTTP stream Producer)(using AKKA
> HTTP Streaming) --> HTTP Streams
> 
> Thanks
> Pulkit


Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message