kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Ran Lupovich <ranlupov...@gmail.com>
Subject Re: Standard way to get http POST request into a Kafka topic?
Date Wed, 28 Apr 2021 03:42:34 GMT
Hi, have a look for Rest Proxy component as part of the kafka eco system

בתאריך יום ד׳, 28 באפר׳ 2021, 01:27, מאת Reed Villanueva ‏<
villanuevareed@gmail.com>:

> What is the best-practice/kafka way to get http(s) POST requests into a
> Kafka topic (kafka v2.0.0 installed on a HDP cluster)?
> Have never used kafka before and would like to know the best way that this
> should be done.
> Basically, we have a public URL that is going to receive requests from a
> specific external URL based on event hooks (
> https://developers.acuityscheduling.com/docs/webhooks) and I want to get
> these requests into a kafka topic.
> I've seen this (https://docs.confluent.io/3.0.0/kafka-rest/docs/intro.html
> ),
> but am a bit confused (again, have never used kafka before). Will there
> need to be an always-on producer to read from these event hooks to produce
> into a topic? What is the best practice way to do this to account for
> whatever common fault tolerances that should be built into a kafka producer
> for this kind of live event feed? No way to just automatically dump the
> requests into the topic (and avoid having to ensure such a simple
> forwarding producer is always alive (and thus not forever missing the data
> that came in during that downtime))?
>
> Thank you
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message