kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Benjamin Black...@b3k.us>
Subject Re: Loadbalancing producers
Date Thu, 29 Aug 2013 16:28:04 GMT
Producers discover the broker that owns each partition and send messages
directly. There isn't anything to load balance at layer 4.
On Aug 29, 2013 8:54 AM, "Mark" <static.void.dev@gmail.com> wrote:

> Can you explain why not?
>
> On Aug 29, 2013, at 8:43 AM, Benjamin Black <b@b3k.us> wrote:
>
> > The LB in front of the brokers doesn't make sense.
> > On Aug 29, 2013 8:42 AM, "Mark" <static.void.dev@gmail.com> wrote:
> >
> >> We have a few dozen front-end web apps running rails. Each one of these
> >> rails instances has an embedded producer which in turn connects to a 3
> >> brokers who are behind a load-balancer. Does that sound about right?
> >>
> >> Is there anything special to account for since these TCP connections are
> >> long lived?
> >>
> >> On Aug 29, 2013, at 7:20 AM, Jun Rao <junrao@gmail.com> wrote:
> >>
> >>> I think a typical setup is that you have a load balancer in front of a
> >>> bunch of frontend services, each of which has an embedded producer.
> >>>
> >>> Thanks,
> >>>
> >>> Jun
> >>>
> >>>
> >>> On Wed, Aug 28, 2013 at 9:01 PM, Mark <static.void.dev@gmail.com>
> wrote:
> >>>
> >>>> Is it common/necessary to load balance the connections your producers
> >> use?
> >>>> I'm looking at the Ruby gem and it doesn't look like this is handled
> via
> >>>> the gem.
> >>
> >>
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message