kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Nag Y <andriod.nag.u...@gmail.com>
Subject Re: Kafka - how to know whether it is broker property or topic property or producer property
Date Sun, 14 Jun 2020 07:13:02 GMT
Ah , got it. To rephrase the answer to my question, considering the same
property

min.insync.replicas
<https://kafka.apache.org/documentation/#min.insync.replicas>

Type: int
Default: 1
Valid Values: [1,...]
Server Default Property: min.insync.replicas
Importance: medium

As the document says,  *Server Default Property* specifies the
corresponding broker property that will be used if  no value is mentioned
for this property ( at the topic level) by considering the rules of
https://kafka.apache.org/documentation/#dynamicbrokerconfigs.

Other interesting example where topic property is different from broker
property. -  cleanup.policy  . While cleanup.policy
<https://kafka.apache.org/documentation/#cleanup.policy> is topic specific
property while equivalent server ( broker) property is log.cleanup.policy

Hope my understanding is inline.

On Sun, Jun 14, 2020 at 12:24 PM Liam Clarke-Hutchinson <
liam.clarke@adscale.co.nz> wrote:

> Hi Nag,
>
>
> https://kafka.apache.org/documentation/#topicconfigs
>
> > Configurations pertinent to topics have both a server default as well an
> optional per-topic override. If no per-topic configuration is given the
> server default is used. The override can be set at topic creation time by
> giving one or more --config options.
>
>
> Hope this helps :)
>
> Cheers,
>
> Liam Clarke-Hutchinson
>
>
> On Sun, Jun 14, 2020 at 6:48 PM Nag Y <andriod.nag.user@gmail.com> wrote:
>
> > Is it documented somewhere the property is shared or we need to look it
> in
> > multiple places ?
> >
> > Thanks
> >
> > On Sun, Jun 14, 2020 at 12:15 PM Liam Clarke-Hutchinson <
> > liam.clarke@adscale.co.nz> wrote:
> >
> > > Hi Nag,
> > >
> > > If topic and brokers share the same property, then it is safe to assume
> > > that the broker property is the default, which can be overridden by
> > > explicit topic configs.
> > >
> > > Kind regards,
> > >
> > > Liam Clarke
> > >
> > > On Sun, Jun 14, 2020 at 6:42 PM Nag Y <andriod.nag.user@gmail.com>
> > wrote:
> > >
> > > > I am going through the documentation and often times, it is either
> not
> > > > clear or need to look at in multiple pleaces to see to which a
> > prticular
> > > > property belongs and is it a specific property to an entity etc ..
> > > >
> > > > To give an example, consider *"min.insync.replicas"* - This is just
> for
> > > an
> > > > example. From the apache documentation, it is mentioned under
> > > > https://kafka.apache.org/documentation/#brokerconfigs . From the
> > > confluent
> > > > documentation it is mentioned under
> > > >
> > > >
> > >
> >
> https://docs.confluent.io/current/installation/configuration/topic-configs.html
> > > > .
> > > > Later, I came to know that this property is available under both and
> > > > follows inheritance based on where it is configured. This needed to
> > look
> > > > into multiple places to understand more about this property to see
> > where
> > > it
> > > > belongs etc ..
> > > >
> > > > But, is not there a documentation about where each property belongs,
> > and
> > > > will it be inherited or not etc.
> > > >
> > > > I do not think this answer need not be complex like looking into
> source
> > > > code, it should be simple enough - perhaps I might be missing
> > something.
> > > >
> > > >
> > > > Also posted here
> > > >
> > > >
> > >
> >
> https://stackoverflow.com/questions/62369238/kafka-how-to-know-whether-it-is-broker-property-or-topic-property-or-producer
> > > >
> > >
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message