kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Gaurav Agarwal <gaurav130...@gmail.com>
Subject Re: How to build strategy for particular setup of kafka
Date Fri, 22 Apr 2016 07:14:05 GMT
Hi
You can have one or two instances of Kafka but you can have one or two
Kafka topic dedicated to each application according to the need. Partition
will have u in increasing the throughput and consumer group id can help u
to make queue as topic or queue.
On Apr 22, 2016 12:37 PM, "Kuldeep Kamboj" <kuldeep.kamboj@osscube.com>
wrote:

> Thanks for reply,
>
> I understand the your point, But my whole strategy depend on first issue
> and that is how I can integrate Apps in architecture. Partition / Consumer
> groups have different purpose. If I need to setup three kafka instances
> each for App ?
>
> On Fri, Apr 22, 2016 at 12:30 PM, Lohith Samaga M <
> Lohith.Samaga@mphasis.com
> > wrote:
>
> > Hi,
> >         It is better NOT to share topics among applications. You may have
> > a wrapper application reading from the queue/topic and routing it to the
> > correct application, but it is simpler for each application to read from
> > its own topic.
> >
> > Best regards / Mit freundlichen Grüßen / Sincères salutations
> > M. Lohith Samaga
> >
> >
> >
> > -----Original Message-----
> > From: Kuldeep Kamboj [mailto:kuldeep.kamboj@osscube.com]
> > Sent: Friday, April 22, 2016 12.08
> > To: users@kafka.apache.org
> > Subject: How to build strategy for particular setup of kafka
> >
> > I have three applications let named AppA, AppB, AppC. All could have
> > several some message queue named like
> >
> >     AppA
> >        MsgQueueA
> >        MsgQueueB
> >     AppB
> >        MsgQueueA
> >        MsgQueueB
> >        MsgQueueC
> >     AppC
> >        MsgQueueA
> >        MsgQueueB
> >        MsgQueueD
> >
> > I have very little exposure for Apache Kafka and even for message queue
> > concepts.
> >
> > I just thinking to create topics for MsgQueueA, MsgQueueB and so on. But
> I
> > am confused how to integrate AppA, AppB, AppC. Partition and Consumer
> group
> > look like wrong choices for them.
> >
> > Also If separation of queue/topic for Apps is better idea instead of
> > re-using them for different Apps for better debugging Like below
> >
> >
> >     AppA
> >        AppAMsgQueueA
> >        AppAMsgQueueB
> >     AppB
> >        AppBMsgQueueA
> >        AppBMsgQueueB
> >        AppBMsgQueueC
> >     AppC
> >        AppCMsgQueueA
> >        AppCMsgQueueB
> >        AppCMsgQueueD
> >
> >
> >
> >
> > --
> > Kuldeep Kamboj
> > Information transmitted by this e-mail is proprietary to Mphasis, its
> > associated companies and/ or its customers and is intended
> > for use only by the individual or entity to which it is addressed, and
> may
> > contain information that is privileged, confidential or
> > exempt from disclosure under applicable law. If you are not the intended
> > recipient or it appears that this mail has been forwarded
> > to you without proper authority, you are notified that any use or
> > dissemination of this information in any manner is strictly
> > prohibited. In such cases, please notify us immediately at
> > mailmaster@mphasis.com and delete this mail from your records.
> >
>
>
>
> --
> Kuldeep Kamboj
> Mob. 9871662849
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message