kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Joe Stein <joest...@elodina.net>
Subject Re: Kafka support needed
Date Wed, 20 Apr 2016 05:18:53 GMT
If you use Go you can use https://github.com/sclasen/event-shuttle which is
nice choice in some cases because footprint, it uses boltdb which is like
leveldb which is like embedded k/v ok

NiFi is cool too https://nifi.apache.org/

So is bruce https://github.com/ifwe/bruce

those are more out of the box and can work with but reliable because people
use them live

On Wed, Apr 20, 2016 at 1:05 AM, Sunny Shah <sunny.cpp@gmail.com> wrote:

> Hi Yogesh,
>
> You can even use sqllite/leveldb to buffer the data on client.
>
> Thanks,
> Sunny
> On Apr 20, 2016 10:31 AM, "Yogesh BG" <yogeshbgv@gmail.com> wrote:
>
> > Thank You for the reply.
> >
> > I am running producer in very resource constraint device(IOT hub). I
> doubt
> > whether i can accommodate local broker.
> >
> >
> > On Wed, Apr 20, 2016 at 10:07 AM, Sunny Shah <sunny.cpp@gmail.com>
> wrote:
> >
> > > Hi Yogesh,
> > >
> > > No, Kafka does not provide this functionality out of the box, Though
> you
> > > can easily engineer it by having a localhost Kafka setup.
> > >
> > >    1. Always write data to the localhost Kafka.
> > >    2. When broker connection is available then read data from localhost
> > >    Kafka and send it to remote Kafka broker.
> > >
> > > If you don't want to engineer this sytem then you can use Apache NiFi,
> It
> > > is meant for reliable edge node data ingestion.
> > >
> > > Thanks,
> > >  Sunny
> > >
> > > On Wed, Apr 20, 2016 at 9:41 AM, Yogesh BG <yogeshbgv@gmail.com>
> wrote:
> > >
> > > > Hi
> > > >
> > > >
> > > >
> > > > I have a one scenario ass below, I want to know whether its supported
> > > > currently. If not is there any work around by using existing kafka
> > > > features.
> > > >
> > > >
> > > >
> > > > I have kafka producer, currently he doesn’t have connection to the
> > > broker.
> > > > I want to send the messages to kafka broker when the connection is
> > > > available.
> > > >
> > > > Meanwhile I should be able to delete the messages from producer
> buffer
> > > > after some size / some days of interval the connection is not
> > available.
> > > >
> > > > --
> > > > Yogesh..BG
> > > > Senior Software engineer
> > > > Sling Media Pvt. Ltd.
> > > > PSS Plaza, #6,
> > > > Wind Tunnel Road.
> > > > Murghesh Palya,
> > > > Banglore - 560 017
> > > > Contact no: 7760922118
> > > >
> > >
> >
> >
> >
> > --
> > Yogesh..BG
> > Senior Software engineer
> > Sling Media Pvt. Ltd.
> > PSS Plaza, #6,
> > Wind Tunnel Road.
> > Murghesh Palya,
> > Banglore - 560 017
> > Contact no: 7760922118
> >
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message