kafka-users mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Mathieu Fenniak <mathieu.fenn...@replicon.com>
Subject Re: Kafka Streams on Windows?
Date Thu, 04 Aug 2016 16:42:18 GMT
Hi Eno,

Yes, I've looked at that.  RocksDB can be built and run in Windows, but,
the JNI wrapper does not include Windows binarie (
https://github.com/facebook/rocksdb/issues/703).  rocksdbjni-4.4.1.jar
includes librocksdbjni-linux32.so, librocksdbjni-linux64.so, and
librocksdbjni-osx.jnilib, so only supports Linux x86 & x64 and OS X.  It is
probably possible for me to build it myself and drop it in my classpath,
but, I'm looking for a lower friction approach if one exists. :-)

It looks like this was discussed recently on the Confluent Platform mailing
list (https://groups.google.com/forum/#!topic/confluent-platform/Z1rsfSNrVJk)
and the conclusion there was that high-level streams DSL doesn't support
configuration of the stores.

Mathieu


On Thu, Aug 4, 2016 at 10:28 AM, Eno Thereska <eno.thereska@gmail.com>
wrote:

> Hi Mathieu,
>
> Have you had a chance to look at http://rocksdb.org/blog/2033/
> rocksdb-is-now-available-in-windows-platform/? <
> http://rocksdb.org/blog/2033/rocksdb-is-now-available-in-windows-platform/?>
> Curious to hear your and other's comments on whether that worked.
>
> It is possible to have Kafka Streams use an in-memory store (included with
> Kafka Streams) for development purposes. In that scenario RocksDb would not
> be needed.
>
> Eno
>
>
> > On 4 Aug 2016, at 16:14, Mathieu Fenniak <mathieu.fenniak@replicon.com>
> wrote:
> >
> > Hey all,
> >
> > Is it anyone developing Kafka Streams applications on Windows?
> >
> > It seems like the RocksDB Java library doesn't include a native JNI
> library
> > for Windows, which prevents a Kafka Streams app from running on
> Windows.  I
> > was just wondering if others have run into this, and if so, what approach
> > you took to resolve it.
> >
> > I'm favouring the idea of running my applications in a Vagrant VM to
> avoid
> > the issue.  It makes the Windows development environment a little less
> > pleasant, but, seems plausible.
> >
> > Other ideas that occurred to me:
> >
> >   - RocksDB does support Windows, but, there don't seem to be any
> binaries
> >   available or packaged for it or the jni library.  I could probably
> build
> >   these myself, but it sounds a little painful.
> >   - Not developing on Windows.  Works for me, but, won't work as well for
> >   my colleagues.
> >   - Is it possible to make Kafka Streams not use any local state storage
> >   in some kind of development mode?  Not sure...
> >
> > Thanks,
> >
> > Mathieu
>
>

Mime
  • Unnamed multipart/alternative (inline, None, 0 bytes)
View raw message